In addition to the famous portrait of Baron Leopold Lichtenberg-Janežič from the 19th century made by the renowned painter Jožef Tominc, the National Gallery in Ljubljana also holds five portraits belonging to his ancestors from the 18th century. The restored mansion, a cultural monument of national importance since 1999, now houses several national and international institutions, and keeps interesting stories of the lives of its past owners. The article first provides a brief overview of the owners of the Jablje mansion from the Middle Ages to the mid-18th century and then proceeds to describe the life stories of persons in the portraits, some of the members of the Schwab-Lichtenberg and Lichtenberg-Janežič families, who held the mansion in their possession until 1941, the year of the death of the last owner, Baroness Hyppolita.