The site of Cuzorn, located in a bottleneck of the Lémance valley, allowed control of access to the region, but its origin remains unknown. The first mention of Cuzorn dates back to 1242, in the ruins of the Belleperche abbey, where an inscription mentions a certain B. de Cuzorn.
In 1259, the local nobility paid homage to the Count of Toulouse, including the brothers Gaubert, Pons, Guillaume, and Gaillard de Fumel, although neither lordship nor castle were mentioned at Cuzorn. However, documents from 1270 mention the lords of the castle of Cuzorn and Amalvinus de Cuzorn in conflict with the Bishop of Agen, suggesting a construction of the castle between 1260 and 1270.
Over the centuries, the lordship of Cuzorn had several owners, including the de Lézergues family and later the Gontaut de Saint-Geniès. In 1442, the castle was besieged, and later its defenses were dismantled. Subsequently, the lordship passed between different families until the 19th century.
In 1953, the castle was acquired by Georges Rastel, who undertook significant renovation work. In 1995, Thierry Delrieu became the owner of the castle, while the ruins were transferred to the municipality in 1996. In 1950, the castle was listed as a historical monument.
Červená Lhota castle stands at the middle of a lake on a rocky island. Its picturesque Renaissance building is a destination of thousands of tourists every year. Its name Červená Lhota meaning 'red lhota' can be explained by the colour of the château"s bright-red roof tiles. There is also a park, where the Chapel of the Holy Trinity is located.
The existence of an original fortress on the site of today"s château is assumed from sometime around the middle of the 14th century. It was built on a rocky granite outcrop, which, after the damming of a stream and the filling up of a fishpond, became an island. The first written source is an entry into the land records from 1465, mentioning the division of the property of deceased Ctibor of Zásmuk between his two sons Petr and Václav.