In the Roman times the city of Peqin was known by the name of Clodiana, an Illyrian-inhabited territory. The foundations of the castle are thought to date from the Roman period, the time of the construction of the Via Egnatia. Its walls at one point had a height of around 12 metres. The castle was later rebuilt and expanded during the Turkish occupation of Albania, at which time it was passed into the control of the Sipahi (lord) of the local fief, who added a palace and a harem. The last resident of the castle was Demir Pasha.
The castle was equipped with subterranean tunnels which served as exits several km away from the city in difficult times. Similarly, clay pipes have been found in the walls of the castle, which archaeologists believe is an indication that water was supplied from outside the castle during wartime.
The city walls of Avila were built in the 11th century to protect the citizens from the Moors. They have been well maintained throughout the centuries and are now a major tourist attraction as well as a UNESCO World Heritage Site. Visitors can walk around about half of the length of the walls.
The layout of the city is an even quadrilateral with a perimeter of 2,516 m. Its walls, which consist in part of stones already used in earlier constructions, have an average thickness of 3 m. Access to the city is afforded by nine gates of different periods; twin 20 m high towers, linked by a semi-circular arch, flank the oldest ones, Puerta de San Vicente and Puerta del Alcázar.