The castle was probably built in the 13th century most likely in place of an ancient Estonian stronghold. The bailiwick of Karksi was first mentioned in 1248. The stronghold had a chapel dedicated to Apostle Peter. The first reference was made to a local clergyman in 1298. The present stone church, very simple in design, was built in the same place between 1773 and 1778. St. Peter’s Church is in the ruins of Karksi castle. The tower of the church is leaning, the inclination of the tower’s top is 205 cm at the moment. In 1994 it was decided to save the tower using complicated "construction surgery" developed while stabilizing structures in the old town of Tartu. Eight 10- metre-tall bored piles along with concrete beams penetrating foundations form a new bearing surface for the tower. As a result, the further leaning of the tower has stopped.
On the way which takes you to the stronghold, in the former cemetery of the Knights of the Order of the Sword, stands a nice Baroque chapel among trees, built in the early 18th century by Field Marshal George Reinhold von Lieven, the owner of the Karksi manorial estate. The coats of arms of the Lievens and the Mannteuffels have been fixed to the chapel doors. The chapel, similarly, was built with one side on the former foundation and therefore is somewhat leaning. The buildings of the Karksi manor have perished.
Fisherman's Bastion is a terrace in neo-Gothic and neo-Romanesque style situated on the Buda bank of the Danube, on the Castle hill in Budapest, around Matthias Church. It was designed and built between 1895 and 1902 on the plans of Frigyes Schulek. Construction of the bastion destabilised the foundations of the neighbouring 13th century Dominican Church which had to be pulled down. Between 1947–48, the son of Frigyes Schulek, János Schulek, conducted the other restoration project after its near destruction during World War II.
From the towers and the terrace a panoramic view exists of Danube, Margaret Island, Pest to the east and the Gellért Hill.
Its seven towers represent the seven Magyar tribes that settled in the Carpathian Basin in 896.
The Bastion takes its name from the guild of fishermen that was responsible for defending this stretch of the city walls in the Middle Ages. It is a viewing terrace, with many stairs and walking paths.
A bronze statue of Stephen I of Hungary mounted on a horse, erected in 1906, can be seen between the Bastion and the Matthias Church. The pedestal was made by Alajos Stróbl, based on the plans of Frigyes Schulek, in Neo-Romanesque style, with episodes illustrating the King's life.