Helme church parish was first mentioned in 1329 during a Lithuanian raid. Most of the neighbouring land was fiefed in the 15th–16th centuries. Livonian Order castle in Helme (Ordensburg Helmet) was probably built in the first half of the 14th century. The site on a steep hill is belived to have been used as a stronghold earlier by Sackalians in the Ancient Estonia. By its ground plan the order castle was 120×60 m oval shaped structure, surrounded by two moats. There was a borough beside the castle in the Middle ages, it was mentioned until the 17th century. The castle was destroyed by the Swedes during the Russo-Swedish War in 1658. Nowadays only parts of the walls with high window holes have survived.
The Castle of Gruyères is one of the most famous in Switzerland. It was built between 1270 and 1282, following the typical square plan of the fortifications in Savoy. It was the property of the Counts of Gruyères until the bankruptcy of the Count Michel in 1554. His creditors the cantons of Fribourg and Bern shared his earldom. From 1555 to 1798 the castle became residence to the bailiffs and then to the prefects sent by Fribourg.
In 1849 the castle was sold to the Bovy and Balland families, who used the castle as their summer residency and restored it. The castle was then bought back by the canton of Fribourg in 1938, made into a museum and opened to the public. Since 1993, a foundation ensures the conservation as well as the highlighting of the building and the art collection.
The castle is the home of three capes of the Order of the Golden Fleece. They were part of the war booty captured by the Swiss Confederates (which included troops from Gruyères) at the Battle of Morat against Charles the Bold, Duke of Burgundy in 1476. As Charles the Bold was celebrating the anniversary of his father's death, one of the capes is a black velvet sacerdotal vestment with Philip the Good's emblem sewn into it.
A collection of landscapes by 19th century artists Jean-Baptiste-Camille Corot, Barthélemy Menn and others are on display in the castle.