Ogmore Castle construction might have begun in 1106. It was in use until the 19th century for a range of purposes, including a court of justice and a prison, but is now a substantial set of remains and a local landmark.
The earthworks were steeply banked and oval in shape, enclosing an area of 50 m in length by 35 m in width. The inner ward was flat and constructed of timber structures. After completion of the ringwork, the building material was stone. The windows were round-headed with Sutton stone ashlar. The first-floor great hall had an ornate fireplace.
William's son Maurice is credited with building the oblong keep; it is perhaps the oldest Norman keep in Glamorgan. Situated north of the main gateway, the keep was the first masonry building and was probably built in the 1120s. It is both the castle's tallest surviving building, and one of the oldest buildings in South Wales. Though only three of the original walls survive, their structure is characterized by irregularly shaped field stones, glacial pebbles, Lias limestone slabs, and brown mortar. Thomas de Londres replaced a timber palisade with a stone wall in around 1200.
In the early 13th century, a second storey was added that housed private apartments. Garderobes were featured on two levels and a latrine tower was part of the exterior. A well-preserved lime kiln was built over an indeterminate 13th-century structure. Subsequently, a courthouse dating to the 14th century and rebuilt in the mid-15th century, was probably the third building to occupy the same spot. The building was rectangular in shape with a simple doorway and was flanked by two chambers. Having sustained damage during Owain Glyndŵr's revolt, a new courthouse, situated in the castle's outer bailey, was built in 1454 and was in use until at least 1631.
The present-day castle remains consist of the keep and some outer walls.
Visby Cathedral (also known as St. Mary’s Church) is the only survived medieval church in Visby. It was originally built for German merchants and inaugurated in 1225. Around the year 1350 the church was enlarged and converted into a basilica. The two-storey magazine was also added then above the nave as a warehouse for merchants.
Following the Reformation, the church was transformed into a parish church for the town of Visby. All other churches were abandoned. Shortly after the Reformation, in 1572, Gotland was made into its own Diocese, and the church designated its cathedral.
There is not much left of the original interior. The font is made of local red marble in the 13th century. The pulpit was made in Lübeck in 1684. There are 400 graves under the church floor.