The first mention of Esslemont is as the 'manor of Eislemont' in the 14th century. The lands of Esslemont were passed by marriage from the family of Mareschal by marriage of the heiress Janet to Francis le Chen of Straloch in the 14th century. After the castle was burnt in 1493, Henry Cheyne undertook re-building via a king's licence dated 1500. In 1564 Patrick Cheyne was created baron of Esslemont by Queen Mary, who stayed here during her campaign against the Earl of Huntly, and a fortalice and tower were recorded in 1575–1576.
The castle was then destroyed as the result of a feud between the Cheynes and the Hays. The name of the lands, now as 'Essilmounthe', appears in Scottish records in 1609.
The castle ceased to be regularly occupied in 1625, when the estate passed to the Errol family. In 1728 it became the property of Robert Gordon and may have been partially occupied till 1769, when the existing mansion, Esslemont House, was erected in its vicinity.
The castle is roofless and missing large sections of wall which were reused in building sites nearby. Especially noticeable are the missing dressed stones of the windows. The structure is a L Plan castle with a staircase turret and a round tower at the south east angle. The main building seems on the ground floor to have contained the kitchen, with a wide fireplace in the north gable; the rugged edges of the ruined sides of the flue being visible high up in the gable. Though ruined, the remains are clearly on three stories. The Gordon Arms are visible on the exterior of the castle.
References:Visby Cathedral (also known as St. Mary’s Church) is the only survived medieval church in Visby. It was originally built for German merchants and inaugurated in 1225. Around the year 1350 the church was enlarged and converted into a basilica. The two-storey magazine was also added then above the nave as a warehouse for merchants.
Following the Reformation, the church was transformed into a parish church for the town of Visby. All other churches were abandoned. Shortly after the Reformation, in 1572, Gotland was made into its own Diocese, and the church designated its cathedral.
There is not much left of the original interior. The font is made of local red marble in the 13th century. The pulpit was made in Lübeck in 1684. There are 400 graves under the church floor.