The history of Welzheim reaches back to the time of the Roman Empire. Around the year 160 AD the Romans founded a colony and two forts there; linguists reconstructed their Latin name as (Castra) Valentia on the base of the town's medieval name Wallenzin first mentioned in 1181. In 1980, for the 800th anniversary of the founding of the city, the eastern part (Ostkastell) of the ruins was reconstructed, and in 1993 an archeological park was founded on the site. It contains replicas of Roman stone monuments and explanatory plaques about Roman Welzheim. The western part of the fort was built over through the years.
Dryburgh Abbey on the banks of the River Tweed in the Scottish Borders was founded in 1150 in an agreement between Hugh de Morville, Constable of Scotland, and the Premonstratensian canons regular from Alnwick Abbey in Northumberland. The arrival of the canons along with their first abbot, Roger, took place in 1152.
It was burned by English troops in 1322, after which it was restored only to be again burned by Richard II in 1385, but it flourished in the fifteenth century. It was finally destroyed in 1544, briefly surviving until the Scottish Reformation, when it was given to the Earl of Mar by James VI of Scotland. It is now a designated scheduled monument and the surrounding landscape is included in the Inventory of Gardens and Designed Landscapes in Scotland.
David Erskine, 11th Earl of Buchan bought the land in 1786. Sir Walter Scott and Douglas Haig are buried in its grounds.