There was a church on the site of St Mary's since circa 1328, erected by Henry de Gower, Bishop of Saint David's. One Sunday morning, in 1739, the roof of the nave collapsed into the church while the congregation was waiting to enter the building. The whole structure was re-built apart from the tower. 1822 saw the church being lit by gas for the first time with thirty six lamps. The church underwent complete renovation between 1879 and 1882 by Vicar Dr Morgan. In 1896, the church was flattened and rebuilt again under the designs of Arthur Blomfield by Dean Allan Smith, though some parts of the old church survived the re-development. In February 1941 the church was extensively damaged by Bombing during the Blitz. It was not rebuilt until the 1950s.
From the 1890s the Swansea Devil stood on a set of buildings facing the west side of the church, constructed by a disgruntled rival of Blomfield's, angry at the commissioning of Blomfield's designs over his own.
References:The Villa d'Este is a 16th-century villa in Tivoli, near Rome, famous for its terraced hillside Italian Renaissance garden and especially for its profusion of fountains: the extraordinary system contains fifty-one fountains and nymphaeums, 398 spouts, 364 water jets, 64 waterfalls, and 220 basins, fed by 875 meters of canals, channels and cascades, and all working entirely by the force of gravity, without pumps. It is now an Italian state museum, and is listed as a UNESCO world heritage site.
Tivoli had been a popular summer residence since ancient Roman times due to its altitude, cooler temperatures and its proximity to the Villa Hadriana, the summer residence of the Emperor Hadrian I.
The Villa was commissioned by Cardinal Ippolito II d'Este (1509-1572), second son of Alfonso I d'Este, the Duke of Ferrara and grandson of Pope Alexander VI, along with Lucrezia Borgia.