The Monastery of St. Michael on the Heiligenberg (Saints" Mountain), was a branch of the nearby Lorsch Abbey. The ruined complex that can be seen today was built beginning in 1023. Within the nave are traces of the Roman temple of Mercury. The monastery was abandoned in the 16th century.
The first mention of the monastery is in the Lorsch codex, from the 12th century, which dates the founding of the monastery to 870. No remains of an earlier monastery have been found, so this might have been merely an estimate of the founding.
References:Herceg Novi was founded (on a former small fishing village, existing since Roman Empire times) as a fortress in 1382 by first Bosnian King Stjepan Tvrtko I and was called Sveti Stefan or Castelnuovo. The Turks conquered Herceg Novi in 1482, and ruled for 200 years, until 1687. However, there was a short pause between 1538 and 1539 when it was held by the Spaniards before they were defeated in the Siege of Castelnuovo. Turkey ruled again until 1687, from then until 1797, the town was ruled by the Venetian Republic.
The Herceg Novi old town is amazing. It is on a fairly steep hill that leads all the way down to the sea. Wandering through the small stairways to the various plazas and fortresses is a many hour adventure.