The earliest traces of human settlement on the Sulzbach castle hill have been dated to the Late Hallstatt or Early La Tène culture. The medieval settlement was built first in the 8th century or early 9th century. The partially stone-made castle was built there in the 9th or 10th century. In 1003 the castle was moved to the Nordgaugrafen family by Henry II. The medieval castle was rebuilt from 1618 to the Renaissance style. Today the original tower from c. 1100 exists.
The Château de Chantilly comprises two attached buildings: the Petit Château built around 1560 for Anne de Montmorency, and the Grand Château, which was destroyed during the French Revolution and rebuilt in the 1870s. Owned by the Institut de France, the château houses the Musée Condé. It is one of the finest art galleries in France and is open to the public.
The estate"s connection with the Montmorency family began in 1484. The first mansion (now replaced by the Grand Château) was built in 1528–1531 for the Constable Anne de Montmorency by Pierre Chambiges. The Petit Château was also built for him, around 1560, probably by Jean Bullant. In 1632, after the death of Henri II, it passed to the Grand Condé who inherited it through his mother, Charlotte Marguerite de Montmorency.
Several interesting pieces of history are associated with the château during the 17th century.