This height above the fertile plain is undoubtedly frequented since at least the end of antiquity. The charters of the eleventh century evoke the castrum of Grimaldo, probably before that date

For three centuries favorable, the village and the economy are developing. The middle of the 14th century marks the end of this period of splendor. Economic and demographic crises, combined with plague and war, forced the inhabitants to group themselves at the top of the hill and to build in the 1370s this bulwark to protect themselves. There are only a few traces left of the fortified entrance-gate here.

The fortifications have evolved over time: summaries in the XI-XIIIth century, they enlarged in the fifteenth century to be at their apogee in the XVIIth century. The abandonment at the end of the eighteenth century, and dismantling during the French Revolution, culminated in the destruction of this castle.

Large families succeeded one another, first linked to the Counts of Provence, then to King Charles II. In the middle of the 15th century, Jean de Cossa, Grand Sénéchal, mark of its borrowed territory, founding the village of Saint-Tropez that we still know today. Then in the middle of the eighteenth century, the lords of the powerful family of Castellane enlarge the building and build the south towers.

Classified as a Historical Monument, it has enjoyed restoration campaigns since the 1980s