The first Scaliger houses can be found in the area around Piazza dei Signori, which was already densely populated in Roman times. Initially they were very modest, being the characteristic house and tower structure but were later enlarged and transformed into mansions with the growth of the family's power, whilst around them other buildings were put up and used for court administration, and are today the palaces of the Tribunale and Prefettura. 

Cangrande I also fortified the city with walls and ramparts which, starting from the Adige at S. Giorgio, follow the profile of the hill and come down to the riveragain at the actual cemetery bridge. The Scaligers decided to mve their residence outside the centre of the city only when their relationship with the city worsened. It was then that they began the contruction of the S. Martino Aquaro Castle which was later to be called Castelvecchio. The imposing structure, which now houses a collection of paintings and sculture, included the residence of the lords and a training camp and barracks for the troops. Protected by the moat and walls, the castle was connected to the other bank of the river Adige by a battle- mented bridge, thus guaranteeing a swift escape route in case of a revolt in the city.

The castle was transformed into barracks by the Venetian Republic and in 1960 was radically restored by Carlo Scarpa who brought to light the elements of the primitive structure. 

The greatness of the Scaligers can be seen in the Arches and monumental tombs, masterpieces of Gothic art, which are erected besides the little church of Santa Maria Antica, the private church of the Della Scala family.