Guarding the town’s southwestern approaches, the late-17th-century ‘Outer Castle’ is best seen from the water (on a boat trip) as it’s inside a military zone.