Near the tiny, beautiful little walled town of Woudrichem you'll find the 14th-century castle, Slot Loevestein. The ancient keep is wonderfully evocative, perhaps more so for the difficulty involved in getting here. It has been a prison, residence and toll castle, though more recently it has hosted various cultural events.
It's best accessed by ferry (www.veerdienstgorinchem.nl) from Woudrichem (€3) or nearby Gorinchem (€5), where there is a train station. National bike route LF12 passes through between Dordrecht and Den Bosch.