This modest 17th-century castle is more like a simple fortress that was built as a defense against piracy.