Still used by fishing vessels but dominated by pleasure craft, the port is lined with evocative old buildings.