Goat Island, west of the Harbour Bridge, has been a shipyard, quarantine station and gunpowder depot in its previous lives. Heritage tours are offered for groups of 20 or more (see the national parks website for details).