A 20-hectare botanic garden is on the site of a former sugar estate which has many stately mature citrus and breadfruit trees.