The convict-built St Matthew’s Anglican Church held its first service in September 1821. It remains the oldest Anglican church in Australia.