Also on College Hill, the brick John Brown House , called the ‘most magnificent and elegant mansion that I have ever seen on this continent’ by John Quincy Adams, was built in 1786.