The modern prison didn't just happen – it was invented, and Eastern State Penitentiary was the first one, opened in 1829 and finally closed in 1971. An excellent audio guide leads you through the eerie, echoing halls. There's also broader information on America's current prison system, and fascinating art installations throughout.
From mid-September through Halloween, the prison hosts a truly terrifying haunted house.