Opposite the train station is where you'll find mammoth neo-Gothic Celje Hall, built in 1907 and erstwhile social centre for German-speaking Celjani, which now contains the year-round tourist office.
