Schloss Ortenburg sits on a strategic cliff-top spot that's been occupied by a series of castles since the 7th century. You enter the complex through its most interesting structure, the late-Gothic Matthiasturm (Matthias Tower), named for the Hungarian king Matthias Corvinus who ruled over the region in the late 15th century - you can see him depicted on horseback as a monumental relief on the tower.
The main palace houses a regional courthouse and is not open to the public. A smaller one, off the courtyard, contains the Sorbisches Museum, which displays Sorb folk art, musical instruments, costumes and other items in the old salt storehouse.
Across the square is Bautzen's new theatre, noteworthy mostly for the amazingly detailed neoclassical sandstone frieze that's been incorporated into the façade. Sculpted by Ernst Rietschel in 1804, it depicts the tragedy of Orest from ancient Greek mythology and originally decorated the now-destroyed Hoftheater in Dresden.