Hammam az-Zahariyya, next to the madrassa of the same name, just north of Umayyad Mosque, has been in use since the 12th century. It's clean and well looked after.