This is a small museum with exhibits of scrolls, armour and paintings that were once the property of the Ikeda clan (who ruled Okayama for much of the Edo period). It's near the rear entrance of Okayama-jō. Look for the traditional black-and-white building.
