Set in a head-turning modern building on the north bank of the Blanda River, this small museum displays local handicrafts, painstakingly intricate embroideries and early Icelandic costumes.