On the hilltop above the old gompa are the ruins of the mud-brick fort that sheltered the entire population of the valley during times of war and gave the village its name (khar means 'citadel' and dhak means 'cliff').