We need prisons! The player would have a rare chance of stumbling upon a massive prison type building with lots of villagers in the cells. But, prison guards and "The Warden" boss (possibly more mini-boss like) can attack you if you attempt to break into the prison. If you get all prisoners out, you get some pretty cool rewards.
Just an idea, feel free to offer up additions to it!