No, it's possible. Click on one of your little villagers, and press the f6 key. Just be careful though, when you get to the end of the selections you can't go back.