There is an easier way to do this if you're interested. Keep a picture of one of the kids in the the box where you can select the villagers...you know, the one with the arrows so you can scan through the tribe? Then you can move around looking for collectables without holding the kid. When you see a collectable, click on the kids picture and you'll be able to go right to the kid and drag him/her back to the item.

I did the "flying scan" for a long time before I came up with this method.