OMG, I am getting this same issue, I see him on detail but when I click done, which generally takes you to that villager, it just goes to one of the 3 huts. Could he have gone from nursing baby to child inside of one the huts during a rainstorm?