Your farmer needs to look for something to take care of them. Remember the tried and true technique of dragging your villagers around to see what they notice? It works here, too.