Well do you have crops on farm? Check villager's like/dislike.Long as villagers is getting foods to food bin I think it isn't a big problem