Are you pausing and un-pausing the game a lot (for example, to place children onto collectibles)? That practice will often adversely affect the game's timers, particularly those of nursing moms.

While many people use pause to help them with everything from breeding to collectibles, the game was designed to be paused while you are away from it for several hours, not as a means to assist with game play.