LOL, yeah you just need to keep dragging him back. If farming is marked, he will do that mostly, but they do have a mind of thir own, so they will do other work they know how to do from time to time.