You do need to train them a bit also, but once they have some training - checking the box of a particular skill will indeed cause them to 'prefer' that task.
They may still wander a bit, I've noticed when food is low they will farm a little no matter what the preference is, but the check helps them stay on task to gain skill and once they are masters in many skills, the check indicates what task they will mostly be performing.
