The chief's pointing is not intended to indicate the precise direction in which you should be looking. It could be anywhere.
Wow. didn't know that. I've only done that a few times so far so it must have just been dumb luck that I found my collectibles in the general direction the chief ended up looking.
I think its a neat new feature to help out with the collectibles because I never seemed to finish mine in vv2!