You needn't worry about guests contacting you, since only registered users can post or send messages (or even search the forums, for that matter). However, being invisible only prevents you from being displayed in the "Who's Online" list. It doesn't prevent registered users from contacting you by clicking your name. If you don't want people to send you private messages, you'll need to change your Preferences (the same screen where you control being invisible).