I saw in another thread that the best thing to do is stack them on top of each other on the diving board. That way they will not interfere with your ability to see collectibles and mushrooms.

After finishing the game and having all the collectibles and no longer needing any mushrooms, I think places that were mentioned such as the graveyard or the mosaic would make nice showcases.