I saw some people needed some help finding this elusive rock.
You know when debris completely block the stream, a little waterfall goes over the cliff and meets the ocean? Try flying your little villagers around there after clearing the debris. You should find it pretty quickly.
Hope that helped!