I hadn't really noticed that patch of dirt - it looks kind of like a path, doesn't it? And if you follow the line it makes you can see the top of what looks like a gate or fence made out of bamboo or something similar. Maybe you have to solve a puzzle to get into that area?