Because the stories are never true. [Though he's pretty sure he ran into a ghost before. So he's not going to say he doesn't believe in ghosts in general, just the stories.]

Just try going to the mountains sometime. You'll probably hear it too!

...

Just don't follow it.