When Lovecraft wrote his stories, mankind knew considerably less about the universe than we do today, and the idea that the universe just does not care, that there is no benevolent god that watches over us, was still kind of new and terrifying.
Yeah, his writing isn't scary by modern standards...