Yes, bps summed it up well. Wide-angle lenses tend to be more suitable for landscape work. It's a rare shot that would require 500mm, and you would need an incredibly clear day to shoot through that much atmosphere and not have a ridiculously hazy photograph. Such long lenses are better for wildlife photography, where you're not actually shooting all that far into the distance, you're just trying to fill the frame with something very small (like a bird).
My three most-used lenses for landscapes are the 17-40 f/4L, the 24-105mm f/4L IS, and the 70-200mm f/4L IS. If you're using an APS-C camera, then I would recommend the equivalent lenses 10-22mm for the wide end, etc.