Underexposed, and lack of contrast can make a photo at that ISO look that way.
Use your histogram, and use your exposure comp, I haven't had a Canon DSLR that I have not used at least 1/3 over on 99.99% of my shots.......10D+1/3, 3 20D's +1/3, Mk2N +1/3, 5D......I actually had to go a 1/2 on that camera. But regardless of the amount you need to use it to adjust for shots like that......it's part of getting to know your camera. For example when I shoot parties, or family stuff (in dark settings) I know I will get 98% of my shots perfect if I have my camera set to +1/3, and my 580 flash set to +2/3rd's.........sounds like it would be alot but it works perfect.
Bottom line is you have to find "the sweet spot".
And as far as your photo.......anything with that low of contast will look soft ( keep in mind that's what USM actually does...adds contrast), combine the fact that it's underexposed and that will show more noise.
At least from my experience that would be my guess.