Which lense to choose for 40D? Please advise!

I have a dilema and need some advice to which to choose and keep.

I have the 40D with the kit lense 28-135 IS. I also purchased the 70-300 IS to cover the telephoto range.

While I am happy with the 'walk around' lense 28-135, it's not a stellar lense. I was very disappointed with the 70-300IS. I am trying to use that lense on 2 different occasions. First is at my son's T-ball games. I found that the images were soft and didn't have the pop in colors. Also I found it missed alot of shots because it was slow to focus, even with IS. Second, I use it to shoot indoor low light body building contests from about 40-50 feet away. At that distance, without an external flash, again, I found the pictures were soft and lacked any pop in colors.

I am an amatuer for sure, but I guess I expected some crisper shots with these lenses. While not L glass, they aren't terrible quality either. Also, I maybe not doing something right as well.

I have an opportunity to exchange the 70-300 for something else. So, here are my questions.

- I am thinking about getting the 70-200L IS f/4 to replace the 70-300. Is this a good choice? I want a good portable lense that I can take hand held shots AND perhaps perform well in both conditions I described above. I know everyone will say get the 2.8, but I can't at that price

- I having heartache over have too much overlap in the range. I already have 28-135 and getting the 70-200 will only add 65mm to my range. Is this not a good way to go? I know I can get an 17-85 or something but I want to keep the cost down. Besides the 28-135 range is a pretty good single lense solution for most situations.

- OR, would you guys, keep both the 70-300 (so I can keep the portability and get the extra 100mm, and maybe learn to shoot with it) and get the 70-200 for sports OR would get something other than the 70-200?

- Lastly, I like to shoot some landscape, portrait, nature as well. Not sure if these lenses are right for me.

Thanks for any inputs!

Can you post some examples of shots you think don't have pop or are consistently soft? The conditions you're shooting in (at least the indoor bodybuilding) sound like they have poor lighting which will always lack that "pop" in the colors.

(and welcome to POTN!)

The 17-55 2.8 is a great lens for the landscapes and low light work.
Then I would look into the 70-200 2.8 non IS if the IS is out of your price range you could sell your other lenses and recoup some of your funds
You mention returning the 70-300 for another lens that will help on coat towards a better lens.

Another option is look into some of Sigma lenses like the EX DG with there IS system. From what I have read they make a good lens as well.

Without samples, we have no idea what the actual problem is. Please post some samples for us to look at.

The 70-200 is great lens. IF you will be taking sports photos then I would suggest the 2.8 version. The speed of the 2.8 will help. I've never done much in the wide angle area so I'm not much help there. The 70-200 f2.8L IS is also a great portrait lens. It is the lens I use most of the time when I'm not at the field. (That's when I use the 300 f2.8L IS which is an absolute gem.)