I like the 70-300L for its compact size and am looking forward to traveling with it and the 17-55 as my two lenses (with maybe the 28/1.8 thrown into the bag as well). I was looking at the 70-200/4 but concluded the extra size wasn't going to work for me. The 200/4 has the advantage of being lighter, though.
After paging through the sample photo threads of all these lenses, it's obvious that all of the L's in this range can produce amazing images. The 2.8's are mindboggling (but vvvvery expensive), but I don't think there's a dud in the lineup.

