I owned in the past a 300 2.8 IS that I used with an extender, and now own the 500 F4.5 L non-IS. I don't miss having IS 99% of the time, since I use the lens on a steady tripod and gimbal head. The 500 F4 IS would certainly be nice for a couple of reasons, but frankly it is twice as much money, and I am not so sure it has twice the benefits, and certainly not twice the image quality. Really the only time I got frustrated not having IS on the lens was trying to get a picture of Jupiter with stacked extenders, as even the slightest vibrations at that MM trying to find a little dot in the sky are extremely multiplied. Far from a deal breaker though.
I think the 600 F4 non-IS is a no go for most people cause it is just SO HUGE and heavy. The 500 4.5 is actually a very nice lens, lighter than the F4 IS, even new F4 IS II, and still great IQ. With the price of used 500 F4 IS's quickly shooting toward $7k and up, the non IS at around half that was just too appealing to me.