I suppose it really depends on what you want, and how much you object to swapping lenses.
I really loved the 10-22, and only sold it because it doesn't fit the new camera. But my creative skills weren't (and still aren't) good enough to make proper use of UWA - I was very much a "cram as much as possible into the shot" type person rather than using it creatively. As a result, once I'd taken a few wide shots I felt the need to go back to something more flexible - i.e. the nice easy zoom life presented by the 24-105. This combined with my dislike of lens-changing (I'm paranoid about dropping lenses - stupid I know) meant that the 10-22 didn't get as much use as it should have done. And IMHO there is little worse than lenses sitting unused on the shelf.
Given that you're set on the 10-22 but unsure on your other options, perhaps you should just get the 10-22 for now? Personally if I had *only* a 10-22, and no 24-105 comfort blanket, I reckon I'd be forced to think more creatively about shots than I otherwise would, and as a result my photographs would be "better" - in a similar way that primes force you to give more consideration to composition and positioning than zooms.