Have owned both as well and the 15-85 was my next lens after the 17-70 non OS. I personally have not once regretted the purchase of the 15-85 as it's my go to general purpose/landscape lens. I've owned it for a little more than 2.5 years. The key differences that I personally noticed in my unscientific comparison:
- Very fast and reliable USM autofoucs on the 15-85
- Canon has the IS but Sigma is slightly faster aperture
- Sigma non-OS has much closer MFD
- The Canon is sharp wide open, the Sigma needed to be stopped down to get the best out of it.
- I thought colors/contrast are better with the Canon
- 15mm vs 17mm is a noticeable difference on the wide end.
That said, and as Taylor pointed out, resale on the 17-70 non-OS is quite low, although I think it would be a real bargain for someone wanting to step up from the 18-55, but not having the money for something more costly. You need to ask yourself though if the approx $350 premium (for a used 15-85) is worth it for the (IMO) net gains that can be realized.