I have both lenses as well. IMHO, the 85 is an exceptional value. I use mine often, especially when I want a walk around lens with a little reach and none of the look-at-me factor a big lens has. Great lens.
But the 85L easily two or three times better if only for that luscious bokeh. Certainly not five times better. But better is better. It's not a great value, especially compared to the 85, but it is a great lens in it's own right in ways the standard 85 can't quite match.
It's a quirky lens, too. The slow focus and hunting in low light. And the sheer weight. It really isn't for everyone. But take the time to find what it does well and it is a hard lens to part with.