I'd consider the Sigma 35mm.
35mm is the new 50mm, I find it better as a general lens than 50mm.
35mm isn't 50mm. It's fine that you personally prefer a 35mm prime, but that doesn't make the Sigma 35mm a good choice for a person who is looking for a 50mm prime.
I once owned 35-85-135 primes, partly because people talked about the 'holy trininty' and that these were the 'right' ones to own. For me they are not. Ideal for me is 24-50-100.
Anyway - to the OP I suggest the 50L if you can afford it. There are indeed differences, but you have to decide which ones matter to you.
For me the key difference is that the 50L autofocus is much better than the 50/1.4. When I had the 50/1.4 I found it to be a nervous performer, and it could be maddening in low light where it would hunt and miss.
Other differences:
Flare - 50L is much more resistant to flare
Bokeh - 50L is much smoother. The 50/1.4 is actually one of the worst EF lenses for bokeh. Then again, I rarely had shots with the 50/1.4 where I thought the bokeh was really objectionable.
Color - better on the 50L, but not a big deal IMO
Contrast - better on the 50L




