The 35L is the better lens, but it came down to focal length, price, size and weight. I couldn't justify over $1k for a lens that I didn't like, even though it had very good optics. 28, 50, 85, 200 are my favourite focal lengths I think. I don't miss the 50 1.4 much, I like my Sigma 50 1.4 more, but the 28 1.8 is a lens I do miss.
Granted I was on full frame though, I like the 35L more on the 1.3x crop, but again, I didn't feel good paying that much for that lens given the equally fast 50mm options out there.
"Foot zoom" is not a legit argument. Perspective is entirely a function of camera position and distance, so 'foot zooming' changes your perspective, necessarily. If I wanted to get really close, I found I wanted a little wider than 35, but if I wanted to shoot from a perspective flattering for portraits, I found the 35mm too wide.