I agree with Jeffrey and TheHoff, but would like to extend the range a bit .
I prefer a combo of 24, 50 and 85 on APS-C, and would like to add a 135 on FF.
I think on APS-C 24-30, 50 and 85-100 makes for a great prime set, maybe add a 14, and on FF 24-28, 50 and 85-100, plus a 135-150 makes for a similarly great set.
A 35 could be added, to fill the relatively large gap between 24 and 50, but personally I find I don't need it.
Of course 50L and 85L are the only two F/1.2 lenses, and both have incredible bokeh. Since you indicate you really like 50 mm as a focal length, I'd suggest you do get the 50L. From the tests I carried out, which includes all Canon 50s except the 50 F/1.0L (50 F/2.5 macro, 50 F/1.8 Mk I, 50 F/1.8 Mk II, 50 F/1.5, 50 F/1.2L), plus a Zuiko 50 F/1.4 and a Zeiss Contax 50 F/1.4, I reckon the 50L has the best IQ and bokeh at any f-stop. The others only can get close, and only at f-stops of F/2.8 and beyond.
Just make sure you get a good one, without major close focusing issues at F/1.4 - F/2.8.
Kind regards, Wim