Im not sure how much use you would get out of either of these lenses as you already have the 100, but i vote for the 135L. I owned the 85 1.8 which I used on a crop body, but I was not a fan of it (I'm aware that many people are, but it quickly became my least used lens). After upgrading to full frame I picked up a 135L and it quickly became my most used lens. For very similar field of view on the FF that the 85 had on the crop, I put this down to other characteristics of the lens. For me, for closely cropped portraits and for outdoor portraits, I much, much prefer the 135L.
Ive never owned the 85 1.4, but have used one a few times, and found the experience to be similar (although a little better) than the Canon.
You probably didn't like it because your depth of field is much wider on a crop body, so that means you get much less background blur on crop sensors. Now with the 135, you get lots of background blur.