2 totally different lens for totally different uses and looks.
How often do you find yourself wishing you had something wider than 24mm? If the answer is "never" then go for the 85mm. If the answer is "At least once at every shoot" then go for the 14-24.
I personally prefer a long focal length. I shy away from the wide end of my 24-70, and I only get out my 14mm Rokinon when I'm doing interior panos. So, if it was me I would probably go for the 85mm.
I think the 85mm 1.8 is next on my to-buy list. Well, after a battery pack for my strobes. I've thought hard about the 85L but I just don't think it would beat the 1.8 for my needs. Heavy, expensive, and slow focus? Nope, can't deal with it. (OK, that's a little bit of sour grapes, too)