People will complain about there being bad copies of both. I'm not a pro, but I've managed to have multiple copies of both due to pure indecisiveness. My end conclusion, which probably is only relevant to me, is:
1. 24-70 is a bit sharper, with better contrast, when wide open.
2. 24-70 has nicer bokeh, but by no means the bokeh of a 135L or 85L.
3. f2.8 makes a big difference, both in isolating a subject, and with a 5D being able to sometimes shoot without a flash indoors.
4. the extra 105 mm is nice of the 24-105.
5. when carrying the lens of a long time, the size of the 24-105 is nice compared to its f2.8 counterpart.
6. despite the f2.8 versus f4.0, I have noticed no difference in autofocus speed or accuracy.
So, I generally believe a 24-70 is a better lens for portraits -- which is what I was using it for -- friends, family, etc. But, that said, I now have a 24-15 because, as someone already said, a prime does much better. And for me, the range of the 24-105 was more important.