I shot the 80D and 1D4 side-by-side for a few weeks. The AI-Servo AF on the 80D is every bit as good as that on the 1D4; speed, tracking, and accuracy on the 80D are all top-notch. For shooting in less than ideal light, the 80D is superior, by far.
The 1D4 has every custom function you could imagine. The camera is hugely configurable. The 80D, not so much. The 80D has EC in manual mode mode. The 1D4 can simulate that, but it is a cumbersome combination of custom function settings.
I think the 80D is more than a stop better than the 1D4 when pushing ISO. The 1D4 at 6400 leaves you some of post-processing work. I shoot my 80D JPG at 6400, if the light is OK.
My main reason for moving from 1D4 to 80D was size/weight. My field sports set-up went from the 1D4/100-400Lc to the 80D/70-300 II. I am right at 1/2 the weight, and I gave up nothing with respect to reach/AF/IQ. The 70-300II (nano-USM) is an amazing lens. The IQ is a half-notch less than the 70-200mm f/4L IS. The AI-Servo performance made me bust into my Happy, Happy, Joy, Joy! dance. While I'm on nano-USM, the 18-135 is also an AF dream. It is good enough to shoot sports/athletics. You can't use the 18-135 with a 1D4.
I am happy with my move from 1D4 to 80D, though I do miss 10fps from time to time.