It depends upon the lens... some lenses have seen "silent upgrades" over the years. Others haven't.
AFAIK, the 70-200/4L selling new today is identical to what has been sold since it was introduced (1999), so I doubt there would be any advantage to buying a more recent copy.
The other possible factor is wear and tear. If the lens you got has seen light, amateur use and appears well kept, all the Canon 70-200s are real workhorses and may hold up for many years or even decades use.
My 70-200/2.8 IS "Mark I" from 2001 still works perfectly, but it's obviously been used pretty hard. This particular model did see a "silent upgrade" revision to the IS mechanism, but according to Canon it was only done for serviceability and didn't improve durability or effectiveness of the IS, so I never spent the $600 to have it done.
I also have a 70-200/4 IS that I bought used a year or two ago (though it looked like new then), and it's been very reliable as well. The IS version was introduced in 2006, so that's the oldest my f4 IS lens could be. I just haven't looked to see if I can find a build code on it.
But, again, all five models of the EF 70-200s have been really tough, pro-grade lenses.... L-series with reasonable sealing for dust and moisture resistance. Use a flashlight and check out the innards. There are probably a few specks of dust in there (nearly all lenses have a few), but so long as there's no fungus or element separation, it will likely be a great lens. Test shots with it will tell you the rest of the story.