What comparison are you making there?
The 24-105L vignette reaches a maximum of -3.5 stops at the extreme corner at 24mm and f/4
If I grab the 16-35 II (a contemporary design I've owned)
16mm and f/2.8 = -4.5 stops (so yes, worse. But we are comparing a one stop faster lens at dramatically different focal lengths)
24mm and f/2.8 = -2.0 stops (much better at 24mm despite being faster)
24mm and f/4 = -1.0 stops (much better)
So the point is, if you owned both lenses and needed to take a picture at 24mm and f/4, the 16-35 would be a better choice. I used to own the 16-35 II as well as the 24-105L. And while I loved the 24-105 for portability, if I had all lenses with me and needed to take pictures at 24mm I would use the UWA because it was better in the range from 24mm to 28mm.
Nevertheless, I still take a lot of pictures with the 24-105L at 24mm because it is my one-lens walkabout.