Charlie wrote in post #15953077
I do think you're putting the chicken before the egg. 100 real world shots and 200 test shots seems backwards to me.
before I do test my cameras, I put them through the ringer with a lot of shots over different days. If you shoot as you normally do and have little issues, then no need to run test shots. Also, it might be a good idea to invest in Focal or something, to automate the process and take out human errors in testing procedures.
good luck with your findings.
I don't understand this comment. The OP did a walkabout of everyday usage and found a tremendous number of shots were mis-focused:
I came back with the largest percentage of non-keepers ever.
So then, being a good scientist/engineer, the OP performed a bunch of repeatable tests using a fairly standard test set-up. And confirmed his suspicions that the focusing behavior was erratic (non-repeatable for a given specific condition) and variable (front and back focused seemingly uncorrelated with any particular lens setting).
The same tests with the same camera body and other lenses did not exhibit the same erratic variability.
The OP came to a fairly sane conclusion (IMHO) that this particular copy of the lens is bad. What the OP would like to hear is whether there have been a larger-than-normal number of bad copies of this lens, or is the extremely rare? If a lot of bad copies, the OP was strongly considering returning the lens (rather than exchanging) and trying something else.
There were far too many negative-to-the-OP posts in this thread for this type of forum. We're supposed to be supportive of posters with issues, trying to help them solve their problem. Instead "we" are telling them the test rig was wrong (it wasn't), or that they aren't testing correctly (live view vs viewfinder, which had no reported difference), and that they should do more real-world tests and stay out of the lab until they are certain the lens is crap (seemed like a pretty easy conclusion to make after that first day, didn't need days and days of real world shots).
We could have approached this far better, even while making the same points overall (although I still think the questioning of technique was unwarranted):
"Hey OP, did you try Live View as well as through the viewfinder?"
"Hey OP, where do you focus the camera on that test rig? It looks like a simple tilted piece of paper to me."
"Hey OP, your tests don't mention anything about edge-to-edge focus. Did you try taking a photo of a flat textured wall parallel to the sensor to see if there is variability across the frame?"
Instead we get responses that assume the OP "did it wrong" and sniping about trade-show tests (which wasn't even the OP).
Yeesh.
This is just a lens, folks, not a religion or your children. It can be returned if deemed defective for the slightest reason.
And if not defective or the defect is easily fixed by Canon, then the OP has generated a future Canon Refurb Shop sale...
shinksma