gjl711 wrote in post #19059965
Isn't that pretty much what most of the legitimate review sites do? DxO with their sensor reviews, DPreview with their in depth reviews, Imaging Resource, Digital-Picture, and a few others.
What does it all mean, though?
Interpretation varies, and some comparisons are done in a meaningless context.
Comparing different sensor sizes at the same ISO sounds logical, but the fact is, your gear only takes photographs with a sensor and a lens, combined, and different size sensors require different optics for the same photo, and for situations where one is focal-length-limited, a larger sensor means that you discard more of the sensor area, and get a lot less of what these academic comparisons suggest you would get. It is nice to have these comparison tools with controlled exposure, but the most simple and direct use of them is often misleading for many types of photography. They are biased towards making larger sensors and larger pixels seem like they are always giving better results, but that is conditional and heavily dependent upon using a larger lens along with the larger sensor.
A complete set of comparison images might require more ISO settings, at 1/3-stop increments, to compare different sensor sizes in equivalence. The DPR tool included ISO 32000 shots from the 5D4, which it does not do for most cameras. That ISO allows you to compare against Canon APS-C cameras in equivalence, though, at ISO 12800. When you do that, the 7D2 has about the same noise as the 5D4 in daylight mode, and a little bit less than the 5D4 in incandescent mode. This suggest that per unit of sensor area, the 7D2 has almost identical noise at high ISOs as the 5D4, or better in warm lighting. The 90D takes that another, step, and the 90D has significantly less noise than the 5D4. Most people looking at these comparisons, using the same ISO for FF vs APS-C, would never notice this, nor would they notice it if they changed the ISOs for each camera independently until the noise looked about the same. The same f-ratios are used for FF and APS-C, which means that the APS-C cameras are showing more diffraction than full equivalence would dictate, and don't cut through the noise the way they would.
Then, you have the issue that these comparison tools do not help directly with focal-length-limited concerns. If they did that, they would shoot all sensor sizes the same distance from the target. Then, it would make sense to compare at the same ISO (as the f-ratio of the same lens dictates ISO exposure index in focal-length-limited situations; not sensor size), and scale the results up so that objects in the frame appear the same size in the comparison.
So, I have a love/hate relationship with these tools; I am very glad that people are providing RAWs with controlled manual exposure, but they are incomplete, and many people will draw the wrong conclusions from them, as they are biased to make larger sensors look better all the time, when the fact is, that potential superiority is conditional, and is often due in real photography to having a larger lens, or by being closer to the subject.