The test process

Testing digital cameras is expensive. To help with the high cost, test results are shared between a number of consumer organisations around the world.

All the tests and procedures described in this article are carried out or overseen by professional testers in consumer laboratories in Europe.

To try to keep up with the rapidly evolving digital camera market, we test batches of cameras 5 or 6 times a year. The lab is constantly testing cameras, but each batch can take some months to complete.

We only test products we can purchase from retail outlets, which means we're often a bit slower than places that take samples from manufacturers, but at least we know that what we're testing is representative of what you're likely to see on the shelves.

Before any testing begins, the lab makes an exhaustive list of each camera's features and specifications.

For the most part we don't rely on manufacturers specifications. For example, we take measurements that include all protruding parts when the camera is off and weigh them with their memory, batteries, neck straps, and so on, that come as standard. Manufacturer's specifications often leave these sorts of things out, but our intention is to try to give you information that relates to actual use.

All computer-related tests are performed on an up-to-date PC. The 5 monitors used are profiled and calibrated EIZO ColorEdge CG21 or EIZO S2433W and both monitors and video cards are adjusted to sRGB colour space.

In order to compare the test results to those of the previous tests using this method, in all relevant tests (especially those where a subjective score is given, such as the outdoor shots) samples from the last test are re-tested in certain aspects and used as anchor for scoring.

Unless otherwise noted subjective tests are evaluated by 5 people, among them at least 3 interested users of cameras who are trained in assessing images. Each panel member has their own monitor to provide best possible viewing conditions.