Overview
ISO/TR 19247:2016 - Photography: Guidelines for reliable testing of digital still cameras (DSCs) provides practical guidance for conducting credible, repeatable tests of digital cameras. It addresses both subjective (visual) evaluation and objective technical measurements, and is written to help testers, reviewers and manufacturers - including those without a photographic or deep scientific background - produce and interpret reliable camera test results.
Key Topics and Requirements
- Scope: Guidance for reliable testing of digital still cameras (DSC testing), covering procedures, documentation and interpretation.
- Visual analysis (subjective testing):
- Use calibrated and profiled display/printer devices with a consistent colour-management workflow.
- Ensure test persons meet basic visual criteria (e.g., screening for colour deficiency) and represent a mix of ages/sexes.
- Minimum of 5 test persons recommended; fewer than 5 is generally insufficient. If under 20 participants, have each person evaluate images twice.
- Use reference “good” and “bad” images, randomize image order, and limit test cycles to about 15–25 images with breaks between cycles.
- Select test motifs that highlight the attribute being evaluated (colour, dynamic range, sharpness, chromatic aberration, distortion, flare, face recognition, etc.).
- Technical measurements (objective testing):
- A comprehensive catalogue of camera performance aspects is provided - testers should choose a subset relevant to the camera’s intended use.
- Suggested measurable criteria include resolution (ISO 12233), texture/low-contrast detail (ISO 19567-1), opto-electronic conversion (OECF, ISO 14524), dynamic range, noise (ISO 15739), colour accuracy (ISO 17321 / CIE), geometric distortion (ISO 17850), vignetting (ISO 17957), chromatic aberration (ISO 19084), shutter lag (ISO 15781), compression artefacts, low-light performance, stray light/flare, defect pixels and battery life (ISO 20087).
- Test conditions and documentation:
- Choose camera settings and environmental conditions that reflect common photographic use.
- Archive images, test charts and software; disclose measurement methods and mathematical analysis for transparency.
- Minimize deviations through consistent procedures and trained personnel.
Applications and Who Uses It
- Camera manufacturers for validation and product development.
- Independent test labs and QA teams for repeatable performance benchmarking.
- Photography magazines, reviewers and test-equipment vendors to improve credibility of published comparisons.
- Software/tool developers creating evaluation or analysis tools for DSCs.
- Professional photographers and procurement teams assessing camera suitability for real-world tasks.
Related Standards
ISO/TR 19247:2016 references and aligns with several measurement standards, including:
Using ISO/TR 19247:2016 helps ensure transparent, repeatable and credible digital still camera testing, improving comparability and trust in image quality and camera performance reports.