Overview
ISO/TS 20282-2:2013 specifies a user-based summative test method for measuring the usability and accessibility of consumer products and products for public use (including walk-up-and-use products). Grounded in ISO 9241-11, the standard operationalizes usability as the extent to which specified users can achieve specified goals with effectiveness, efficiency, and satisfaction in a defined context of use. Accessibility is treated as a special case of usability by testing users who represent extremes of the general population.
Key topics and requirements
- Scope and applicability: Intended when typical contexts of use and clear success criteria can be identified and when a limited number of user goals are tested (e.g., unpacking, installation, completing a transaction).
- Summative test method: Provides a standardized user-based procedure to produce valid, reliable measures of usability and accessibility for benchmarking and validation.
- Core measures: Effectiveness (goal achievement), efficiency (resources such as time/effort), and satisfaction (user experience).
- Test design essentials: Define goals, select representative user samples, specify context of use, and verify the product can achieve intended goals before testing (see sections on test procedure and 7.4).
- Statistical and reporting guidance: Includes guidance on recruiting representative samples, confidence intervals (Annexes C and D), satisfaction scales (Annex E), and a format for test reports (Annex F).
- Validity, reliability & ethics: Emphasizes test validity and reliability, along with ethical considerations for user-based testing.
- Limits: Not suitable for highly variable or complex interactions that cannot be categorized into well-defined subsets (e.g., complex e‑commerce sites, word processors).
Practical applications
- Use ISO/TS 20282-2:2013 to:
- Validate usability/accessibility requirements for finished products.
- Benchmark and compare competing products’ usability (consumer devices, kiosks, ticketing websites).
- Support procurement decisions and publish comparable usability data.
- Complement formative UX testing by providing summative evidence for compliance or marketing claims.
- Typical product examples within scope: office photocopiers, ticketing websites for simple transactions, consumer devices with set-up goals, and public kiosks. The method can also be applied internally to functional prototypes.
Who should use it
- Product designers, UX researchers, usability and accessibility specialists, quality assurance teams, procurement officers, regulators, and service providers needing standardized, comparable measures of usability and accessibility.
Related standards
- ISO 9241-11 (usability guidance and terminology)
- ISO/TS 20282-1 (design requirements for context of use and user characteristics)
- ISO/TR 22411 (guidance on older people and people with disabilities)
Keywords: ISO/TS 20282-2:2013, summative test method, usability testing, accessibility testing, consumer products, products for public use, effectiveness efficiency satisfaction, walk-up-and-use.