Overview
ISO/IEC TR 5469:2024 is a Technical Report that addresses functional safety and AI systems. It summarizes properties, risk factors, methods and processes for using AI in safety-critical contexts, including:
- AI embedded inside safety-related functions to realize required behavior;
- Non‑AI safety functions used to ensure safety for AI‑controlled equipment;
- AI systems used to design or develop safety‑related functions.
The report provides practical guidance for engineers, architects and safety managers on integrating AI into electrical/electronic/programmable electronic (E/E/PE) systems while addressing functional safety concerns.
Key topics and technical requirements
ISO/IEC TR 5469:2024 covers the full scope of AI‑related functional safety topics without prescribing a single recipe. Major technical areas include:
- Overview of functional safety and applicability to AI in E/E/PE systems.
- AI technology elements and the three‑stage realization principle (model creation, validation, execution) with guidance on deriving acceptance criteria.
- Properties and risk factors such as automation level, transparency/explainability, environment complexity, learning dynamics, adversarial vulnerabilities and hardware issues.
- Verification and validation (V&V) challenges and techniques: data preparation, model‑level validation, choice of AI metrics, system‑level testing, virtual and physical testing, test coverage limits and drift mitigation.
- Control and mitigation measures: AI subsystem architectures, detection and switching mechanisms, supervision with constraints, redundancy/ensembles and diversity, robustness techniques, optimization/compression, attention mechanisms and data/parameter protection.
- Processes and methodologies: relationship between AI life cycle and functional safety life cycle, documentation and artefacts, PFMEA for offline training, and fault models.
- Informative annexes include applicability to IEC 61508, worked examples, V&V process guidance, and mappings to related standards.
Practical applications and users
ISO/IEC TR 5469:2024 is intended for:
- Functional safety engineers and system integrators designing AI-enabled safety functions in automotive, industrial automation, robotics, medical devices and transportation systems.
- AI developers implementing models for safety‑relevant tasks and needing to align model lifecycle with safety lifecycle.
- Certification bodies, safety assessors and regulators seeking a reference for assessing AI-related safety risks and mitigation measures.
- R&D teams exploring robust, explainable and testable AI for high‑assurance applications.
Practical uses include defining acceptance criteria for AI models, designing supervisory safety architectures, planning V&V strategies (virtual + physical), and mapping AI elements to established safety frameworks.
Related standards
- IEC 61508 series (functional safety for E/E/PE systems) - applicability discussed in Annex A.
- ISO/IEC 5338 and other AI lifecycle standards - mappings included in Annex D.
Keywords: ISO/IEC TR 5469:2024, functional safety, AI systems, verification and validation, E/E/PE, three-stage realization, explainable AI, adversarial robustness, safety lifecycle.