Overview
ISO/IEC 23005-1:2020 (MPEG‑V - Media context and control - Part 1: Architecture) defines the architecture and information model for exchanging context and control data between real-world sensors/actuators and virtual worlds. Published as the fourth edition in 2020, the standard specifies the interfaces and data formats used to adapt information (bi-directionally) between:
- virtual world → real world,
- real world → virtual world, and
- exchanges between virtual worlds.
The standard focuses on data representations (not the adaptation engine implementation) and provides a modular architecture to support interoperable cross‑reality systems.
Key topics and technical requirements
- Architecture and scope: a system-level architecture that frames how sensors, actuators, virtual objects and AV content interconnect across real and virtual domains.
- Data formats and interfaces: standardized representations for sensor-related data (sensor capabilities, sensed data, sensor adaptation preferences), actuator control (sensory device capabilities, commands, sensory effect preferences), virtual object characteristics, and sensory effects embedded in audio‑visual content.
- Use cases and instantiations: comprehensive catalogue of practical scenarios (Representation of Sensory Effects, Natural User Interaction, Haptics, Bio‑sensed data, Environmental Monitoring, Interoperable Virtual Worlds, 3D printing, Olfactory information, Virtual panoramic vision, Adaptive sound handling, etc.) that illustrate concrete system architectures and message flows.
- Interoperability focus: enables independent vendors (device makers, content providers, platform builders) to exchange contextual and control information reliably.
- Out of scope: the adaptation engine (RV/VR engine) and the internal algorithms for adaptation are intentionally not standardized - only the interfaces and data models are.
Practical applications and typical users
ISO/IEC 23005-1 is valuable to:
- System architects and platform developers building mixed‑reality, VR/AR or cross‑platform virtual world systems.
- Sensor and actuator manufacturers implementing standardized capabilities and command formats for haptics, motion, olfactory devices, environmental sensors, automotive sensors, etc.
- Game studios, broadcast and immersive media producers seeking multi‑sensory integration (4D cinema, immersive broadcasting, adaptive sound).
- Healthcare, training and simulation vendors using bio‑sensed data, haptic feedback and interoperable virtual environments.
- Automotive and IoT integrators implementing virtual panoramic views, in‑vehicle information systems and eco‑driving monitoring.
Using this standard helps reduce integration cost, improve device/content interoperability and accelerate development of interoperable cross‑reality experiences.
Related standards
- ISO/IEC 23005 series (other parts provide complementary tools such as user sensory preferences and device capability descriptions - see ISO/IEC 23005-2 and other parts for detailed data items).