Overview
ISO/IEC 23090-14:2023 - "Information technology - Coded representation of immersive media - Part 14: Scene description" specifies extensions to scene description formats to support MPEG media, with an emphasis on immersive media (VR/AR/3D). The standard defines syntax and semantics for scene description extensions, a processing model for a Presentation Engine, and a Media Access Function (MAF) API for communication between the Presentation Engine and media access components. Although targeted at ISO/IEC 12113 (glTF 2.0 delivery), the extensions can be applied to other scene description formats.
Key topics and technical requirements
- Scene description extensions: Syntax and semantics to reference MPEG-encoded content, timed media, and dynamically updated scene elements.
- Media Access Function (MAF) API: Standardized API contract enabling Presentation Engines to retrieve, buffer, and control MPEG media assets.
- Buffer API and timing model: Requirements for timed items, circular buffering, and synchronization between scene events and media playback.
- Visual extensions: Support for MPEG texture video and mesh linking (e.g., mesh correspondence and shadow associations).
- Audio extensions: Spatial audio support via MPEG_audio_spatial extensions and audio attenuation definitions.
- Metadata and animation: Viewport recommendations, animation timing semantics, and JSON schema guidance for scene updates and patches.
- Carriage formats: Defined packaging for glTF JSON and patches, glTF objects/sources, mesh correspondence samples, pose/weight samples, and animation sample formats to be carried in containers (e.g., ISOBMFF).
- Normative references: Aligns with ISO/IEC 12113 (glTF), ISO/IEC 14496-12 (ISOBMFF), JSON RFCs, and IEEE 754 floating-point standards.
- Annexes: JSON schema references, attribute registries, real-time media support, audio attenuation functions, and usage examples.
Practical applications and who should use it
This standard is practical for:
- Immersive application developers (VR/AR/XR) integrating MPEG-encoded video, 3D assets, and spatial audio into a unified scene.
- Engine and runtime implementers building Presentation Engines and MAF-compliant modules for playback, synchronization, and buffering.
- Content delivery and packaging providers creating carriage formats for glTF + MPEG media inside ISOBMFF or similar containers.
- Tool vendors and pipeline engineers producing exporters, converters, or asset toolchains that must maintain timed scene semantics.
- Standards and interoperability teams ensuring consistent behavior for MPEG resources across platforms.
Related standards
- ISO/IEC 12113 (glTF 2.0 runtime 3D asset delivery)
- ISO/IEC 14496-12 (ISO base media file format)
- IETF RFC 8259 / RFC 6902 (JSON and JSON Patch)
- IEEE 754 (Floating-Point Arithmetic)
Using ISO/IEC 23090-14:2023 helps implementers unify scene description, media access, and timing semantics for rich, MPEG-based immersive experiences.