Overview
ISO/IEC 23090-18:2024/Amd 1:2024 is an important amendment to the international standard on the coded representation of immersive media, specifically focusing on the carriage of geometry-based point cloud compression (G-PCC) data with added support for temporal scalability. Published by ISO and IEC, this amendment responds to increasing demand for efficient and scalable handling of point cloud data-enabling higher flexibility in streaming, storage, and playback of 3D media content.
The key enhancement in this amendment is the introduction of temporal scalability for G-PCC data. Temporal scalability enables a dynamic trade-off between visual quality and resource consumption by providing multiple frame rate options within a single point cloud bitstream. This allows applications to adapt 3D content delivery to diverse device capabilities, network conditions, and user preferences.
Key Topics
- Temporal Level Tracks: Introduction of new track types for handling temporal subsets of G-PCC bitstreams, each associated with a unique temporal level identifier.
- Codec-Independent Sample Grouping: Use of standardized sample groups such as ‘tele’ for temporal level mapping, supporting efficient switching between quality levels.
- Parameter Set Sample Groups: Mechanisms to reliably manage parameter sets for decoding samples, enabling robust random access and error resilience.
- Sub-frame Timing Sample Groups: Enhanced support for precise timing and synchronization of sub-frames within point cloud sequences.
- Scalability Information Boxes: New boxes (e.g., GPCCScalabilityInfoBox) signal temporal level information and frame rate, improving interoperability and metadata management.
Applications
The amendment offers tangible benefits and enhanced flexibility across various sectors that manage or deliver immersive media:
- 3D Video Streaming: Service providers can deliver point cloud data at multiple frame rates (for example, 30fps, 45fps, or 60fps), dynamically adjusting to bandwidth or device limitations.
- Virtual and Augmented Reality (VR/AR): Applications can provide smoother and more customized viewing experiences, with scalable temporal quality based on user or device requirements.
- Real-Time Communications: Enables adaptive transmission in video conferencing, telepresence, and remote collaboration where latency and resource usage are critical.
- Cloud-Based Processing: Supports efficient storage and retrieval by allowing selection of only the necessary temporal levels for a given application, reducing computational load.
- Content Creation and Editing: Facilitates workflow optimization in 3D content production pipelines, where various temporal resolutions may be required for editing, preview, or final output.
- Broadcast and Interactive Media: Temporary scalability allows for seamless transitions between different quality levels during playback or interaction, enhancing end-user experience.
Related Standards
For seamless integration and interoperability, the amendment references and builds upon other notable international standards:
- ISO/IEC 23090-18: Base specification for geometry-based point cloud compression (G-PCC) data carriage.
- ISO/IEC 23090-9: Provides definitions for G-PCC setup units, parameter sets, and related structures.
- ISO/IEC 14496-12: Commonly known as the ISO Base Media File Format, underpinning sample grouping and track management in G-PCC carriage.
- ISO/IEC JTC 1/SC 29: The technical committee responsible for coding of audio, picture, multimedia, and hypermedia information, including immersive media standards.
Practical Value
Implementing ISO/IEC 23090-18:2024/Amd 1:2024 allows organizations and developers to:
- Offer adaptive 3D media experiences.
- Achieve optimized network and device performance.
- Enhance interoperability across diverse playback and processing systems.
- Ensure future-proof media workflows by aligning with up-to-date international standards.
This amendment is crucial for anyone involved in the capture, processing, delivery, or consumption of immersive point cloud media content seeking scalable, efficient, and standards-compliant solutions.