Overview
ISO/IEC 14496-19:2004 - “Information technology - Coding of audio‑visual objects - Part 19: Synthesized texture stream” defines how synthesized texture data is encoded and transmitted as part of an MPEG‑4 audio‑visual presentation. The standard specifies the data structures, animation methods and the coded bitstream representation for SynthesizedTexture streams that enable photo‑realistic, very low‑bit‑rate synthetic video clips. Its scope covers integration with MPEG‑4 scene description (STNode usage), texture rendering, skeleton‑driven animation and stream decoding.
Key Topics
- SynthesizedTexture model: Objects (Actors) composed of a Texture, Skeleton and Animation sharing a common Stage, Camera and Timeline.
- Texture primitives: Vector‑style entities (lines, patches, area color points, profiles) used to represent skin and color via mathematical models.
- Skeleton & animation: Key‑frame based skeletons control intrinsic (layer/skeleton) and extrinsic (object/world) motion; unspecified frames are derived by interpolation (“tweening”).
- Texture rendering & warping: Re‑rendering textures as skeleton geometry changes produces realistic warping effects for photorealism.
- ST Coding (bitstream): Compact hierarchical representation with techniques to achieve high compression:
- Aggregation of related primitive attributes into sub‑streams
- Quantization using standard tables for compact numeric representation
- Packing with lossless statistical methods (variants of Huffman, run‑length, etc.)
- Bitstream structure: Top‑level blocks include Header, Scene, Object and Texture; Object blocks include Skeleton and Animation. The standard defines decoding order and syntax (default coding syntax 0).
- Decoding & playback: Defines how the SynthesizedTexture data is demultiplexed, de‑quantized, decompressed and rendered into raster frames for display.
Applications & Who Uses It
- Multimedia codec implementers building MPEG‑4 players or encoders that require low‑bit‑rate synthetic video support.
- Streaming and broadcast services aiming to deliver realistic animated textures where bandwidth is constrained.
- Game, AR/VR and interactive graphics developers who integrate textured, animated assets into MPEG‑4 scenes (via STNode and MovieTexture analogues).
- Tool and content creators producing synthetic clips, avatars or UI elements that benefit from skeletal animation and compact texture representation.
Related Standards & Notes
- Related MPEG‑4 parts referenced: ISO/IEC 14496‑1 (Systems) and 14496‑11 (Scene description & application engine). Part 14 (MP4 file format) and Part 10 (AVC) are also commonly used together in MPEG‑4 ecosystems.
- The document notes possible patent claims (example: Vimatix Inc.) - implementers should review patent/licensing considerations before deployment.
Keywords: ISO/IEC 14496-19, synthesized texture stream, MPEG‑4, ST Coding, texture warping, skeleton animation, low bit rate.