Overview
ISO/IEC 23000-12:2010 - part of the MPEG-A family - defines the Interactive Music Application Format (IM AF), a standardized file format for delivering multitrack, interactive music content. The standard specifies how to package multiple audio tracks together with hierarchical grouping, preset mixes, producer-defined interactivity rules, timed text, images and metadata inside an ISO-Based Media File Format (ISO‑BMFF) container. IM AF enables listener-controlled recomposition (user mixes) while ensuring interactions comply with constraints imposed by the content owner.
Key topics and technical requirements
- File container: IM AF is built on ISO-BMFF (ISO/IEC 14496‑12) and uses standard boxes such as ftyp, moov, mdat plus IM AF-specific boxes (e.g., grco, prco, ruco).
- Multitrack audio support: stores multiple audio tracks (mono/stereo) and supports codecs such as MP3, AAC, SAOC and PCM.
- Hierarchical grouping: grup structures group tracks into hierarchies (e.g., all guitars) to simplify selection and mixing.
- Preset mixes: prst boxes contain predefined mixing parameters (Preset‑mix mode) for ready-made listening experiences.
- User interactivity: User‑mix mode allows selection/unselection of tracks/groups and per-track volume control; interactions are validated against interactivity rules defined in ruco (selection and mixing rules).
- Timed multimedia: synchronized 3GPP timed text for lyrics, JPEG images, and MPEG‑7 metadata (MDS) are supported to enrich presentation.
- File structures: supports single‑presentation files and multiple‑presentation (album) files; includes guidance for backward compatibility with legacy music players.
- Brand identification: defines a file type brand for application discovery and interoperability.
- Rule analysis: player behavior must include a rule analyzer to verify user actions conform to producer restrictions.
Practical applications and target users
IM AF is intended for any solution that needs interoperable, interactive music content:
- Streaming platforms and interactive music services offering remixable tracks and karaoke features.
- Mobile and desktop interactive music players that implement Preset‑mix and User‑mix modes.
- Music app developers building user‑mixing, educational, or gamified music experiences.
- Content producers and rights holders who want to deliver multitrack releases with controlled interactivity.
- Device manufacturers and middleware vendors aiming for standardized playback and content exchange.
Related standards (normative references)
ISO/IEC 23000‑12 provides a practical, interoperable way to deliver rich, multitrack interactive music content - enabling new service models and consistent playback behavior across platforms.