Skip to content

MPEG 141

MPEG 141 took place as an online conference from 2023-01-16 until 2023-01-20.

Press Release

MPEG reaches the First Milestone for MPEG-4 Audio Conformance (2nd Edition)

At the 141st MPEG meeting, MPEG Audio Coding (WG 6) reached the first milestone for the 2nd edition of ISO/IEC 14496-26 (MPEG-4 Part 26, Audio conformance) by promoting the text to Committee Draft (CD) status. This new edition incorporates six amendments and eight corrigenda which span 12 years of standardization activity. The conformance data repository is more than 14 GB of compressed audio streams and associated reference decoded waveforms. The conformance data supports detailed diagnostic assessment of decoder implementations. More than 30 MPEG-4 Audio compression standards are included in the repository, including the very widely deployed Advanced Audio Coding (AAC), and High-Efficiency AAC. This work item is expected to reach the final stage of standardization in April 2024.

MPEG finalizes the 5th Edition of High Efficiency Video Coding

At the 141st MPEG meeting, the Joint Video Experts Team (WG 5) completed development of the 5th edition of ISO/IEC 23008-3, High Efficiency Video Coding (HEVC), promoting it to the Final Draft International Standard (FDIS) stage. This new edition includes the specification of shutter interval Supplemental Enhancement Information (SEI), definitions of new levels for extending the operation ranges of HEVC, and various text improvements. Upon publication, the text of ISO/IEC 23008-3 will be largely aligned with the latest version of the corresponding twin text of HEVC in ITU-T H.265.

MPEG finalizes the 2nd Edition of Versatile Video Coding Conformance

At the 141st MPEG meeting, the Joint Video Experts Team (WG 5) completed development of the 2nd edition of ISO/IEC 23090-15, conformance testing for Versatile Video Coding (VVC), promoting it to the Final Draft International Standard (FDIS) stage. This new edition includes bitstreams to test devices for their compliance with the profiles of VVC version 2 (which features operation range extensions for higher bit depths and high bit rates) as released in 2022, as well as improvements to version 1 testing. The standardization of such tests is beneficial to VVC implementers as it enables them to check the proper functioning of their implementations during product development. It also helps VVC product users to verify conformance claims for such products.

MPEG reaches the First Milestone for a Technical Report on
Film Grain Synthesis Technology

At the 141st MPEG meeting, the Joint Video Experts Team (WG 5) reached the first milestone for ISO/IEC 23009-9 entitled “Film grain synthesis technology for video applications” by promoting the text to Committee Draft Technical Report (CDTR) status. This text contains an overview of applications for film grain synthesis, a description of film grain characteristics metadata, analysis and synthesis methods, and will be accompanied by a new software implementation of the film grain characteristics (FGC) supplemental enhancement information (SEI) message for both autoregressive and frequency-domain models. The report provides guidance on the use of film grain synthesis technology in video applications, including using the FGC SEI message defined in AVC, HEVC, and VVC/VSEI standards. Such technology can provide subjective quality benefits for certain video applications and, thus, could effectively achieve improved video compression by removing or reducing the amount of noise that may be present in a video or image signal prior to compression and by resynthesizing and adding back an approximation of the removed noise, given a set of signalled parameters, during decoding. Beyond the historical advent of film grain due to chemical processing as in the case of analog film stock, the possible usage also includes synthetic film grain that is added in post-production to digitally captured high-value content for artistic effect, or to mask imperfections in digital footage, which may otherwise sometimes look too sharp and clear and exhibit contouring artefacts. The term “film grain” can also be used to refer to digital image sensor noise, particularly in low-light and high-speed captures. This document aims to provide a publicly referenceable overview of the end-to-end processing steps for film grain and sensor noise removal, estimation, parameterization, synthesis, and blending for consumer distribution applications. This document includes examples of encoder-side and post-decoding processing steps for grain blending for some of the currently defined technologies.

MPEG completes 2nd Edition of Visual Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression (V-PCC)

At the 141st MPEG meeting, MPEG 3D Graphics & Haptics Coding (WG 7) completed development of the second edition of ISO/IEC 23090-5 Visual volumetric video-based coding (V3C) and video-based point cloud compression (V-PCC), promoting it to the Final Draft International Standard (FDIS) stage. The V3C standard is an extensible framework for the coding of volumetric video, offering a single bitstream structure with a uniform bridge to systems-level standards, including ISO/IEC 23090-10 Carriage of V3C data and ISO/IEC 23090-14 Scene description. The second edition adds support for ISO/IEC 23090-12 MPEG immersive video (MIV) through the addition of common atlas sub-bitstreams and packed video sub-bitstreams. A future edition of the standard is expected to add support for video-based dynamic mesh coding.

The V3C standard leverages video compression technologies and the video ecosystem in general (i.e., hardware acceleration, transmission services, and infrastructure) while enabling new kinds of applications. The V3C standard contains several profiles that leverage existing video codecs (i.e., Advanced Video Coding (AVC), High Efficiency Video Coding (HEVC), and Versatile Video Coding (VVC)), which can make them suitable to run on existing and emerging platforms. The standard is video-codec agnostic, and readily extensible to using other video specifications such as Essential Video Coding (EVC) and Low Complexity Enhancement Video Coding (LCEVC). V-PCC addresses lossless and lossy coding of 3D point clouds with associated attributes such as colours and reflectance. Point clouds are typically represented by extremely large amounts of data, which is a significant barrier for mass-market applications. However, the relative ease to capture and render spatial information as point clouds as compared to other volumetric video representations makes point clouds increasingly popular to present immersive volumetric data. With the current V-PCC encoder implementation providing a compression ratio in the range of 100:1 to 300:1, a dynamic point cloud of one million points could be encoded at 8 Mbit/s with good perceptual quality. Real-time decoding and rendering of V-PCC bitstreams has also been demonstrated on current mobile hardware. MIV enables the compression of multi-view, multi-view plus depth and multi-plane image source data. MIV was developed to support compression of immersive video content, in which a real or virtual 3D scene is captured by multiple real or virtual cameras. The standard enables the storage and distribution of immersive video content over existing and future networks, for playback with 6 degrees of freedom (6DoF) of view position and orientation. Views may use equirectangular, perspective, or orthographic projection. By pruning and packing views, MIV can achieve bit rates around 15 to 30 Mbit/s using HEVC and a pixel rate equivalent to HEVC Level 5.2. Besides the MIV Main profile for MVD, there is the MIV Geometry Absent profile, which is suitable for use with cloud-based and decoder-side depth estimation, and the MIV Extended profile, which enables coding of multi-plane images (MPI).

MPEG reaches the First Milestone for two MPEG-I Scene Description Standards

At the 141st MPEG meeting, MPEG Systems (WG 3) promoted two MPEG-I scene description standards to the first milestone of the standard development process:

  • ISO/IEC 23090-14 Amendment 2, support for haptics, augmented reality, avatars, interactivity, MPEG-I audio, and lighting, reached the Committee Draft Amendment (CDAM) stage. The second amendment adds various technologies to efficiently support important immersive media applications such as augmented reality and haptics by introducing technologies such as the nodes describing real-world reference for avatars, the nodes adding haptic feedback to the materials, the basic signaling for avatars based on the MPEG reference humanoid avatar model, etc. It also adds a generic interactivity framework and video-based lighting extensions.
  • ISO/IEC 23090-24, conformance and reference software for scene description, was promoted to Committee Draft (CD) stage.

Both ISO/IEC 23090-14 Amendment 2 and ISO/IEC 23090-24 are expected to be completed (i.e., to reach the status of Final Draft Amendment (FDAM) and Final Draft International Standard (FDIS), respectively) by the beginning of 2024.

MPEG adds support for Green Metadata to Essential Video Coding (EVC)

At its 141st MPEG meeting, MPEG Systems (WG 3) promoted ISO/IEC 23001-11 Amendment 2 – energy-efficient media consumption (green metadata) for Essential Video Coding (EVC, ISO/IEC 23094-1) – to Committee Draft Amendment (CDAM) stage, marking the first step in the standard development process. The standard enhances the ability to signal bitstream complexity information for both the baseline and main profiles of EVC by counting the number of coding units with complexity-intensive operations. The amendment is expected to be completed – i.e., to reach the status of Final Draft Amendment (FDAM) – by the beginning of 2024.

Output documents published in MPEG 141

MPEG-I

#PartTitle
2Omnidirectional Media FormatTechnologies under Consideration for OMAF
3Versatile Video CodingPreliminary working draft 3 of SEI processing order SEI message in VVC
3Versatile Video CodingTest model 19 for versatile video coding (VTM 19)
4Immersive AudioMPEG-I immersive audio Encoder Input Format, Version 4
4Immersive AudioMPEG-I immersive audio augmented reality Listener Space Description Format, Version 2
4Immersive AudioMPEG-I immersive audio Core Experiment Methodology, Version 2
6Immersive Media MetricsPreliminary WD of ISO/IEC 23090-6 AMD 2 Additional latencies and Other Improvements
6Immersive Media MetricsTechnologies under Consideration for ISO/IEC 23090-6
7Immersive Media MetadataWD of ISO/IEC 23090-7 AMD 1 Common metadata for immersive media
7Immersive Media MetadataTechnologies under Consideration for Immersive media metadata
8Network based Media ProcessingNBMP reference software and conformance framework
8Network based Media ProcessingTechnologies under Consideration for NBMP
9Geometry-based Point Cloud CompressionCommon test conditions for G-PCC
9Geometry-based Point Cloud CompressionGuidelines to use G-PCC for achieving best compression performances
10Carriage of Visual Volumetric Video-based Coding DataTechnologies under consideration on carriage of V3C data
10Carriage of Visual Volumetric Video-based Coding DataDefect under investigation on ISO/IEC 23090-10
12Immersive VideoCommon test conditions for MPEG immersive video
12Immersive VideoCall for MPEG immersive video test materials
14Scene Description for MPEG MediaPotential improvement of ISO/IEC 23090-14 DAM 1 Support for immersive media codecs in scene description
14Scene Description for MPEG MediaText of ISO/IEC 23090-14 CDAM 2 Support for haptics, augmented reality, avatars, interactivity, MPEG-I audio and lighting
14Scene Description for MPEG MediaTechnologies under Consideration on Scene Description
14Scene Description for MPEG MediaProcedures for standard development for ISO/IEC 23090-14 (MPEG-I Scene Description)
14Scene Description for MPEG MediaExploration Experiments for MPEG-I Scene Description
14Scene Description for MPEG MediaRequirements Coverage of MPEG-I Scene Description
14Scene Description for MPEG MediaRevised registration of Khronos extensions for 1st edition
14Scene Description for MPEG MediaDraft registration of Khronos extensions 2nd edition
17Reference Software and Conformance for OMAFWD of Reference software and conformance for omnidirectional media format (OMAF) 2nd edition
18Carriage of Geometry-based Point Cloud Compression DataPotential improvement of ISO/IEC 23090-18 DAM 1 Support for temporal scalability
18Carriage of Geometry-based Point Cloud Compression DataTechnologies under Considerations on Carriage of geometry-based point cloud compression data
24Conformance and Reference Software for Scene Description for MPEG MediaText of ISO/IEC CD 23090-24 Conformance and reference software for scene description
24Conformance and Reference Software for Scene Description for MPEG MediaProcedures for test scenarios and reference software development for MPEG-I Scene Description
25Conformance and Reference Software for Carriage of Visual Volumetric Video-based Coding DataDraft text of ISO/IEC DIS 23090-25 Conformance and reference software for carriage of visual volumetric video-based coding data
26Conformance and Reference Software for Carriage of Geometry-based Point Cloud Compression DataWD of ISO/IEC 23090-26 Conformance and reference software for carriage of geometry-based point cloud compression data
29Video-based dynamic mesh codingCommon Test Conditions for V-DMC
32Carriage of haptics dataWD of ISO/IEC 23090-32 Carriage of haptics data

MPEG-DASH

#PartTitle
1Media Presentation Description and Segment FormatsText of ISO/IEC 23009-1 5th edition CDAM 2 EDRAP streaming, content steering and other extensions
1Media Presentation Description and Segment FormatsTechnologies under Consideration for DASH
1Media Presentation Description and Segment FormatsDefects under Investigation on DASH
9Encoder and packager synchronizationText of ISO/IEC CD 23009-9 Redundant encoding and packaging for segmented live media (REAP)

MPEG-H

#PartTitle
63D Audio Reference SoftwareText of ISO/IEC CD 23008-6:2021/AMD 1, Corrections for closest loudspeaker playout and increased software resilience
12Image File FormatDraft text of ISO/IEC 23008-12 DAM 1 Support for progressive rendering signalling and other improvements
12Image File FormatWD of ISO/IEC 23008-12 2nd Edition AMD 2 Renderable Text Items and other improvements
12Image File FormatTechnology under Consideration on ISO/IEC 23008-12
12Image File FormatDefect Report for ISO/IEC 23008-12:2017

MPEG-4

#PartTitle
1SystemsDraft text of ISO/IEC DIS 14496-1 5th edition Systems
12ISO base Media File FormatPotential improvement of ISO/IEC DIS 14496-12 8th edition ISO base media file format
12ISO base Media File FormatWD of 14496-12 8th Edition AMD 1 Support for T.35, original sample duration and other improvements
12ISO base Media File FormatTechnologies under Consideration for ISO/IEC 14496-12
12ISO base Media File FormatDefect Report of ISO/IEC 14496-12
14MP4 File FormatTechnologies under Consideration for ISO/IEC 14496-14
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatWD of 14496-15 6th edition AMD 3 Support for neural-network post-filter supplemental enhancement information and other improvements
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatDraft text of ISO/IEC 14496-15 6th edition DAM 2 Picture-in-picture support and other extensions
15Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO base Media File FormatTechnologies under Consideration for ISO/IEC 14496-15
22Open Font FormatWD of ISO/IEC 14496-22 5th edition Open font format
26Audio ConformanceText of ISO/IEC CD 14496-26 Second Edition, Audio conformance
32File Format ReferenceTechnology under consideration on ISO/IEC 14496-32 File format reference software and conformance
34Syntactic description languageDraft text of ISO/IEC DIS 14496-34 Syntactic description language

MPEG-2

#PartTitle
1SystemsWD of ISO/IEC 13818-1 9th edition Systems

MPEG-CICP

#PartTitle
2VideoPreliminary working draft 2 of additional colour type identifiers for AVC, HEVC and Video CICP

MPEG-V

#PartTitle
6Common Types and ToolsDefect under investigation on ISO/IEC 23005-6

MPEG-C

#PartTitle
7Versatile Supplemental Enhancement Information Messages for Coded Video BitstreamsImprovements under consideration for neural network post-filter SEI messages

MPEG-B

#PartTitle
10Carriage of Timed Metadata Metrics of Media in ISO Base Media File FormatTechnologies under Consideration for ISO/IEC 23001-10
13Media OrchestrationDefect under investigation on ISO/IEC 23001-13
16Derived Visual Tracks in the ISO Base Media File FormatTechnologies under Consideration for Derived visual tracks including further visual derivations

MPEG-A

#PartTitle
19Common Media Application Format (CMAF) for Segmented MediaPreliminary WD of ISO/IEC 23000-19 AMD New Structural CMAF Brand Profile
19Common Media Application Format (CMAF) for Segmented MediaTechnology under consideration on CMAF
22Multi-Image Application Format (MIAF)Draft text of ISO/IEC DIS 23000-22 2nd edition Multi-image application format

Explorations

#PartTitle
Thoughts on Use Cases and Requirements for Audio Coding for Machines (ACoM)
Draft Use Cases and Draft Requirements on Audio Coding for Machines (ACoM)
36Neural Network-based Video CompressionExploration experiment on neural network-based video coding (EE1)
36Neural Network-based Video CompressionDescription of algorithms and software in neural network-based video coding (NNVC) version 2
41Enhanced compression beyond VVC capabilityExploration experiment on enhanced compression beyond VVC capability (EE2)
41Enhanced compression beyond VVC capabilityAlgorithm description of enhanced compression model 8 (ECM 8)
42Future Capabilities for MPEG-IRevised requirements for Render-based systems MPEG Phase 1
44AI-based coding for graphicsGuidelines for conducting AI exploration experiments for PCC
44AI-based coding for graphicsPerformance analysis of currently AI-based available solutions for PCC
44AI-based coding for graphicsPreliminary data set collection for AI experiments

All

#PartTitle
Assets of communication

MPEG-AI

#PartTitle
2Video coding for machinesCommon test conditions for video coding for machines
3Optimization of encoders and receiving systems for machine analysis of coded video contentPreliminary WD of TR: Optimization of encoders and receiving systems for machine analysis of coded video content

Other documents published in MPEG 141

TypeTitle
Press ReleasePress Release of 10th Meeting
AhGList of SC29/WG 03 AHGs established at the 10th meeting (MPEG 141)
AhGWG2 AHGs established at the 10th MPEG WG2 meeting (MPEG 141)
Time lineMPEG Roadmap after the MPEG 141 meeting
Time lineMPEG Roadmap after the MPEG 141 meeting (Extended PPT)
Administrative MattersRequest for offers to host an MPEG meeting (MPEG 143 - MPEG 150)
Administrative MattersMeeting Notice of the 142nd MPEG meeting including the 11th meeting of SC29/AG2,3,5, WG2,3,4,5,7,8