© Fraunhofer IIS/Viaframe

Fraunhofer and b<>com present VR Comedy Show “Vaudeville” in MPEG-H Spatial Audio based on the VRIF Draft Guidelines

Fraunhofer Institute for Integrated Circuits IIS, the world-renowned experts in audio and media technologies, and the Hypermedia innovators from the French Research and Technology Institute b<>com have teamed up at IBC 2017 to showcase an end-to-end spatial audio system for production, delivery, playback and rendering of Higher Order Ambisonics (HOA) MPEG-H Audio, the international standard for immersive audio. The first virtual reality experience produced with this toolchain is the episodic VR comedy show “Vaudeville” from French VR studio DVGroup.

The content is delivered to VR headsets following aspects of the draft guidelines of the Virtual Reality Industry Forum (VRIF), which enable the production and delivery of high quality VR experiences, emphasizing interoperability in an open ecosystem.

While VRIF is not in itself a standards development organization, members advocate for the creation of an interoperable end-to-end ecosystem for high-quality audiovisual virtual reality services. At IBC 2017, the VR Industry Forum will publish a first draft of its guidelines for VR at www.vr-if.org/guidelines/. Fraunhofer IIS and b<>com present the very first VR experiences based on aspects of these guidelines.

The virtual reality environment demonstrated at IBC, rendered on Samsung Gear VR headsets, produces an entertainment experience with a stunning level of immersion. The audio mix which is configured as Higher Order Ambisonics, has been produced using the b<>com Spatial Audio Toolbox and is delivered using VRIF’s 3D Audio Baseline media profile, which is based on the MPEG-H Audio technology, substantially developed by Fraunhofer IIS. The 3D Audio Baseline media profile is technically specified in MPEG as part of the Omnidirectional Media Format (OMAF) (http://mpeg.chiariglione.org/standards/mpeg-a/omnidirectional-media-application-format/profiles-under-considerations-isoiec-23000).

MPEG-H Audio is a true multiscreen audio codec system that can carry audio channels, ambisonics audio and audio objects with metadata, which enables maximum creative freedom in the creation of interactive and immersive audio experiences. The MPEG-H TV Audio system is already on-air in South Korean UHD TV broadcast. It is part of the ATSC 3.0 and DVB-UHD television standards and suitable for Over-the-top (OTT) content. Advanced capabilities of MPEG-H include:

  • Immersive Sound: MPEG-H adds 3D audio components for an immersive audio experience.
  • Interactive Audio: Consumers have the ability to adjust the sound mix to their preferences.
  • Universal Delivery: MPEG-H tailors playback to sound best on any device and in any environment.

For effortless integration on VR playback systems, Fraunhofer IIS provides a VR Audio SDK, ready to create a VR experience with MPEG-H Audio decoding and the best-in-class audio rendering.

Through its Spatial Audio Toolbox solution, b<>com is providing state-of-the-art tools for producing and post-producing High Order Ambisonics Audio.

At IBC in Amsterdam, from 15-19 September 2017, visitors to the b<>com (Hall 8, booth G14) and Fraunhofer (Hall 8, booth B80) booths can experience Vaudeville VR with MPEG-H Audio.

Header image © Fraunhofer IIS/Viaframe

This post is also available in: Deutsch 汉语 한국어

Twitter – Fraunhofer IIS