Blog

3D audio

Viewing posts tagged 3D audio

Immersive Audio Podcast Episode 59 – Hyunkook Lee (A Conceptual Model of Immersive Experience in Extended Reality)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the director of the Applied Psychoacoustics Laboratory at the University of Huddersfield – Hyunkook Lee.

Dr Hyunkook Lee is a Reader (i.e., Associate Professor) in Music Technology and the Director of the Applied Psychoacoustics Laboratory, University of Huddersfield, U.K. His research over the last 10 years contributed to advancing the understanding of three-dimensional (3D) audio perception and developing new 3D capture and reproduction techniques. He has invented various psychoacoustics-based 3D microphone arrays including PCMA-3D and ESMA-3D, whose principle for height microphone configuration has been adopted for Schoep’s award-winning ORTF-3D array. Recently, he has been focusing on researching and developing perceptually optimised techniques of 6DoF audio rendering for extended reality applications. He is also currently leading a multidisciplinary project that connects immersive arts and technologies. From 2006 to 2010, he was a Senior Research Engineer in audio R&D with LG Electronics, South Korea, where he participated in the standardisations of MPEG audio codecs and developed spatial audio algorithms for mobile devices. He is an Associate Technical Editor of the Journal of the Audio Engineering Society (AES). He co-edited a recently published book “3D Audio” (Routledge). Hyunkook is a Fellow of the AES, Vice-Chair of the AES High-Resolution Audio Technical Committee, and has recently been elected as a Governor of the AES for 2022-2023.   Dr Lee received a B. Mus (Hons) degree in music and sound recording (Tonmeister) from the University of Surrey, U.K., in 2002 and a PhD in spatial audio psychoacoustics from the Institute of Sound Recording (IoSR), the University of Surrey in 2006.

In this episode, we discuss Hyunkook’s recent research on “A Conceptual Model of Immersive Experience in Extended Reality” and its influence on spatial audio.

Listen to Podcast

Show Notes

Hyunkook Lee – https://pure.hud.ac.uk/en/persons/hyunkook-lee

360 Reality Audio Creative Suite – https://360ra.com/

IMERSA – https://www.imersa.org/item/immersive-audio

University of Surrey, Music & Sound Recording (Tonmeister) – https://www.surrey.ac.uk/undergraduate/music-and-sound-recording-tonmeister

University of Huddersfield, Music Technology – https://www.hud.ac.uk/inspire/musictechnology/

University of Huddersfield, Applied Psychoacoustics Lab – www.hud.ac.uk/apl

Applied Psychoacoustics Lab on Facebook – https://www.facebook.com/applied.psychoacoustics.lab/

A Conceptual Model of Immersive Experience in Extended Reality Paper – https://psyarxiv.com/sefkh/

Conceptual Model of Immersive Experience in Extended Reality Online Lecture – https://www.youtube.com/watch?v=ZoSTV-WVeeI

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 58 – Max Röhrbein (ENCIRCLED, IOSONO – Wave Field Synthesis)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Bjørn Jacobsen are joined by the co-founder and managing director of Encircled Max Röhrbein from Berlin, Germany.

Max is a co-founder and a managing director at Encircled audio.solutions GmbH where Encircled is the official and only licensee of the IOSONO software.

In this episode, Max discusses the technical capabilities of the entire IOSONO software and hardware ecosystem and we dive deep into this episode’s hot topic – Wave Field Synthesis.

Listen to Podcast

Show Notes

Cujo Sound YouTube Channel – https://www.youtube.com/channel/UCDe59ZJaYVueCUH55POlW3g

Dolby Atmos plug-in for Logic Pro – https://support.apple.com/en-gb/guide/logicpro/lgcp8e75f0b5/mac

Unity to acquire Peter Jackson’s Weta Digital in $1.6 billion deal – https://www.techspot.com/news/92159-unity-acquire-peter-jackson-weta-digital-16-billion.html

Max Röhrbein – https://www.linkedin.com/in/max-r%C3%B6hrbein-7560ab59/

Encircled/ IOSONO – https://encircled-audio.com/

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 57 – Hugo Larin (Flux:: Immersive – SPAT Revolution)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the ambassador and key collaborator of the FLUX:: Immersive – SPAT Revolution audio engine project Hugo Larin from Montreal, Canada.

Hugo Larin has deep roots in audio mixing, design, and operation as well as in networked control and data distribution.  He launched his career in production equipment rentals and in-studio recording. His passion for technology and for the entertainment production environment quickly drove him toward the live production sphere. His activities in this realm include a number of mixing, operation, and technical director roles on a variety of high-profile productions and events.

In this episode, Hugo discusses the technical capabilities of the SPAT Revolution engine along with the entire fleet of FLUX:: Immersive tools and we talk about the newly launched ADM OSC initiative.

For our podcast listeners, Flux:: Immersive are giving special access to extended licenses for -> Spat Revolution Software

Listen to Podcast

Show Notes

Flux:: – https://www.flux.audio/

Flux:: Immersive – https://www.flux.audio/immersive/

Spat Revolution – https://www.flux.audio/project/spat-revolution/

Ircam HEar  – https://www.flux.audio/project/ircam-hear-v3/

LANDR – https://www.landr.com

Ircam – https://www.ircam.fr/

ADM-OSC – https://doc.flux.audio/en_US/spat_revolution_doc/Ecosystem_&_integration_ADM_OSC.html

ADM-OSC GitHub – https://github.com/immersive-audio-live/ADM-OSC

FLUX:: Immersive User Group – https://www.facebook.com/groups/fluximmersive.usergroup

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 56 – Nuno Fonseca (Sound Particles – Physics Based Audio)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the founder and CEO of Sound Particles Nuno Fonseca from Leiria, Portugal.

Nuno Fonseca (PhD), is the founder and CEO of Sound Particles company, and was the creator of Sound Particles software, a 3D CGI-like audio software used in all major Hollywood studios in productions such as “Star Wars 9”, “Frozen II”, “Aquaman” or “Game of Thrones”. Former university professor (computer science and music technology areas),  Nuno is the author of the Portuguese book “Introdução à Engenharia de Som” (Introduction to Sound Engineering), co-author of the Portuguese book “Desenvolvimento em iOS” (iOS Development), author of “All You Need to Know About 3D Audio” ebook, and author of more than 20 papers regarding audio research. He is a member of AES, SMPTE, CAS, MPSE, AMPS, and a member of the Audio Engineering Society (AES) Technical Committee on “Audio for Cinema”.

In this episode, Nuno shares the story of the creation of Sound Particles and he explains the core operational principles of Physics-based Audio and its unique sonic properties.

Listen to Podcast

Show Notes

Xp4l – https://www.xp4l.com/

Spatial Audio on Netflix  – https://9to5mac.com/2021/08/18/netflix-spatial-audio-support-roll-out/

Nuno Fonseca – https://pt.linkedin.com/in/nuno-fonseca-04250a30

All You Need to Know about All about 3D Audio Ebook – https://soundparticles.com/resources/ebooks/3daudio

Sound Particles – https://soundparticles.com/products/soundparticles/overview

Energy Panner Plugin – https://soundparticles.com/products/energypanner

Brightness Panner Plugin – https://soundparticles.com/products/brightnesspanner

Space Controller Plugin – https://soundparticles.com/products/spacecontroller

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Double Emmy Awards nomination for Micro Monsters with David Attenborough

We’re incredibly proud to announce that Micro Monsters with David Attenborough has been nominated for two Emmy awards! With nominations for Outstanding Interactive Media and Outstanding Sound. Very grateful for this recognition at the highest level! Huge congratulations to all nominees and the entire amazing team at Alchemy Immersive, Atlantic Productions, and Oculus VR for bringing this project to life.

1.618 Digital Team

Immersive Audio Podcast Episode 55 – Varun Nair (Two Big Ears & Facebook 360 Spatial Workstation)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel is joined by Varun Nair from Edinburgh, Scotland.

Varun has spent the past 15 years building technologies, products, teams, and companies in Silicon Valley, UK, and India. Most recently he was head of AR/VR audio software at Facebook. Prior to that, he co-founded Two Big Ears, an immersive audio technology company, which was acquired by Facebook in 2016.

In this episode, Varun shares the story of the creation of the Two Big Ears start-up and the subsequent journey. We dive into spatial audio tech and the future opportunities it presents.

Listen to Podcast

Show Notes

Varun Nair LinkedIn – https://www.linkedin.com/in/varun-nair-tech/?originalSubdomain=uk

Two Big Ears –  https://www.facebook.com/TwoBigEars/

The Facebook 360 Spatial Workstation – https://facebook360.fb.com/spatial-workstation/

Facebook 360 Spatial Workstation Public group – https://www.facebook.com/groups/audio360support/permalink/2314771132087082/?comment_id=2314999128730949&reply_comment_id=2319634628267399

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 54 – Tom Slater (Call & Response – Spatial Audio in Physical Spaces)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by Tom Slater from London, UK.

Tom is an artist and producer who specialises in spatial sound for art and music in physical spaces. Tom co-founded Call & Response Studios in 2011 which is now based at Somerset House and houses a 25.2 surround sound creative production space.

In this episode, we dive into the topic of spatial audio in physical spaces. Tom shares his experience working with large speaker arrays in a variety of set-ups for live music and art exhibitions.

Listen to Podcast

Show Notes

Call and Response –  https://callandresponse.org.uk/

Spatial Sound Institute – https://spatialsoundinstitute.com/Compound-Terrains-2017-2018

Assembly 2020 – https://www.assembly2020.co/

Google Chrome Omnitone – https://github.com/GoogleChrome/omnitone

Music Excerpt from Assembly Project 2020. By Artists: Loraine James, Kelman Duran, Ben Vince.

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 53 – Ulli Scuda & Philipp Eibl (MPEG-H)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel is joined by head of the SoundLab group Ulli Scuda and research engineer Philipp Eibl at Fraunhofer IIS, over Zoom from Bavaria, Germany.

Ulli Scuda got a Tonmeister degree at the Film University Potsdam-Babelsberg where he also got his PhD. His experience covers sound recording, sound design and mixing for various film and music formats, ranging from binaural up to 22.2. He was a visiting lecturer at the Ansbach University of Applied Sciences. Today he heads the SoundLab group in the audio department at Fraunhofer IIS where he researches 3D-Audio production and reproduction technologies, as well as microphone arrays and production workflows. His main expertise is immersive audio production, interactive and object-based audio.

Philipp Eibl is a research engineer for Fraunhofer IIS, specializing in Next Generation Audio and the development of NGA production tools in particular.  Together with his colleagues, he mixes content for interactive and immersive experiences and advises industry partners on how they can integrate object-based audio production into their workflows.    Philipp joined Fraunhofer after studying Multimedia Art as well as Media Technology and Production in Salzburg and Amberg and interning in music and broadcast production.  His years of employment in a radio broadcast at the Bayerischer Rundfunk gave him first-hand experience and knowledge of the day-to-day work in both production and live broadcast environments at one of Germany’s largest radio stations.

In this episode, we discuss and compare new generation spatial audio codec MPEG-H and associated authoring tools for its ecosystem.

Listen to Podcast

Show Notes

Fraunhofer Institute – https://www.fraunhofer.de/en.html

MPEG-H Audio – https://www.iis.fraunhofer.de/en/ff/amm/broadcast-streaming/mpegh.html

Sony 360 Reality Audio – https://www.sony.co.uk/electronics/360-reality-audio

Sony 360 Reality Audio Creative Suite – https://360ra.com/product/360-reality-audio-creative-suite/

MPEG-H Authoring Suite – https://www.iis.fraunhofer.de/en/ff/amm/broadcast-streaming/mpegh-audio-production-tools.html

Spatial Audio Designer – https://newaudiotechnology.com/products/spatial-audio-designer/

ADM – https://www.iis.fraunhofer.de/en/ff/amm/dl/whitepapers/adm-profile.html

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 52 – Monica Bolles (Spatial Audio for Domes & Planetariums)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Bjørn Jacobsen are joined by sound artist Monica Bolles from Denver, US.

Monica Bolles has been working with spatial audio since 2011 when she first gained access to her local planetarium’s 15.1 channel surround system. Since then she has been continuously building toolsets in Max MSP to create large textured soundscapes that explore space, movement, and interaction. Tapping into her roots in traditional audio engineering she works with composers and live performers to explore methods of translating their work to spatial environments while exploring the role the audio engineer plays as a performer and musician. As an artist, she has been focusing on building custom instruments that explore data sonification and use gestural control to create improvised spatial audio experiences. As a producer, she puts together teams to build large immersive works that bring together live performance, dance, 360-projections, spatial audio, and other new technologies.  She is also a presenter and host of workshops in her field and has performed in this capacity at SXSW (2019) Ableton Loop (2018), IMERSA Summit (2013-2019), and NIME (2017-2018), among others. Currently, she owns and operates her own company, Resonant Interactions, specializing in immersive experience design.

In this episode, we dive into the topic of spatial audio for domes and planetariums, and Monica expertly covers multiple aspects of this re-emerging industry.

Listen to Podcast

Show Notes

Unreal Engine 5 – https://www.unrealengine.com

Meta Sounds – https://docs.unrealengine.com/5.0/en-US/AudioFeatures/MetaSounds/

Dolby Atmos for Music – https://www.dolby.com/music/

Monica Bolles – http://www.monicabolles.com

Resonant Interactions – http://www.resonantinteractions.com

N/TOPIA – https://vimeo.com/392358059

Orbits – https://vimeo.com/360311936

Collision – https://vimeo.com/437903790

SPAT Revolution – https://www.flux.audio/project/spat-revolution/

IRCAM – https://www.ircam.fr/

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

Immersive Audio Podcast Episode 51 – Kaushik Sunder (Embody)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel is joined by the Director of Engineering at Embody – Kaushik Sunder, from San Francisco, US.

Kaushik Sunder currently heads the overall Engineering efforts and also leads the Audio and Acoustics Research Team at EMBODY.  Kaushik has spent a great deal of his research career in the field of 3D Audio and Psychoacoustics. Over the last few years, his research has focussed on understanding the importance of personalized HRTFs particularly for headphone playback of spatial audio.   Prior to working at Embody, Kaushik served as a role of Research Scientist at Ossic and as a Postdoctoral Researcher at the Sound Recording Department, Schulich School of Music at McGill University. He is also a visiting research scientist at the Human factors department at NASA Ames Research Center. Kaushik received his PhD from the Digital Signal Processing Laboratory, NTU Singapore. He has regularly authored articles appearing in the Journal of Acoustical Society of America, IEEE Signal Processing Magazine, Journal of Audio Engineering Society, and AES International Conventions.

In this episode, we dive deep into the topic of personalised listening for spatial audio, and Kaushik expertly explains the science behind personalised HRTF and the advantages of its usage in the studio.

Listen to Podcast

Show Notes

Kaushik Sunder – https://www.linkedin.com/in/kaushik-sunder-9445b314/

Embody – https://embody.co/

This Is Your Brain On Music Book – https://en.wikipedia.org/wiki/This_Is_Your_Brain_on_Music

NASA AMES Research Centre – https://www.nasa.gov/ames

Ossic – https://www.kickstarter.com/projects/248983394/ossic-x-the-first-3d-audio-headphones-calibrated-t

Audeze – https://www.audeze.com/

Ambi Decoder – https://new.steinberg.net/immerse/

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.