Back Back

In 360° sound immersion with delgrès

Tech
Published on August 09, 2020

Come taste the sound of the Creole blues of the Delgrès trio in an immersive 360° and binaural experience: Mo Jodi as if you were on stage with the musicians!

How it all started?

The experience of RV and binaural sound began when the management of the Overseas Cluster ordered innovative digital native modules to cover the Route du Rhum 2018. The digital experience group, based in Malakoff, and which was created at that time, produced an RV module and a binaural podcast on the theme of "Boating on board a sailboat" with an ultramarine skipper. (Click here to find the article and the video)

This first experience won us over, especially because the narration, design and manufacturing guidelines are totally different from what we are used to doing for 2D TV.

Afterwards, we wanted to push a little further, and create an RV module with binaural sound, always valuing an artist from overseas. An opportunity with the Delgrès group was confirmed. On tour throughout France, we wanted to record a sound check or a rehearsal of the group.

What is the technical equipment for this recording?

We therefore contacted Nathalie Gallet from Medialab and Lidwine Hô from the Innovations and Development department to elaborate this new project. They had already intervened on the first experience in support. With them we estimated our technical needs. 

The Medialab had just received a 360° camera "Insta Pro 2". Nathalie and Lidwine came to present it to us. We welcomed them in our new Social room. While Nathalie was deciphering with us the functionalities of the camera, Lidwine was advising us on the audio equipment necessary for the capture. To complete the video equipment loaned by the Medialab, (Insta Pro 2), we bought the Zoom H3VR recorder and we purchased the multitrack "Sound Devices PIX 270i" to test it, as the Malakoff radio service was looking to equip itself with this type of equipment.

D-Day

On D-Day, the sound check of Delgrès took place in the concert hall La Batterie (Guyancourt). So we installed, as planned, in the middle of the stage the Insta Pro 2, the H3VR fixed on the camera. The multitrack was receiving in madi the divergent tracks and the final mix from the front console.

Arrived in post-prod, the choice was quite obvious between the different tracks recorded to start on the MO JODI track. The image editing done with Nathalie Gallet on Adobe Première consisted essentially of stitching, synchronizing and dressing the module. As for the mixing done on Reaper, we worked with Lidwine Hô. After she imported the multitrack audios into the software, processed the different sources (equalization, compression, etc.), then spatialized the instruments, we tried to give a specific presence to each instrument according to its placement in space and from the point of view of the telenaut.

Finally, FB 360 Encoder allowed us to create spatialized masters adapted to social networks, Facebook and Youtube, the only ones able to play video in 360.

The result is quite close to what we hoped to obtain, namely an experience that gives the impression of being exclusively on stage with the band, and being able to choose one's angle of vision and sound perception.

YOU CAN SEE AND EAR HERE 

Some images of the captation

 
Written by Ghislaine Vingot, chef de projet; Bruno Dessommes, Chef OPS/Mixeur; France Télévisions
Published on August 09, 2020

Join our
next
testing session!

Final test before launching automatic subtitling of franceinfo

Closed captions are produced everyday for the French public news channel, from 6 to 9 AM and from 9 PM to midnight. In addition, on France TV website and applications, franceinfo will receive automatic subtitling thanks to an Artificial Intelligence during the rest of the day.

We'll keep it, tweak it, or
remake it—you decide!

Other related articles with #Binaural sound

FranceTV Sport VR : Vivez le sport comme jamais avec une nouvelle application disponible sur les casques de réalité virtuelle Apple Vision Pro et MetaQuest

FranceTV Sport VR: Experience sport like never before with a new application available on Apple Vision Pro and MetaQuest virtual reality headsets

France Télévisions is innovating by offering you a unique immersive experience: immerse yourself in the heart of sporting events thanks to 360° videos in 3D and spatialized sound, as well as a gaming section allowing you to become an Olympic athlete (only available on MetaQuest).
Le son binaural expliqué en vidéo

Binaural sound explained in video (and sound)

Binaural sound or how to restore natural 3D listening with headphones. Demonstration in images (and sound) in a video that introduces you to the world of spatialized sound.