![\"20150716_153048_HDR\"](\"https:\/\/sites.temple.edu\/tudsc\/files\/2015\/07\/20150716_153048_HDR.jpg\")
<\/a><\/p>\nBefore we move on to the main topic, let\u2019s look into the debates between binaural versus multi-channel sound systems. I believe you already know that the most of the music albums are not actually recorded to reflect the actual performance environment of artists. Instead, recording engineers virtually decide positions of instruments and vocals by adjusting pan, volume, and filters. The\u00a0key factor for these recordings is even or clearer bandwidth distribution. For example, if base and drums, which use lower frequencies, are positioned in the same channel with the similar volume then the recorded sounds are not clearer because they interfere with each other. Some classical music and live concert albums use binaural recording techniques, but most recorded music use stereo channels to have a clearer bandwidth separation. This means the locations of the drums and guitars are not relevant to the actual stage of musicians. Although a clearer separation is also one of the advantages of multi channel surround system, it is more difficult to verify the advantage for delivering better\u00a0staging than binaural systems.<\/p>\n
You may want to compare the differences between wearing stereo headphones and multi channel speakers when you play games supporting a multi channel system. In fact, many reviewers have tested this before, but is is difficult to find a good comparison because the reviewers do not use identical speakers. Most results of these reviews are based on differences from different speakers, sound processing units, and volumes. This may be my next project.<\/p>\n
<\/p>\n Binaural audio supporters\u2019 claim is that with proper binaural recordings or simulations and with quality stereo speakers we do not need multiple speakers to generate multi-dimensional audio space because it is rare to find someone with more than two ears. This is similar with what Oculus Rift does to our eyes. This method is\u00a0simple but effective and the most widely used method for the current software available on the Oculus Rift. In order to set up 5.1 or 7.1 sound software developers need to set up 5 or 7 different points around users to capture sound from\u00a0the virtual world. Players also need to have multiple speakers that correspond to each sound capturing point. \u00a0Binaural audio supporters argue these extra costs are not necessary. They claim having a quality pair of speakers that have flat outputs across all bandwidth is more important. In fact, when you play multi-channel movies or games on consoles with good quality binaural surround emulation system known as Dolby surround (this surround sound is totally different with the 3D sound emulations that reconstruct 3D staging from two channel sources) you will definitely feel sound staging, which is similar with the sound when you have multi-channel speakers.<\/p>\n Multi-channel speakers supporters\u2019 claim is that even if we have two ears, multiple speakers can provide clearer spatial separation than just using two speakers. In other words, only two channels do not convey enough surround sound information. In fact, when you play multi-channel movies or games on consoles with Dolby surround what you will experience is less clear than the sound when you have with physical multi-channel speakers. This is a sound claim when we see the examples\u00a0of stereo recording, but the\u00a0advantage\u00a0for delivering right staging to users is not quite tested. In fact, the virtual staging for clearer separations are more artificial than real. It means that we can hear individual instruments’ sound more clearly, but they are not positioned to how they are played when artists perform.<\/p>\n Debates between binaural versus multi-channel sound systems are still ongoing issues since there have been no legitimate studies until today. You can read more about this on a\u00a0BBC’s recent experiment.<\/a> Either way, having interactive surround sound is one important factor to increase more sense of presence on VR devices.<\/p>\n <\/p>\n <\/p>\n I <\/span>Surround sound on HMD with 3D graphics<\/span><\/p>\n 3D gaming development tools usually offer ambient sound tools such as Ambient Sound Actor on Unreal Engine kit. These tools usually have distance algorithms and virtual microphones that capture sounds around player and transmit the corresponding speakers\u00a0based upon the user’s movements and directions.\u00a0 For example, when there is a singing bird on the scene which is assigned as an individual sound actor the bird will have its own volume set by developers. The volume will be at its maximum when a virtual microphone, which will transformed to the users left or right ear\u2019s speaker, and the bird have 0 distances. As the distance increase the volume will be attenuated. The distance is dependent on movements of both the user’s and the bird\u2019s animation.<\/p>\n In this case, developers can put 2 virtual microphones for 2 or 2.1 audio systems, or 5 or 7 microphones for 5.1 or 7.1 audio systems. If there is no significant difference among 2.1, 5.1, and 7.1 audio systems then the binaural supporters\u2019 claims will be supported especially when users use headphones. This is a more complex problem than the previous environment. Since camera recorded footage should include multiple sound sets and video playback software should simulate multi-channel sounds based on the user’s behaviors, but this is currently not available on any of available content and software for capturing the\u00a0physical\u00a0world.\u00a0This might be the reason why most 360 videos do not provide interactive audio based on user’s operations.<\/p>\n <\/p>\n As you see in this picture it looks like there is an attempt at making interactive 360 video with binaural sound recording.<\/p>\n<\/a><\/p>\n<\/a><\/p>\n
\nI <\/span>Surround sounds on HMD with camera recorded footage<\/span><\/p>\n<\/a>
\nPhoto: BINAURAL AUDIO RIG\/LINK<\/a><\/span><\/p>\n