No
Yes
View More
View Less
Working...
Close
OK
Cancel
Confirm
System Message
Delete
Schedule
An unknown error has occurred and your request could not be completed. Please contact support.
Scheduled
Wait Listed
Personal Calendar
Speaking
Conference Event
Meeting
Interest
Schedule TBD
Conflict Found
This session is already scheduled at another time. Would you like to...
Loading...
Please enter a maximum of {0} characters.
Please enter a maximum of {0} words.
must be 50 characters or less.
must be 40 characters or less.
Session Summary
We were unable to load the map image.
This has not yet been assigned to a map.
Search Catalog
Reply
Replies ()
Search
New Post
Microblog
Microblog Thread
Post Reply
Post
Your session timed out.
This web page is not optimized for viewing on a mobile device. Visit this site in a desktop browser to access the full set of features.
2017 GTC San Jose

S7606 - Capture and Rendering of Interactive 3D Audio for Virtual and Augmented Reality

Session Speakers
Session Description

The goal of VR and AR is to immerse the user in a created world by fooling the human perceptual system into perceiving rendered objects as real. This must be done without the brain experiencing fatigue: accurate audio representation plays a crucial role in achieving this. Unlike vision with a narrow foveated field of view, human hearing covers all directions in full 3D. When the rendered audio and vision do not agree, the user falls out of the experience. The importance of audio for VR and AR are being increasingly realized, and VisiSonics is developing a comprehensive toolset to address the needs of industry. We'll describe several products developed by VisiSonics that are based on over a decade of research. These include propagation engines that are embedded in standard authoring workflows for gaming (Unity, Unreal, Wwise, FMOD) and movie postproduction (Adobe, ProTools); capture of audio into high-order ambisonics and MPeg-H; personalization of 3D audio to the individual's head shape via customization of the head-related transfer function and others. We'll demonstrate workflow solutions designed to enrich the audio immersion for the gaming, video post-production and capture in VR/AR.


Additional Session Information
Intermediate
Talk
Tools and Libraries Virtual Reality and Augmented Reality
Architecture / Engineering / Construction Games Media & Entertainment Software
25 minutes
Session Schedule