IP Library › Granted Patent US 11,617,051
Granted Patent B2
US 11,617,051 · App. 16/685,305 · Granted Mar 28, 2023

Streaming binaural audio from a cloud spatial audio processing system to a mobile station for playback on a personal audio delivery device

Inventors: Shruti Badhwar (San Mateo, CA); Marielle Venita Jakobsons (Oakland, CA); Saarish Kareer (San Mateo, CA); Nidhi Sikarwar (Santa Clara, CA)
Assignee: EMBODYVR, INC.
H04S7/304H04L65/60H04L67/10H04S3/008H04S2400/01H04S2400/11H04S2420/01H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,617,051
App. No.
16/685,305
Granted
Mar 28, 2023
Kind
B2
Abstract

Spatial audio is received from an audio server over a first communication link. The spatial audio is converted by a cloud spatial audio processing system into binaural audio. The binauralized audio is streamed from the cloud spatial audio processing system to a mobile station over a second communication link to cause the mobile station to play the binaural audio on the personal audio delivery device.

Claims (32)

1. A method comprising:

receiving, by a cloud spatial audio processing system, spatial audio from an audio server over a first communication link;

converting, by the cloud spatial audio processing system, the spatial audio into binaural audio, wherein converting the spatial audio to the binaural audio comprises applying an HRTF to the spatial audio, and wherein a spatial format and a spatial configuration of the HRTF is mapped using a mapping function to a spatial format and a spatial configuration of the spatial audio; and

streaming the binaural audio from the cloud spatial audio processing system to a mobile station over a second communication link for playback on a personal audio delivery device.

2. The method of claim 1 , wherein the spatial audio is at least one of object-based audio, ambisonic audio, and multi-channel audio.

3. The method of claim 1 , wherein the audio server downconverts or does not downconvert the spatial audio to a fewer number of audio signals before sending the spatial audio over the first communication link to the cloud spatial audio processing system.

4. The method of claim 1 , wherein the HRTF is a personalized HRTF or a generalized HRTF.

5. The method of claim 1 , wherein converting the spatial audio to the binaural audio comprises applying a room model to the spatial audio, wherein a spatial format and spatial configuration of the room model matches a spatial format and spatial configuration of the spatial audio.

6. The method of claim 5 , wherein the room model is defined by a listener.

7. The method of claim 1 , wherein a bandwidth of the second communication link which is a 3 rd generation (3G), 4 th generation (4G), 5 th generation (5G), or WiFi connection is less than a bandwidth of the first communication link.

8. The method of claim 1 , further comprising receiving an indication of head movement by a listener; and wherein converting the spatial audio into binaural audio comprises converting the spatial audio into the binaural audio based on the indication of the head movement.

9. The method of claim 1 , further comprising applying an equalization filter to left and right binaural audio channels of the binaural audio.

10. A non-transitory, machine-readable medium having instructions stored thereon that are executable by a cloud spatial audio processing system to perform operations comprising:

receiving, by the cloud spatial audio processing system, spatial audio from an audio server over a first communication link;

converting, by the cloud spatial audio processing system, the spatial audio into binaural audio, wherein converting the spatial audio to the binaural audio comprises applying an HRTF to the spatial audio, and wherein a spatial format and a spatial configuration of the HRTF is mapped using a mapping function to a spatial format and a spatial configuration of the spatial audio; and

streaming the binaural audio from the cloud spatial audio processing system to a mobile station over a second communication link for playback on a personal audio delivery device.

11. The machine-readable medium of claim 10 , wherein the spatial audio is at least one of object-based audio, ambisonic audio, and multi-channel audio.

12. The machine-readable medium of claim 10 , wherein the instructions for converting the spatial audio to the binaural audio comprises applying a room model to the spatial audio,

wherein a spatial format and spatial configuration of the room model matches a spatial format and spatial configuration of the spatial audio.

13. The machine-readable medium of claim 10 , wherein a bandwidth of the second communication link which is a 3G, 4G, or 5G, or WiFi connection is less than a bandwidth of the first communication link.

14. The machine-readable medium of claim 10 , wherein the HRTF is a personalized HRTF or a generalized HRTF.

15. A system comprising:

a mobile station;

a personal audio delivery device in communication with the mobile station;

a non-transitory, machine-readable medium having instructions stored thereon that are executable by a cloud spatial audio processing system to perform operations comprising:

receiving, by the cloud spatial audio processing system, spatial audio from an audio server over a first communication link;

converting, by the cloud spatial audio processing system, the spatial audio into binaural audio, wherein converting the spatial audio to the binaural audio comprises applying an HRTF to the spatial audio, and wherein a spatial format and a spatial configuration of the HRTF is mapped using a mapping function to a spatial format and a spatial configuration of the spatial audio; and

streaming the binaural audio from the cloud spatial audio processing system to the mobile station over a second communication link for playback on the personal audio delivery device.

16. The system of claim 15 , wherein the spatial audio is at least one of object-based audio, ambisonic audio, and multi-channel audio.

17. The system of claim 15 , further comprising instructions for converting the spatial audio to the binaural audio comprises applying a room model to the spatial audio, wherein a spatial format and spatial configuration of the room model matches a spatial format and spatial configuration of the spatial audio.

18. The system of claim 15 , wherein a bandwidth of the second communication link which is a 3G, 4G, or SG, or WiFi connection is less than a bandwidth of the first communication link.

19. The system of claim 15 , wherein the HRTF is a personalized HRTF or a generalized HRTF.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2019
From: BADHWAR, SHRUTI; JAKOBSONS, MARIELLE VENITA; KAREER, SAARISH; SIKARWAR, NIDHI
To: EMBODYVR, INC
Reel/Frame 051021/0810 →
Continuity (4)
Provisional Application 62861760 · Jun 14, 2019
Provisional Application 62854609 · May 30, 2019
Provisional Application 62797904 · Jan 28, 2019
Related Publication 20200245092A1 · Jul 30, 2020