IP Library Granted Patent US 10,972,853
Granted Patent B2
US 10,972,853 · App. 16/719,392 · Granted Apr 6, 2021

Signalling beam pattern with objects

Inventors: Moo Young Kim (San Diego, CA); Nils Günther Peters (San Diego, CA); S M Akramus Salehin (San Diego, CA); Dipanjan Sen (Dublin, CA)
Assignee: Qualcomm Incorporated
H04S7/302G10L19/008H04R5/02H04R5/04H04S3/008H04S2400/01H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,972,853
App. No.
16/719,392
Granted
Apr 6, 2021
Kind
B2
Abstract

A device for processing coded audio is disclosed. The device is configured to store an audio object and audio object metadata associated with the audio object. The audio object metadata includes frequency dependent beam pattern metadata. The device may apply, based on the frequency dependent beam pattern metadata, a renderer to the audio object to obtain one or more speaker feeds and output the one or more speaker feeds.

Claims (75)

1. A device configured for processing coded audio, the device comprising:

a memory configured to store an audio object and audio object metadata associated with the audio object, wherein the audio object meta data comprises frequency dependent beam pattern metadata and the frequency dependent beam pattern metadata comprises a syntax element indicative of whether the device change a beam pattern based on frequency, and

one or more processors electronically coupled to the memory, the one or more processors are configured to:

determine a value of the syntax element;

apply, based on the value of the syntax element indicating to change the beam pattern based on frequency, a renderer to the audio object to obtain one or more speaker feeds; and

output the one or more speaker feeds,

wherein the renderer changes the beam pattern based on frequency.

2. The device of claim 1 , wherein the frequency dependent beam pattern metadata is defined for a number of frequency bands being equal to or greater than 1.

3. The device of claim 2 , wherein the one or more processors are configured to render all frequencies of the audio object using a same beam pattern in response to the number of frequency bands being equal to 1.

4. The device of claim 1 , wherein:

the audio object metadata further comprises a first set of weighting values and at least a first set of metadata representative of a first directional beam for the audio object; and

the one or more processors are further configured to:

apply the first set of weighting values to the audio object to obtain a weighted audio object; and

apply, based on the first set of metadata representative of the first directional beam, the renderer to the weighted audio object to obtain the one or more speaker feeds.

5. The device of claim 4 , wherein the first set of metadata to describe the first directional beam for the audio object comprises at least one of an azimuth value, an elevation value, a distance value, a gain value or a diffuseness value.

6. The device of claim 2 , wherein:

the number of frequency bands is equal to M, M being an integer value greater than 1;

the audio object metadata further comprises M sets of weighting values and at least M sets of metadata representative of M directional beams, each of the M directional beams corresponding to one of the M frequency bands; and

the one or more processors are further configured to:

apply the M sets of weighting values to audio signals of the audio object to obtain weighted audio objects;

sum the weighted audio objects to determine a weighted summation of audio objects; and

apply the renderer to the weighted summation of audio objects to obtain the one or more speaker feeds.

7. The device of claim 6 , wherein each of the M sets of metadata comprises at least one of an azimuth value, an elevation value, a distance value, a gain value or a diffuseness value.

8. The device of claim 6 , wherein to apply the renderer, the one or more processors are configured to perform vector-based amplitude panning with respect to the weighted audio object.

9. The device of claim 1 , further comprising:

one or more speakers configured to reproduce, based on the output speaker feeds, a soundfield.

10. The device of claim 1 , wherein the device comprises one of a vehicle, an unmanned vehicle, a robot, and a handset.

11. The device of claim 1 , wherein the one or more processors comprises one or more integrated circuits.

12. A method for processing coded audio, the method comprising:

storing an audio object and audio object metadata associated with the audio object, wherein the audio object meta data comprises frequency dependent beam pattern metadata and the frequency dependent beam pattern metadata comprises a syntax element indicative of whether the device change a beam pattern based on frequency;

determining a value of the syntax element;

applying, based on the value of the syntax element indicating to change the beam pattern based on frequency, a renderer to the audio object to obtain one or more speaker feeds; and

output the one or more speaker feeds,

wherein the renderer changes the beam pattern based on frequency.

13. The method of claim 12 , wherein the frequency dependent beam pattern metadata is defined for a number of frequency bands being equal to or greater than 1.

14. The method of claim 13 , further comprising:

rendering all frequencies of the audio object using a same beam pattern in response to the number of frequency bands being equal to 1.

15. The method of claim 12 , wherein the audio object metadata further comprises a first set of weighting values and at least a first set of metadata representative of a first directional beam for the audio object, wherein the method further comprises:

applying the first set of weighting values to the audio object to obtain a weighted audio object; and

applying, based on the first set of metadata representative of the first directional beam, the renderer to the weighted audio object to obtain the one or more first speaker feeds.

16. The method of claim 15 , wherein the first set of metadata to describe the first directional beam for the audio object comprises at least one of an azimuth value, an elevation value, a distance value, a gain value, and a diffuseness value.

17. The method of claim 13 , wherein the number of frequency bands is equal to M, M being an integer value greater than 1, the audio object metadata further comprises M sets of weighting values and at least M sets of metadata representative of M directional beams, each of the M directional beams corresponding to one of the M frequency bands, the method further comprising:

applying the M sets of weighting values to audio signals of the audio object to obtain weighted audio objects;

summing the weighted audio objects to determine a weighted summation of audio objects; and

applying the renderer to the weighted summation of audio objects to obtain the one or more speaker feeds.

18. The method of claim 17 , wherein each of the M sets of metadata comprises at least one of an azimuth value, an elevation value, a distance value, a gain value, and a diffuseness value.

19. The method of claim 17 , wherein applying the renderer comprises performing vector-based amplitude panning with respect to the weighted audio object.

20. The method of claim 12 , further comprising:

reproducing, based on the output speaker feeds, a soundfield using one or more speakers.

21. The method of claim 12 , wherein the method is performed by one of a vehicle, an unmanned vehicle, a robot, or a handset.

22. The method of claim 12 , wherein the method is performed by one or more integrated circuits.

23. An apparatus for processing coded audio, the apparatus comprising:

means for storing an audio object and audio object metadata associated with the audio object, wherein the audio object meta data comprises frequency dependent beam pattern metadata and the frequency dependent beam pattern metadata comprises a syntax element indicative of whether the device change a beam pattern based on frequency;

means for determining a value of the syntax element;

means for applying, based on the value of the syntax element indicating to change the beam pattern based on frequency, a renderer to the audio object to obtain one or more speaker feeds; and

means for outputting the one or more speaker feeds,

wherein the renderer changes the beam pattern based on frequency.

24. The apparatus of claim 23 , wherein the frequency dependent beam pattern metadata is defined for a number of frequency bands being greater or equal to 1.

25. The apparatus of claim 23 , further comprising:

means for rendering all frequencies of the audio object using a same beam pattern in response to the number of frequency bands being equal to 1.

26. The apparatus of claim 23 , wherein the audio object metadata further comprises a first set of weighting values and at least a first set of metadata representative of a first directional beam for the audio object, the apparatus further comprising:

means for applying the first set of weighting values to the audio object to obtain a weighted audio object; and

means for applying, based on the first set of metadata representative of the first directional beam, the renderer to the weighted audio object to obtain the one or more first speaker feeds.

27. The apparatus of claim 24 , wherein the number of frequency bands is equal to M, M being an integer value greater than 1, the audio object metadata further comprises M sets of weighting values and at least M sets of metadata representative of M directional beams, each of the M directional beams corresponding to one of the M frequency bands, the apparatus further comprising:

means for applying the M sets of weighting values to audio signals of the audio object to obtain weighted audio objects;

means for summing the weighted audio objects to determine a weighted summation of audio objects; and

means for applying the renderer to the weighted summation of audio objects to obtain the one or more speaker feeds.

28. The apparatus of claim 23 , wherein the apparatus comprises one of a vehicle, an unmanned vehicle, a robot or a handset.

29. The apparatus of claim 23 , wherein the apparatus comprises one or more integrated circuits.

30. A non-transitory computer readable storage medium containing instructions that when executed by one or more processors cause the one or more processors to:

store an audio object and audio object metadata associated with the audio object, wherein the audio object meta data comprises frequency dependent beam pattern metadata and the frequency dependent beam pattern metadata comprises a syntax element indicative of whether the device change a beam pattern based on frequency;

determine a value of the syntax element;

apply, based on the value of the syntax element indicating to change the beam pattern based on frequency, a renderer to the audio object to obtain one or more first speaker feeds; and

output the one or more speaker feeds,

wherein the renderer changes the beam pattern based on frequency.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2020
From: KIM, MOO YOUNG; PETERS, NILS GÜNTHER; SALEHIN, S M AKRAMUS; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 052127/0864 →
Continuity (2)
Provisional Application 62784239 · Dec 21, 2018
Related Publication 20200204939A1 · Jun 25, 2020