IP Library Granted Patent US 9,736,609
Granted Patent B2
US 9,736,609 · App. 14/174,784 · Granted Aug 15, 2017

Determining renderers for spherical harmonic coefficients

Inventors: Martin James Morrell (San Diego, CA); Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04S5/00H04S7/30H04S7/301H04S2400/11H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,736,609
App. No.
14/174,784
Granted
Aug 15, 2017
Kind
B2
Abstract

In general, techniques are described for determining renderers used for rendering spherical harmonic coefficients to generate one or more loudspeaker signals. A device comprising one or more processors may perform the techniques. The one or more processors may be configured to determine a local speaker geometry of one or more speakers used for playback of spherical harmonic coefficients representative of a sound field, and configure the device to operate based on the local speaker geometry.

Claims (44)

1. A method comprising:

determining, by one or more processors of a device, a local speaker geometry of one or more speakers used for playback of spherical harmonic coefficients representative of a sound field;

determining, by the one or more processors, a two-dimensional or three-dimensional renderer based on the local speaker geometry; and

rendering, by the one or more processors, multi-channel audio data from the spherical harmonic coefficients using the determined two-dimensional or three-dimensional renderer, the multi-channel audio data is defined in a spatial domain.

2. The method of claim 1 , wherein determining the two-dimensional or three-dimensional renderer based on the local speaker geometry comprises, when the local speaker geometry conforms to a stereo speaker geometry, determining a two-dimensional stereo renderer.

3. The method of claim 1 , wherein determining the two-dimensional or three-dimensional renderer based on the local speaker geometry comprises, when the local speaker geometry conforms to horizontal multi-channel speaker geometry having more than two speakers, determining a horizontal two-dimensional multi-channel renderer.

4. The method of claim 3 , wherein determining the horizontal two-dimensional multi-channel renderer comprises determining an irregular horizontal two-dimensional multi-channel renderer when the determined local speaker geometry indicates an irregular speaker geometry.

5. The method of claim 3 , wherein determining the horizontal two-dimensional multi-channel renderer comprises determining a regular horizontal two-dimensional multi-channel renderer when the determined local speaker geometry indicates a regular speaker geometry.

6. The method of claim 1 , wherein determining the two-dimensional or three-dimensional renderer based on the local speaker geometry comprises, when the local speaker geometry conforms a three-dimensional multi-channel speaker geometry having more than two speakers on more than one horizontal plane, determining a three-dimensional multi-channel renderer.

7. The method of claim 6 , wherein determining the three-dimensional multi-channel renderer comprises determining an irregular three-dimensional multi-channel renderer when the determined local speaker geometry indicates an irregular speaker geometry.

8. The method of claim 6 , wherein determining the three-dimensional multi-channel renderer comprises determining a near regular three-dimensional multi-channel renderer when the determined local speaker geometry indicates a near regular speaker geometry.

9. The method of claim 6 , wherein determining the three-dimensional multi-channel renderer comprises determining a regular three-dimensional multi-channel renderer when the determined local speaker geometry indicates a regular speaker geometry.

10. The method of claim 1 , wherein determining the renderer comprises:

determining an allowed order of spherical basis functions to which the spherical harmonic coefficients are associated, the allowed order identifying those of the spherical harmonic coefficients that are required to be rendered given the determined local speaker geometry; and

determining the renderer based on the determined allowed order.

11. The method of claim 1 , wherein determining the two-dimensional or three-dimensional renderer comprises:

determining an allowed order of spherical basis functions to which the spherical harmonic coefficients are associated, the allowed order identifying those of the spherical harmonic coefficients that are required to be rendered given the determined local speaker geometry; and

determining the two-dimensional or three-dimensional renderer such that the two-dimensional or three-dimensional renderer only renders those of the spherical harmonic coefficients associated with spherical basis functions having an order less than or equal to the determined allowed order.

12. The method of claim 1 , wherein determining the local speaker geometry of the one or more speakers comprises receiving input from a listener specifying local speaker geometry information describing the local speaker geometry.

13. The method of claim 1 , wherein determining the two-dimensional or three-dimensional renderer based on the local speaker geometry comprises, when the local speaker geometry conforms to a mono speaker geometry, determining a mono renderer.

14. A device comprising:

one or more processors configured to:

determine a local speaker geometry of one or more speakers used for playback of spherical harmonic coefficients representative of a sound field;

determine a two-dimensional or three-dimensional renderer based on the local speaker geometry; and

configure the device to operate in accordance with the determined two-dimensional or three-dimensional renderer to render multi-channel audio data from the spherical harmonic coefficients, the multi-channel audio data defined in a spatial domain; and

a memory coupled to the one or more processors, and configured to store the determined two-dimensional or three-dimensional renderer.

15. The device of claim 14 , wherein the one or more processors are further configured to, when determining the two-dimensional or three-dimensional renderer based on the local speaker geometry, determine, when the local speaker geometry conforms to a stereo speaker geometry, a two-dimensional stereo renderer.

16. The device of claim 14 , wherein the one or more processors are further configured to, when determining the two-dimensional or three-dimensional renderer based on the local speaker geometry, determine, when the local speaker geometry conforms to horizontal multi-channel speaker geometry having more than two speakers, a horizontal two-dimensional multi-channel renderer.

17. The device of claim 16 , wherein the one or more processors are further configured to, when determining the horizontal two-dimensional multi-channel renderer, determine an irregular horizontal two-dimensional multi-channel renderer when the determined local speaker geometry indicates an irregular speaker geometry.

18. The device of claim 16 , wherein the one or more processors are further configured to, when determining the horizontal two-dimensional multi-channel renderer, determine a regular horizontal two-dimensional multi-channel renderer when the determined local speaker geometry indicates a regular speaker geometry.

19. The device of claim 14 , wherein the one or more processors are further configured to, when determining the two-dimensional or three-dimensional renderer based on the local speaker geometry, determine, when the local speaker geometry conforms a three-dimensional multi-channel speaker geometry having more than two speakers on more than one horizontal plane, a three-dimensional multi-channel renderer.

20. The device of claim 19 , wherein the one or more processors are further configured to, when determining the three-dimensional multi-channel renderer, determine an irregular three-dimensional multi-channel renderer when the determined local speaker geometry indicates an irregular speaker geometry.

21. The device of claim 19 , wherein the one or more processors are further configured to, when determining the three-dimensional multi-channel renderer, determine a near regular three-dimensional multi-channel renderer when the determined local speaker geometry indicates a near regular speaker geometry.

22. The device of claim 19 , wherein the one or more processors are further configured to, when determining the three-dimensional multi-channel renderer, determine a regular three-dimensional multi-channel renderer when the determined local speaker geometry indicates a regular speaker geometry.

23. The device of claim 14 , wherein the one or more processors are configured to determine an allowed order of spherical basis functions to which the spherical harmonic coefficients are associated, the allowed order identifying those of the spherical harmonic coefficients that are required to be rendered given the determined local speaker geometry, and determine the renderer based on the determined allowed order.

24. The device of claim 14 , wherein the one or more processors are configured to determine an allowed order of spherical basis functions to which the spherical harmonic coefficients are associated, the allowed order identifying those of the spherical harmonic coefficients that are required to be rendered given the determined local speaker geometry, and determine the two-dimensional or three-dimensional renderer such that the two-dimensional or three-dimensional renderer only renders those of the spherical harmonic coefficients associated with spherical basis functions having an order less than or equal to the determined allowed order.

25. The device of claim 14 , wherein the one or more processors are configured to receive input from a listener specifying local speaker geometry information describing the local speaker geometry.

26. The device of claim 14 , wherein the one or more processors are configured to determine, when the local speaker geometry conforms to a mono speaker geometry, a mono renderer.

27. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:

determine a local speaker geometry of one or more speakers used for playback of spherical harmonic coefficients representative of a sound field;

determine a two-dimensional or three-dimensional renderer based on the local speaker geometry; and

render the spherical harmonic coefficients using the determined two-dimensional or three-dimensional renderer to generate multi-channel audio data, the multi-channel audio data defined in a spatial domain.

28. The method of claim 1 , further comprising reproducing, by the one or more speakers coupled to the one or more processors, the sound field based on the multi-channel audio data.

29. The device of claim 14 , further comprising the one or more speakers, the one or more speakers coupled to the one or more processors, and configured to reproduce the sound field based on the multi-channel audio data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2014
From: MORRELL, MARTIN JAMES; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 033290/0464 →
Continuity (3)
Provisional Application 61762302 · Feb 7, 2013
Provisional Application 61829832 · May 31, 2013
Related Publication 20140219456A1 · Aug 7, 2014