IP Library › Granted Patent US 9,736,606
Granted Patent B2
US 9,736,606 · App. 14/670,074 · Granted Aug 15, 2017

Editing of higher-order ambisonic audio data

Inventors: Martin James Morrell (San Diego, CA); Pei Xiang (San Diego, CA); Richard Paul Walters (Dana Point, CA); Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04S3/008G06F3/04842G10L19/008G11B20/10527G11B27/031H04H20/89H04N21/233H04N21/4398H04N21/4392
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,736,606
App. No.
14/670,074
Granted
Aug 15, 2017
Kind
B2
Abstract

In general, techniques are described for audio editing of higher-order ambisonic audio data. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may be configured to store a higher order ambisonic (HOA) representation of the audio object. The one or more processors may be configured to add a source tail to the HOA representation of the audio object by storing one or more spherical harmonic (SH) basis functions associated with the audio object to a buffer.

Claims (38)

1. A method of editing a first audio object, the method comprising:

adding, by a device, a source tail to a higher order ambisonic (HOA) representation of a first audio object by storing one or more spherical harmonic (SH) basis functions associated with the first audio object to a buffer; and

applying, by the device, the one or more stored SH basis functions to one or more subsequent audio objects to associate the one or more subsequent audio objects with an audio source associated with the first audio object.

2. The method of claim 1 , wherein adding the source tail comprises applying a delay to a first audio object by storing the first audio object represented by the one or more higher order ambisonics coefficients to a delay buffer.

3. The method of claim 2 , further comprising:

determining a delay number; and

iterating through the one or more SH basis functions, for a number of iterations equal to the delay number.

4. The method of claim 3 , further comprising upon iterating through the one or more SH basis functions for the number of iterations equal to the delay number, determining whether all of the one or more SH basis functions have been processed.

5. The method of claim 4 , further comprising:

when all of the one or more SH basis functions have been processed, manipulating a read/write position of the delay buffer.

6. The method of claim 5 , wherein manipulating the read/write position of the delay buffer comprises at least one of increasing the read/write position or resetting the read/write position.

7. The method of claim 1 , further comprising:

presenting, via a physical display of the device, a graphical user interface having a representation of the delay;

rendering the HOA coefficients to one or more speaker feeds; and

outputting the one or more speaker feeds to drive one or more loudspeakers, the device including the loudspeakers.

8. A device configured to edit a first audio object, the device comprising:

a memory configured to store a higher order ambisonic (HOA) representation of the first audio object; and

one or more processors coupled to the memory, and configured to:

add a source tail to the HOA representation of the first audio object by storing one or more spherical harmonic (SH) basis functions associated with the first audio object to a buffer; and

apply the one or more stored SH basis functions to one or more subsequent audio objects to associate the one or more subsequent audio objects with an audio source associated with the first audio object.

9. The device of claim 8 ,

wherein the one or more processors are configured to apply a delay to the first audio object based on a correlation with a user input associated with a movement of an element of a graphical user interface (GUI).

10. The device of claim 9 , wherein the one or more processors are further configured to derive the one or more SH basis functions from the movement of the element.

11. The device of claim 10 , wherein the one or more processors are further configured to store the one or more derived SH basis functions to a buffer.

12. The device of claim 9 , wherein the one or more processors are further configured to display the GUI that depicts a representation of a soundfield in which the first audio object is positioned and a representation of the first audio object at a location within the soundfield the first audio object resides.

13. The device of claim 9 , wherein the one or more processors are further configured to display the GUI that depicts a representation of a soundfield in which the first audio object resides and a representation of the first audio object, wherein the representation of the first audio object is at a location within the soundfield at which the first audio object resides, and receive the user input.

14. The device of claim 9 , wherein the one or more processors are further configured to display the GUI that depicts a representation of a soundfield in which the first audio object resides and a representation of the first audio object at a location within the soundfield the first audio object resides, and receive the user input, wherein the GUI indicates the delay of the first audio object via a graphical representation.

15. The device of claim 14 , wherein a width or volume of the graphical representation is indicative of a gain applied to the first audio object.

16. The device of claim 14 , wherein the length of the graphical representation is indicative of a duration of the delay applied to the first audio object.

17. The device of claim 8 , further comprising:

a physical display configured to present a graphical user interface having a representation of the source tail; and

one or more loudspeakers,

wherein the one or more processors are further configured to:

render the HOA coefficients to one or more speaker feeds; and

output the one or more speaker feeds to drive the one or more loudspeakers.

18. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:

add a source tail to a higher order ambisonic (HOA) representation of a first audio object by storing one or more spherical harmonic (SH) basis functions associated with the first audio object to a buffer; and

apply the one or more stored SH basis functions to one or more subsequent audio objects to associate the one or more subsequent audio objects with an audio source associated with the first audio object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2015
From: MORRELL, MARTIN JAMES; XIANG, PEI; WALTERS, RICHARD PAUL; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 035504/0576 →
Continuity (2)
Provisional Application 62032477 · Aug 1, 2014
Related Publication 20160035386A1 · Feb 4, 2016