IP Library Granted Patent US 10,595,152
Granted Patent B2
US 10,595,152 · App. 16/009,164 · Granted Mar 17, 2020

Processing spatially diffuse or large audio objects

Inventors: Dirk Jeroen Breebaart (Ultimo, AU); Lie Lu (San Francisco, CA); Nicolas R. Tsingos (San Francisco, CA); Antonio Mateos Sole (Barcelona, ES)
Assignees: Dolby Laboratories Licensing Corporation; Dolby International AB
H04S7/308G10L19/00G10L19/008G10L19/018G10L19/20H04S3/002H04S2400/11H04S2400/13H04S2400/15H04S2420/03H04S2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,595,152
App. No.
16/009,164
Granted
Mar 17, 2020
Kind
B2
Abstract

Diffuse or spatially large audio objects may be identified for special processing. A decorrelation process may be performed on audio signals corresponding to the large audio objects to produce decorrelated large audio object audio signals. These decorrelated large audio object audio signals may be associated with object locations, which may be stationary or time-varying locations. For example, the decorrelated large audio object audio signals may be rendered to virtual or actual speaker locations. The output of such a rendering process may be input to a scene simplification process. The decorrelation, associating and/or scene simplification processes may be performed prior to a process of encoding the audio data.

Claims (35)

1. A method, comprising:

receiving audio data comprising at least one audio object and metadata associated with the at least one audio object, the metadata including data relating to size of the at least one audio object;

determining that the size of the at least one audio object is greater than a threshold size value based on a flag of the metadata;

performing decorrelation on the at least one audio object to determine decorrelated audio object audio signals; and

mixing the decorrelated audio object audio signals with at least an audio signal for the at least one audio object to determine a mixed audio signal for rendering.

2. The method of claim 1 , wherein the at least one audio object is associated with at least one object location, wherein at least one of the at least one object location is stationary.

3. The method of claim 1 , wherein the at least one audio object is associated with at least one object location, wherein at least one of the at least one object location varies over time.

4. The method of claim 1 , wherein an actual playback speaker configuration is used to render the mixed audio signal to speakers of a playback environment.

5. The method of claim 1 , further comprising applying a level adjustment process to the decorrelated audio object audio signals.

6. The method of claim 1 , wherein performing decorrelation includes at least one of a delay and a filter.

7. The method of claim 1 , wherein performing decorrelation includes at least one of an all-pass filter and a pseudo-random filter.

8. The method of claim 1 , wherein performing decorrelation includes a reverberation process.

9. The method of claim 1 , further comprising:

rendering the mixed audio signal according to virtual speaker locations.

10. An apparatus, comprising:

an interface system; and

a logic system configured to:

receive, via the interface system, audio data comprising at least one audio object and metadata associated with the at least one audio object, the metadata including data relating to size of the at least one audio object;

determine that the size of the at least one audio object is greater than a threshold size value based on a flag of the metadata;

perform decorrelation on the at least one audio object to determine decorrelated audio object audio signals; and

mix the decorrelated audio object audio signals with at least an audio signal for the at least one audio object to determine a mixed audio signal for rendering.

11. The apparatus of claim 10 , wherein the at least one audio object is associated with at least one object location, wherein at least one of the at least one object location is stationary.

12. The apparatus of claim 10 , wherein the at least one audio object is associated with at least one object location, wherein at least one of the at least one object location varies over time.

13. The apparatus of claim 10 , wherein an actual playback speaker configuration is used to render the mixed audio signal to speakers of a playback environment.

14. The apparatus of claim 10 , wherein the logic system is further configured to:

apply a level adjustment process to the decorrelated audio object audio signals.

15. The apparatus of claim 10 , wherein performing decorrelation includes at least one of a delay and a filter.

16. The apparatus of claim 10 , wherein performing decorrelation includes at least one of an all-pass filter and a pseudo-random filter.

17. The apparatus of claim 10 , wherein the logic system is further configured to:

render the mixed audio signal according to virtual speaker locations.

18. A non-transitory medium having software stored thereon, the software including instructions for controlling at least one apparatus to:

receive audio data comprising at least one audio object and metadata associated with the at least one audio object, the metadata including data relating to size of the at least one audio object;

determine that the size of the at least one audio object is greater than a threshold size value based on a flag of the metadata;

perform decorrelation on the at least one audio object to determine decorrelated audio object audio signals; and

mix the decorrelated audio object audio signals with at least an audio signal for the at least one audio object to determine a mixed audio signal for rendering.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2018
From: BREEBAART, DIRK JEROEN; LU, LIE; TSINGOS, NICOLAS R.; MATEOS SOLE, ANTONIO
To: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
Reel/Frame 046095/0543 →
Priority Claims (1)
ES 201331193 · Jul 31, 2013 · national
Continuity (4)
Continuation 15490613 · Apr 18, 2017
Division 14909058
Provisional Application 61885805 · Oct 2, 2013
Related Publication 20180295464A1 · Oct 11, 2018