IP Library › Granted Patent US 9,883,311
Granted Patent B2
US 9,883,311 · App. 14/898,737 · Granted Jan 30, 2018

Rendering of audio objects using discontinuous rendering-matrix updates

Inventors: Dirk Jeroen Breebaart (Pyrmont, AU); David S. McGrath (Rose Bay, AU); Rhonda Wilson (San Francisco, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04S3/02G10L19/008G10L19/032H04S7/30H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,883,311
App. No.
14/898,737
Granted
Jan 30, 2018
Kind
B2
Abstract

An audio playback system generates output signals for multiple channels of acoustic transducers by applying a rendering matrix to data representing the aural content and spatial characteristics of audio objects, so that the resulting sound field creates accurate listener impressions of the spatial characteristics. Matrix coefficients are updated to render moving objects. Discontinuous updates of the rendering matrix coefficients are controlled according to psychoacoustic principles to reduce audible artifacts. The updates may also be managed to control the amount of data needed to perform the updates.

Claims (71)

1. A method for processing audio information that includes object data, wherein the method comprises:

receiving one or more signals that convey the object data representing aural content and spatial metadata for each of one or more audio objects, wherein the spatial metadata contains data representing a location in space relative to a reference position in a playback system;

processing the object data and configuration information to calculate rendering matrix coefficients for use in rendering signals in the playback system, wherein the configuration information describes a configuration of acoustic transducers in a set of acoustic transducers for the playback system;

calculating a measure of update performance from the calculated rendering matrix coefficients and the object data according to psychoacoustic principles relating to the audibility of artifacts created by changes to rendering matrix coefficients, and deriving matrix update parameters from the measure of update performance;

generating updated matrix coefficient values in response to the rendering matrix coefficients and the matrix update parameters;

updating the rendering matrix coefficients in response to the updated matrix coefficient values; and

either

assembling an encoded representation of the object data and the rendering matrix coefficients into an encoded output signal,

or

applying the rendering matrix to the object data representing the aural content of audio objects to generate audio output signals representing the aural content of rendered audio objects for respective audio channels.

2. The method of claim 1 , wherein:

the measure of update performance comprises a measure of perceived distortion that would result from updating the rendering matrix with the calculated rendering matrix coefficients; and

the matrix update parameters are derived to reduce magnitudes of changes in rendering matrix coefficients in response to the measure of perceived distortion to reduce audibility of artifacts generated by the coefficient changes.

3. The method of claim 2 that comprises:

receiving one or more signals that convey bed channel data representing aural content for each of one or more audio channels, wherein each audio channel corresponds to an unvarying position relative to the reference position;

wherein:

the measure of perceived distortion is calculated also from the bed channel data; and

either

an encoded representation of the bed channel data is assembled into the encoded output signal,

or

the applying of the rendering matrix also includes combining with bed channel data to generate audio output signals representing the combined aural content of bed channel data and rendered audio objects for respective audio channels.

4. The method of claim 2 , wherein magnitudes of changes in rendering matrix coefficients are controlled by one or more update-limit parameters established in response to an estimated perceived distortion resulting from the changes in rendering matrix coefficients.

5. The method of claim 4 , wherein the one or more update-limit parameters are set not to reduce magnitudes of changes in rendering matrix coefficients when a psychoacoustic model determines its associated audio object is inaudible.

6. The method of claim 1 that comprises deriving the matrix update parameters to reduce a rate at which changes in rendering matrix coefficients are performed, wherein the rate is controlled to reduce audibility of resulting artifacts generated by the coefficient changes.

7. The method of claim 6 , wherein:

the measure of update performance comprises an estimated change in perceived accuracy of spatial characteristics of audio objects rendered by the rendering matrix that would result from updating the rendering matrix with the calculated rendering matrix coefficients; and

performing the changes in rendering matrix coefficients only if the change in perceived accuracy exceeds a threshold.

8. The method of claim 1 , wherein each coefficient in the rendering matrix has an associated gain factor, and wherein the method comprises:

adjusting each gain factor so that output of the rendering matrix does not exceed a maximum allowable level.

9. The method of claim 1 that comprises driving one or more acoustic transducers in the set of acoustic transducers in response to each audio output signal.

10. An audio information processing apparatus for processing audio information that includes object data, wherein the audio information processing apparatus comprises one or more processors configured to:

receive one or more signals that convey the object data representing aural content and spatial metadata for each of one or more audio objects, wherein the spatial metadata contains data representing a location in space relative to a reference position in a playback system;

process the object data and configuration information to calculate rendering matrix coefficients for use in rendering signals in the playback system, wherein the configuration information describes a configuration of acoustic transducers in a set of acoustic transducers for the playback system;

calculate a measure of update performance from the calculated rendering matrix coefficients and the object data according to psychoacoustic principles relating to the audibility of artifacts created by changes to rendering matrix coefficients, and deriving matrix update parameters from the measure of update performance;

generate updated matrix coefficient values in response to the rendering matrix coefficients and the matrix update parameters;

update the rendering matrix coefficients in response to the updated matrix coefficient values; and

either

assemble an encoded representation of the object data and the rendering matrix coefficients into an encoded output signal,

or

apply the rendering matrix to the object data representing the aural content of audio objects to generate audio output signals representing the aural content of rendered audio objects for respective audio channels.

11. The audio information processing apparatus of claim 10 , wherein:

the measure of update performance comprises a measure of perceived distortion that would result from updating the rendering matrix with the calculated rendering matrix coefficients; and

the matrix update parameters are derived to reduce magnitudes of changes in rendering matrix coefficients in response to the measure of perceived distortion to reduce audibility of artifacts generated by the coefficient changes.

12. The audio information processing apparatus of claim 11 , wherein the one or more processors are further configured to receive one or more signals that convey bed channel data representing aural content for each of one or more audio channels, wherein each audio channel corresponds to an unvarying position relative to the reference position;

wherein:

the measure of perceived distortion is calculated also from the bed channel data; and

either

an encoded representation of the bed channel data is assembled into the encoded output signal,

or

the applying of the rendering matrix also includes combining with bed channel data to generate audio output signals representing the combined aural content of bed channel data and rendered audio objects for respective audio channels.

13. The audio information processing apparatus of claim 11 , wherein magnitudes of changes in rendering matrix coefficients are controlled by one or more update-limit parameters established in response to an estimated perceived distortion resulting from the changes in rendering matrix coefficients.

14. The audio information processing apparatus of claim 13 , wherein the one or more update-limit parameters are set not to reduce magnitudes of changes in rendering matrix coefficients when a psychoacoustic model determines its associated audio object is inaudible.

15. The audio information processing apparatus of claim 10 , wherein the audio information process is further configured to derive the matrix update parameters to reduce a rate at which changes in rendering matrix coefficients are performed, wherein the rate is controlled to reduce audibility of resulting artifacts generated by the coefficient changes.

16. The audio information processing apparatus of claim 15 , wherein:

the measure of update performance comprises an estimated change in perceived accuracy of spatial characteristics of audio objects rendered by the rendering matrix that would result from updating the rendering matrix with the calculated rendering matrix coefficients; and

the one or more processors are configured to perform the changes in rendering matrix coefficients only if the change in perceived accuracy exceeds a threshold.

17. The audio information processing apparatus of claim 10 , wherein each coefficient in the rendering matrix has an associated gain factor, and wherein the one or more processors are further configured to adjust each gain factor so that output of the rendering matrix does not exceed a maximum allowable level.

18. The audio information processing apparatus of claim 10 , wherein the audio information processing apparatus is further configured to drive one or more acoustic transducers in the set of acoustic transducers in response to each audio output signal.

19. A non-transitory medium recording a program of instructions that is executable by a device to perform a method for processing audio information that includes object data, wherein the method comprises:

receiving one or more signals that convey the object data representing aural content and spatial metadata for each of one or more audio objects, wherein the spatial metadata contains data representing a location in space relative to a reference position in a playback system;

processing the object data and configuration information to calculate rendering matrix coefficients for use in rendering signals in the playback system, wherein the configuration information describes a configuration of acoustic transducers in a set of acoustic transducers for the playback system;

calculating a measure of update performance from the calculated rendering matrix coefficients and the object data according to psychoacoustic principles relating to the audibility of artifacts created by changes to rendering matrix coefficients, and deriving matrix update parameters from the measure of update performance;

generating updated matrix coefficient values in response to the rendering matrix coefficients and the matrix update parameters;

updating the rendering matrix coefficients in response to the updated matrix coefficient values; and

either

assembling an encoded representation of the object data and the rendering matrix coefficients into an encoded output signal,

or

applying the rendering matrix to the object data representing the aural content of audio objects to generate audio output signals representing the aural content of rendered audio objects for respective audio channels.

20. The medium of claim 19 , wherein:

the measure of update performance comprises a measure of perceived distortion that would result from updating the rendering matrix with the calculated rendering matrix coefficients; and

the matrix update parameters are derived to reduce magnitudes of changes in rendering matrix coefficients in response to the measure of perceived distortion to reduce audibility of artifacts generated by the coefficient changes.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE SECOND ASSIGNOR PREVIOUSLY RECORDED ON REEL 037350 FRAME 0817. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 4, 2017
From: BREEBAART, DIRK JEROEN; MCGRATH, DAVID S.; WILSON, RHONDA
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 044684/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2015
From: BREEBAART, DIRK JEROEN; MCGRATH, DAVID; WILSON, RHONDA
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 037350/0817 →
Continuity (2)
Provisional Application 61840591 · Jun 28, 2013
Related Publication 20160142844A1 · May 19, 2016