Adaptive panner of audio objects
An audio object including audio content and object metadata is received. The object metadata indicates an object spatial position of the audio object to be rendered by audio speakers in a playback environment. Based on the object spatial position and source spatial positions of the audio speakers, initial gain values for the audio speakers are determined. The initial gain values can be used to select a set of audio speakers from among the audio speakers. Based on the object spatial position and a set of source spatial positions at which the set of audio speakers are respectively located in the playback environment, a set of non-negative optimized gain values for the set of audio speakers is determined. The audio object at the object spatial position is rendered with the set of optimized gain values for the set of audio speakers.
1 . A computer-implemented method, comprising:
receiving an audio object comprising audio content and object metadata, the object metadata of the audio object indicating an object spatial position of the audio object to be rendered by a plurality of audio speakers, each audio speaker in the plurality of audio speakers being located in a respective source spatial position in a plurality of source spatial positions, wherein the object spatial position is related to audio content in one or more audio frames, or one or more subdivisions of an audio frame;
determining, based on the object spatial position of the audio object and the plurality of source spatial positions of the plurality of audio speakers, a plurality of initial gain values for the plurality of audio speakers, each audio speaker in the plurality of audio speakers being assigned with a respective initial gain value in the plurality of initial gain values;
determining, for each of the plurality of audio speakers, whether a respective audio speaker is an active audio speaker or whether the respective audio speaker is not an active audio speaker, wherein an audio speaker is an active audio speaker if the initial gain value assigned to the audio speaker is above a threshold value, and wherein the audio speaker is not an active audio speaker if the initial gain value assigned to the audio speaker is below or at a threshold value;
determining, based on the object spatial position of the audio object and a set of source spatial positions at which the set of active audio speakers are respectively located, a set of optimized non-negative gain values for the set of active audio speakers, wherein the set of optimized gain values are yielded using the initial gain values of the active speakers as input; and
outputting, for each audio speaker in the set of active audio speakers a respective optimized gain value in the plurality of optimized gain values.
2 . A system comprising:
one or more processors; and
a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations of:
receiving an audio object comprising audio content and object metadata, the object metadata of the audio object indicating an object spatial position of the audio object to be rendered by a plurality of audio speakers, each audio speaker in the plurality of audio speakers being located in a respective source spatial position in a plurality of source spatial positions, wherein the object spatial position is related to audio content in one or more audio frames, or one or more subdivisions of an audio frame;
determining, based on the object spatial position of the audio object and the plurality of source spatial positions of the plurality of audio speakers, a plurality of initial gain values for the plurality of audio speakers, each audio speaker in the plurality of audio speakers being assigned with a respective initial gain value in the plurality of initial gain values;
determining, for each of the plurality of audio speakers, whether a respective audio speaker is an active audio speaker or whether the respective audio speaker is not an active audio speaker, wherein an audio speaker is an active audio speaker if the initial gain value assigned to the audio speaker is above a threshold value, and wherein the audio speaker is not an active audio speaker if the initial gain value assigned to the audio speaker is below or at a threshold value;
determining, based on the object spatial position of the audio object and a set of source spatial positions at which the set of active audio speakers are respectively located, a set of optimized non-negative gain values for the set of active audio speakers, wherein the set of optimized gain values are yielded using the initial gain values of the active speakers as input; and
outputting, for each audio speaker in the set of active audio speakers a respective optimized gain value in the plurality of optimized gain values.
3 . A non-transitory computer-readable medium storing instructions that, when exceed by a processors, cause the one or more processors to perform the operations of:
receiving an audio object comprising audio content and object metadata, the object metadata of the audio object indicating an object spatial position of the audio object to be rendered by a plurality of audio speakers, each audio speaker in the plurality of audio speakers being located in a respective source spatial position in a plurality of source spatial positions, wherein the object spatial position is related to audio content in one or more audio frames, or one or more subdivisions of an audio frame;
determining, based on the object spatial position of the audio object and the plurality of source spatial positions of the plurality of audio speakers, a plurality of initial gain values for the plurality of audio speakers, each audio speaker in the plurality of audio speakers being assigned with a respective initial gain value in the plurality of initial gain values;
determining, for each of the plurality of audio speakers, whether a respective audio speaker is an active audio speaker or whether the respective audio speaker is not an active audio speaker, wherein an audio speaker is an active audio speaker if the initial gain value assigned to the audio speaker is above a threshold value, and wherein the audio speaker is not an active audio speaker if the initial gain value assigned to the audio speaker is below or at a threshold value;
determining, based on the object spatial position of the audio object and a set of source spatial positions at which the set of active audio speakers are respectively located, a set of optimized non-negative gain values for the set of active audio speakers, wherein the set of optimized gain values are yielded using the initial gain values of the active speakers as input; and
outputting, for each audio speaker in the set of active audio speakers a respective optimized gain value in the plurality of optimized gain values.