Systems, methods, apparatus, and computer-readable media for audio object clustering

1. A method of audio signal processing performed by an audio signal processing device, said method comprising:

receiving, via an audio interface of the audio signal processing device, N sets of spherical harmonic coefficients;

determining, by one or more processors of the audio signal processing device, a direction in space associated with each of the N sets of spherical harmonic coefficients, wherein each of the N sets of spherical harmonic coefficients represents an audio signal;

grouping, by the one or more processors, the N sets of spherical harmonic coefficients into L clusters based on said associated directions in space and an indication of a user's head orientation received from a renderer;

mixing, by the one or more processors and according to said grouping, the plurality of sets of spherical harmonic coefficients into L sets of spherical harmonic coefficients, wherein L is less than N, and wherein at least two sets among the L sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients; and

producing, based on the determined directions in space and the grouping, metadata that indicates spatial information for each of the L audio streams.

2. The method according to claim 1 , wherein each of said N sets of spherical harmonic coefficients is a set of coefficients of orthogonal basis functions.

3. The method according to claim 1 , wherein said mixing comprises, for each of at least one among the L clusters, calculating a sum of at least two sets among said plurality of sets of spherical harmonic coefficients.

4. The method according to claim 1 , wherein said mixing comprises calculating each among the L sets of spherical harmonic coefficients as a sum of the corresponding ones among the N sets of spherical harmonic coefficients.

5. The method according to claim 1 , wherein at least two among the N sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients.

6. The method according to claim 1 , wherein, for at least one among the L sets of spherical harmonic coefficients, a total number of spherical harmonic coefficients in the set is based on a bit rate indication.

7. The method according to claim 1 , wherein, for at least one among the L sets of spherical harmonic coefficients, a total number of spherical harmonic coefficients in the set is based on information received from at least one among a transmission channel, and a decoder.

8. The method according to claim 1 , wherein, for at least one among the L sets of spherical harmonic coefficients, a total number of spherical harmonic coefficients in the set is based on a total number of spherical harmonic coefficients in at least one among the corresponding ones among the N sets of spherical harmonic coefficients.

9. The method according to claim 1 , wherein each of said N sets of spherical harmonic coefficients describes an audio object.

10. A non-transitory computer-readable data storage medium having instructions stored thereon that, when executed, cause one or more processors to:

interface with an audio interface to receive N sets of spherical harmonic coefficients;

determine a direction in space associated with each of the N sets of spherical harmonic coefficients, each of the N sets of spherical harmonic coefficients represents an audio signal;

group the N sets of spherical harmonic coefficients into L clusters based on said associated directions in space and an indication of a user's head orientation received from a renderer;

according to said grouping, mix the plurality of sets of spherical harmonic coefficients into L sets of spherical harmonic coefficients, wherein L is and less than N, and wherein at least two sets among the L sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients; and

produce, based on the determined directions in space and the grouping, metadata that indicates spatial information for each of the L audio streams.

11. An apparatus for audio signal processing, said apparatus comprising:

means for determining a direction in space associated with each of N sets of spherical harmonic coefficients, each of the N sets of spherical harmonic coefficients represents an audio signal,

means for grouping the N sets of spherical harmonic coefficients into L clusters based on said associated directions in space and an indication of a user's head orientation received from a renderer;

means for mixing the plurality of sets of spherical harmonic coefficients into L sets of spherical harmonic coefficients, according to said grouping, wherein L is less than N, and wherein at least two sets among the L sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients; and

means for producing, based on the determined directions in space and the grouping, metadata that indicates spatial information for each of the L audio streams.

12. An apparatus for audio signal processing, said apparatus comprising:

an audio interface configured to receive N sets of spherical harmonic coefficients;

a clusterer configured to determine a direction in space associated with each of the N sets of spherical harmonic coefficients and group the N sets of spherical harmonic coefficients into L clusters based on said associated directions in space and an indication of a user's head orientation received from a renderer, each of the N sets of spherical harmonic coefficients represents an audio signal;

a downmixer configured to mix the plurality of sets of spherical harmonic coefficients into L sets of spherical harmonic coefficients, according to said grouping, wherein L is less than N, and wherein at least two sets among the L sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients; and

a metadata downmixer configured to produce, based on the determined directions in space and the grouping, metadata that indicates spatial information for each of the L audio streams.

13. The apparatus according to claim 12 , wherein each of said N sets of spherical harmonic coefficients is a set of spherical harmonic coefficients of orthogonal basis functions.

14. The apparatus according to claim 12 , wherein said downmixer is configured to calculate each among the L sets of spherical harmonic coefficients as a sum of the corresponding ones among the N sets of spherical harmonic coefficients.

15. The apparatus according to claim 12 , wherein at least two among the N sets of spherical harmonic coefficients have different numbers of spherical harmonic coefficients.

16. The method of claim 1 , further comprising:

receiving, from a device, the indication of the local rendering environment.

17. The method of claim 1 , further comprising:

receiving, from a device comprising a loudspeaker array, the indication of the local rendering environment.

18. The apparatus of claim 12 , further comprising:

one or more microphones to record respective PCM streams for N audio objects,

wherein each of the one or more microphones is associated with a spatial position,

wherein the apparatus is configured to generate each of the N audio objects to encapsulate the corresponding PCM stream and the spatial information based on the spatial positions of the one or more microphones.

19. The apparatus of claim 12 , wherein the clusterer is further configured to receive, from a device, the indication of the local rendering environment.

20. The apparatus of claim 12 , wherein the clusterer is further configured to receive, from a device comprising a loudspeaker array, the indication of the local rendering environment.