Reordering of foreground audio objects in the ambisonics domain
In general, disclosed is a device that includes one or more processors, coupled to the memory, configured to perform an energy analysis with respect to one or more audio objects, in the ambisonics domain, in the first time segment. The one or more processors are also configured to perform a similarity measure between the one or more audio objects, in the ambisonics domain, in the first time segment, and the one or more audio objects, in the ambisonics domain, in the second time segment. In addition, the one or more processors are configured to perform a reorder of the one or more audio objects, in the ambisonics domain, in the first time segment with the one or more audio objects, in the ambisonics domain, in the second time segment, to generate one or more reordered audio objects in the first time segment.
1. A device configured to encode foreground audio objects comprising:
a memory configured to store one or more foreground audio objects, in an ambisonics domain, in a first time segment and one or more foreground audio objects, in an ambisonics domain, in a second time segment; and
one or more processors, coupled to the memory, configured to:
perform an energy analysis with respect to the one, or more foreground audio objects, in the ambisonics domain, in the first time segment;
perform a similarity measure between the one or more foreground audio objects, in the ambisonics domain, in the first time segment, and the one or more foreground audio objects, in the ambisonics domain, in the second time segment;
perform a reorder of the one or more foreground audio objects, in the ambisonics domain, in the first time segment with the one or more foreground audio objects, in the ambisonics domain, in the second time segment, to generate, one or more reordered foreground audio objects, in the ambisonics domain, in the first time segment;
perform a reorder of one or more spatial vectors, in the ambisonics domain in the first time segment, corresponding to the one or more foreground audio objects, in the first time segment, based on a swap of spatial positions of at least two of the one or more foreground audio objects in a soundfield such that a first spatial position in the ambisonics domain is associated with a second of the at least two of the one or more foreground audio objects in the soundfield after the reorder of the one or more spatial vectors, and that a second spatial position in the ambisonics domain is associated with a first of the at least two of the one or more foreground audio objects in the soundfield after the reorder of the one or more spatial vectors; and
encode (a) the reordered foreground audio objects, in the ambisonics domain, in the first time segment, and (b) the reordered spatial vectors, in the ambisonics domain, in the first time segment.
2. The device of 1 , wherein the one or more processors are configured to:
determine directional property parameters of (i) the one or more foreground audio objects in the ambisonics domain in the first time segment, (ii) the one or more foreground audio objects in the ambisonics domain in the first time segment, or both (i) the one or more foreground audio objects, in the ambisonics domain, in the first time segment and (ii) the one or more foreground audio objects, in the ambisonics domain, in the second time segment.
3. The device of claim 2 , wherein the directional property parameters provide an indication of movement and location of the one more foreground audio objects, in the ambisonics domain, in the first time segment.
4. The device of claim 2 , wherein the directional property parameters provide an indication of movement and location of the one more foreground audio objects, in the ambisonics domain, in the second time segment.
5. The device of claim 1 , wherein the first time segment is an audio frame, and the second time segment is an audio frame.
6. The device of claim 1 , wherein the one or more processors are configured to perform the reorder of the one or more foreground audio objects, in the ambisonic domain, in the first time segment with the one or more foreground audio objects, in the ambisonic domain, in the second time segment comprises:
an energy comparison of one of the one or more foreground audio objects in the first time segment with more than one of the one or more foreground audio objects in the second time segment.
7. The device of claim 6 , wherein the one or more processors are configured to discard at least one of the one or more foreground audio objects in the second time segment, as reorder candidates, with the one of the one or more foreground audio objects in the first time segment.
8. The device of claim 1 , wherein the one or more processors are configured to sequentially perform (a) the reorder of the one or more spatial vectors, in the ambisonics domain, in the first time segment, corresponding to the one or more foreground audio objects in the first time segment with (b) the reorder of the one or more foreground audio objects, in the ambisonic domain, in the first time segment.
9. The device of claim 1 , wherein the one or more processors are configured to: concurrently perform (a) the reorder of the one or more spatial vectors, in the ambisonics domain, corresponding to the one or more foreground audio objects in the first time segment with (b) the reorder of the one or more foreground audio objects, in the ambisonics domain, in the first time segment.
10. The device of claim 1 , wherein the one or more processors are configured to generated separate syntax elements that to indicate the reorder of the one or more spatial vectors in the first time segment and the reorder of the one or more foreground audio objects in the first time segment.
11. The device of claim 1 , wherein the one or more processors are configured to differently reorder (a) the one or more spatial vectors in the first time segment than (b) the one or more foreground audio objects in the first time segment.
12. The device of claim 11 , wherein the one or more processors are configured to differently reorder based on the swap of spatial positions of the at least two of the one or more foreground audio objects in the soundfield.
13. Device of claim 1 , wherein the similarity measure is based on a correlation operation.
14. A device configured to decode a bitstream comprising:
a memory configured to store the bitstream;
one or more processors, coupled to the memory, configured to:
receive the bitstream that includes reorder information to determine how one or more reordered foreground audio objects, in an ambisonics domain, in a first time segment were reordered;
decompress the received bitstream to:
generate the foreground audio objects, in the ambisonics domain, in the first time segment based on the reorder information; and
generate one or more spatial vectors, in the ambisonics domain, wherein the one or more spatial vectors corresponds to the one or more foreground audio objects in the first time segment, wherein the reorder information is based on a swap of spatial positions of at least two of the one or more foreground audio objects in a soundfield such that a first spatial position in the ambisonics domain is associated with a second of the at least two of the one or more foreground audio objects in the soundfield after the reorder of the one or more spatial vectors, and that a second spatial position in the ambisonics domain is associated with a first of the at least two of the one or more foreground audio objects in the soundfield after the reorder of the one or more spatial vectors.
15. The device of claim 14 , wherein the one or more processors are configured to generate un-reordered one or more foreground audio objects, in the ambisonics domain, in the first time segment.
16. The device of claim 15 , wherein the one or more processors are configured to sequentially perform (a) the un-reorder of the one or more spatial vectors, in the ambisonics domain, corresponding to the one or more foreground audio objects in the first time segment with (b) the un-reorder of the one or more foreground audio objects, in the ambisonics domain, in the first time segment.
17. The device of claim 15 , wherein the one or more processors are configured to concurrently perform (a) the un-reorder of the one or more spatial vectors, in the ambisonics domain, corresponding to the one or more foreground audio objects in the first time segment with (b) the un-reorder of the one or more foreground audio objects, in the ambisonics domain, in the first time segment.
18. The device of claim 15 , wherein the one or more processors are configured to differently un-reorder (a) the one or more spatial vectors in the first time segment than (b) the one or more foreground audio objects in the first time segment.
19. The device of claim 18 , wherein the one or more processors are configured to differently un-reorder based on the swap of spatial positions of the at least two of the one or more foreground audio objects in the soundfield.
20. The device of claim 14 , wherein the first time segment is an audio frame and the second time frame is an audio frame.
21. The device of claim 15 , wherein the one or more processors are configured to receive syntax elements separately, a first syntax element for the one or more foreground audio objects in the first time segment and a second syntax element for the one or more spatial vectors, in the ambisonics domain, in the first time segment.