Orientation-aware surround sound playback
Example embodiments disclosed herein relate to orientation-aware surround sound playback. A method for processing audio on an electronic device that includes a plurality of loudspeakers is disclosed, the loudspeakers arranged in more than one dimension of the electronic device. The method includes, responsive to receipt of a plurality of received audio streams, generating a rendering component associated with the plurality of received audio streams, determining an orientation dependent component of the rendering component, processing the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers and dispatching the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component. Corresponding system and computer program products are also disclosed.
1. A method for processing audio on an electronic device comprising a plurality of loudspeakers, the loudspeakers arranged in more than one dimension of the electronic device, comprising:
responsive to receipt of a plurality of received audio streams, generating a rendering component associated with the plurality of received audio streams;
determining an orientation dependent component of the rendering component;
processing the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers;
cancelling crosstalk of the received audio streams;
separating a crosstalk cancellation function into an orientation dependent component and an orientation independent component; and
dispatching the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component, wherein the method further comprises decomposing the received audio streams to direct and diffuse parts; and
in determining the orientation dependent component of the rendering component, different orientation dependent components are used for the direct and diffuse parts, respectively.
2. The method according to claim 1 , further comprising upmixing or downmixing the received audio streams depending on the number of the loudspeakers.
3. The method according to claim 1 , wherein determining an orientation dependent component of the rendering component comprises:
splitting the rendering component into orientation dependent component and orientation independent component.
4. The method according to claim 1 , the orientation of the loudspeakers is associated with an angle between the electronic device and its user continuously.
5. The method according to claim 1 , wherein the rendering component is associated with the content or the format of the received audio streams.
6. The method according to claim 1 , wherein the plurality of received audio streams are two channel signals, multi-channel signals, object audio format signals or Ambisonics B-format signals.
7. The method according to claim 6 , the method further comprising converting the plurality of received audio streams into mid-side format when the plurality of received audio streams are two channel signals.
8. The method according to claim 6 , further comprising processing metadata carried by the received audio streams.
9. A system for processing audio on an electronic device comprising a plurality of loudspeakers, the loudspeakers arranged in more than one dimension of the electronic device, comprising:
a generator that generate a rendering component associated with a plurality of received audio streams, responsive to receipt of the plurality of received audio streams;
a determiner that determine an orientation dependent component of the rendering component;
a processor that process the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers;
a crosstalk canceller configured to cancel crosstalk of the received audio streams, and to separate a crosstalk cancellation function into an orientation dependent component and an orientation independent component; and
a dispatcher that dispatch the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component, wherein the system further comprises a decomposer that decompose the received audio streams to direct and diffuse parts, and further wherein the determiner uses different orientation dependent components for the direct and diffuse parts, respectively.
10. The system according to claim 9 , further comprising an upmixer or a downmixer that upmix or downmix the received audio streams depending on the number of the loudspeakers.
11. The system according to claim 9 , wherein the determiner is further configured to split the rendering component into orientation dependent component and orientation independent component.
12. The system according to claim 9 , wherein the orientation of the loudspeakers is associated with an angle between the electronic device and its user.
13. The system according to claim 9 , wherein the rendering component is associated with the content or the format of the received audio streams.
14. The system according to claim 9 , wherein the received audio streams are two channel signals, multi-channel signals, object audio format signals or Ambisonics B-format signals.
15. The system according to claim 14 , the system further comprising a converter that convert the received audio streams into mid-side format when the plurality of received audio streams are two channel signals.
16. The system according to claim 14 , further comprising a metadata processer configured to process metadata carried by the received audio streams.
17. A computer program product, comprising a computer program tangibly embodied on a non-transitory machine readable medium, the computer program containing program code for performing the method according to claim 1 .