Methods and systems for automatically updating look directions of radiation patterns
A method that includes displaying a user interface (UI) of a three-dimensional (3D) acoustic environment that includes a sound source; receiving a user selection, via an input device, of a location within the UI, the location towards which the sound source is to be oriented within the 3D acoustic environment; determining a set of parameters that define an orientation of the sound source towards the location within the 3D acoustic environment; determining that there is motion of the location or the sound source within the 3D acoustic environment; updating, without user intervention and based on the motion, the set of parameters to maintain the orientation of the sound source towards the location.
1 . A method comprising:
displaying a user interface (UI) of a three-dimensional (3D) acoustic environment that includes a sound source;
receiving a first user selection, via an input device, of a location within the UI, the location towards which the sound source is to be oriented within the 3D acoustic environment;
receiving a second user selection through the input device of a UI item that locks an orientation of the sound source with the location;
determining, responsive to the receiving of the second user selection, a set of parameters that define the orientation of the sound source towards the location within the 3D acoustic environment;
determining that there is motion of the location or the sound source within the 3D acoustic environment; and
updating, without user intervention and based on the motion, the set of parameters to maintain the orientation of the sound source towards the location.
2 . The method of claim 1 , wherein the sound source is a first sound source, and the location is one of:
a static location within the 3D acoustic environment,
a second sound source within the 3D acoustic environment, or
a point within a region surrounded by a plurality of sound sources within the 3D acoustic environment.
3 . The method of claim 2 , wherein the motion of the location comprises a movement of the second sound source from the location to a new location within the 3D acoustic environment, wherein the set of parameters are updated such that the orientation of the first sound source follows the second sound source from the location to the new location.
4 . The method of claim 1 , wherein the sound source comprises a radiation pattern for sound of the sound source, wherein the orientation is a look direction the radiation pattern from the sound source and towards the location.
5 . The method of claim 1 further comprising fixing the orientation of the sound source towards the location responsive to receiving the second user selection such that regardless of the motion of the location or the sound source, the orientation of the sound source remains directed towards the location.
6 . The method of claim 1 further comprising:
encoding the sound source into a bitstream for transmission to a playback device; and
providing metadata that includes the set of parameters,
wherein the playback device is to be configured to render the sound source according to the set of parameters.
7 . The method of claim 6 further comprising, subsequent to providing the metadata, providing the updated set of parameters such that the playback device is configured to adjust the orientation of the sound source during rendering of the sound source.
8 . The method of claim 6 , wherein the sound source is a part of a live audio broadcast.
9 . An electronic device comprising:
at least one processor; and
memory having instructions stored therein which when executed by the at least one processor causes the electronic device to:
receive an audio object of a sound program, the audio object comprising a radiation pattern for projecting sound towards a look direction of the audio object within a three-dimensional (3D) scene;
assign a point within the 3D scene of which the look direction of the audio object is to be directed towards;
receive a user selection of an item for locking the look direction;
determine, responsive to a reception of the user selection, one or more orientation parameters for the look direction of the audio object;
determine whether there is motion of the point or of the audio object within the 3D scene; and
responsive to a determination that there is motion of the point or of the audio object, update, based on the motion and without user intervention, the one or more orientation parameters to maintain the look direction directed towards the point.
10 . The electronic device of claim 9 , wherein the user selection is a first user selection, wherein the electronic device further comprises a display, wherein the memory has further instructions to display a user interface (UI) of the 3D scene on the display, wherein the instructions to assign the point comprises instructions to receive, through an input device, a second user selection of the point within the UI, wherein the item is a UI item within the UI.
11 . The electronic device of claim 9 , wherein the audio object is a first audio object, wherein the point is one of:
a static location with respect to an origin within the 3D scene,
a second audio object within the 3D scene, or
a location within a region surrounded by a plurality of audio objects within the 3D scene.
12 . The electronic device of claim 11 , wherein the location is a centroid of the region.
13 . The electronic device of claim 9 , wherein the sound program is a live audio broadcast.
14 . The electronic device of claim 9 , wherein the sound program is a live audio communication between the electronic device and a playback device.
15 . A method comprising:
decoding an audio object of a sound program from a bitstream;
receiving metadata of the sound program, wherein the metadata instructs a decoding side to lock a look direction of a radiation pattern of the audio object towards a point within a three-dimensional (3D) scene as the point or the audio object moves during playback of the sound program;
determining a listener location within the 3D scene, wherein the point is to be at the listener location;
determining one or more orientation parameters for the look direction of the radiation pattern to be orientated towards the listener location;
producing a set of spatially rendered audio signals by spatially rendering the sound program according to the one or more orientation parameters; and
using the set of spatially rendered audio signals to drive a set of speakers to playback the sound program.
16 . The method of claim 15 , wherein the point is a first point, the look direction is a first look direction, the radiation pattern is a first radiation pattern, and the audio object is a first audio object, wherein the metadata further instructs the decoding side to lock a second look direction of a second radiation pattern of a second audio object towards a second point within the 3D scene.
17 . The method of claim 16 , wherein the second point is at a location of the first audio object within the 3D scene.
18 . The method of claim 16 , wherein the metadata comprises a plurality of references to a plurality of audio objects within the 3D scene, wherein the method further comprises:
determining locations of the plurality of audio objects based on the plurality of references;
determining a location of the second point within an area bounded by the locations of the plurality of audio objects; and
determining the second look direction of the second radiation pattern of the second audio object from a location of the second audio object to the location of the second point within the 3D scene.
19 . The method of claim 15 , wherein the audio object is at a first location within the 3D scene, wherein the method further comprises:
determining that the audio object has moved to a second location or that the listener location has moved to a new listener location within the 3D scene; and
moving the look direction of the radiation pattern from the first location to the second location or from the listener location to the new listener location over a period of time.
20 . The method of claim 19 further comprising determining an angle between either the first location and the second location with respect to the listener location or the listener location and the new listener location with respect to the first location within the 3D scene, wherein moving the look direction comprises rotating the look direction along the angle at a velocity based on the period of time.
21 . The method of claim 15 , wherein the metadata further comprises one or more angular offsets, wherein the method further comprises spatially rendering the audio object such that the look direction of the radiation pattern is offset from the point based on the one or more angular offsets.
22 . The method of claim 15 , wherein the sound program is a live audio broadcast.