IP Library Granted Patent US 11,570,569
Granted Patent B2
US 11,570,569 · App. 16/960,723 · Granted Jan 31, 2023

Associated spatial audio playback

Inventors: Sujeet Shyamsundar Mate (Tampere, FI); Adriana Vasilache (Tampere, FI); Lasse Laaksonen (Tampere, FI); Kari Jarvinen (Vantaa, FI); Antti Eronen (Tampere, FI); Jussi Leppanen (Tampere, FI)
Assignee: Nokia Technologies Oy
H04S7/304G06F3/012H04R1/406H04R3/005H04S3/008H04R2201/401H04R2430/20H04S2400/01H04S2400/11H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,570,569
App. No.
16/960,723
Granted
Jan 31, 2023
Kind
B2
Abstract

An apparatus including at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured, with the at least one processor, to cause the apparatus at least to: generate content lock information for a content lock, wherein the content lock information enables control of audio signal processing associated with audio signals related to one or more audio sources based on a position and/or orientation input.

Claims (88)

1. An apparatus comprising

at least one processor and

at least one non-transitory memory including computer code for one or more programs, the at least one memory and the computer code configured, with the at least one processor, to cause the apparatus at least to:

generate content lock information for a content lock, wherein the content lock is associated with at least one audio source, wherein the content lock information enables control of audio signal processing associated with audio signals related to the at least one audio source based on a position and/or orientation input relative to the at least one audio source; and

provide the content lock information for the audio signal processing associated with the audio signals.

2. The apparatus as claimed in claim 1 , wherein the content lock information is configured to enable control of image processing of images based on the position and/or orientation input, wherein the at least one audio source comprises at least one audio object.

3. The apparatus as claimed in claim 1 , wherein the generated content lock information is configured to cause the apparatus to generate at least one of:

a trigger parameter configured to activate the content lock;

an identifier configured to identify the at least one audio source; or

at least one content lock type to be applied to the at least one audio source

as part of the content lock information.

4. The apparatus as claimed in claim 3 , wherein the at least one content lock type is at least one of:

a translational lock for locking the at least one audio source translationally;

a rotational lock for locking the at least one audio source rotationally;

a head lock for locking the at least one audio source translationally and rotationally;

a body lock for locking the at least one audio source rotationally and for not locking the at least one audio source translationally;

a hard lock for locking the at least one audio source with no motion; or

a soft lock for locking the at least one audio source within a range of values.

5. The apparatus as claimed in claim 3 , wherein the trigger parameter comprises at least one of:

a viewport range defined in at least one of: azimuth or elevation;

a time range; or

an object identifier.

6. The apparatus as claimed in claim 3 , wherein the generated content lock information is configured to cause the apparatus to generate at least one of:

an image effect to be applied to an image when the content lock is implemented; or

an audio effect to be applied by the audio signal processing when the content lock is implemented.

7. The apparatus as claimed in claim 1 , wherein the content lock information comprises interactivity information, wherein the interactivity information comprises at least one of:

a trigger identifier caused to associate the interactivity information to at least one content lock trigger; or

an impact effect linked to the trigger identifier, the impact effect defining an effect to be applied by the audio signal processing associated with the audio signals related to the at least one audio source based on the position and/or orientation input.

8. The apparatus as claimed in claim 7 , wherein the impact effect comprises at least one of:

an emphasis in gain;

a de-emphasis in the gain;

an increase in spatial extent; or

a decrease in the spatial extent.

9. An apparatus comprising

at least one processor and

at least one non-transitory memory including computer code for one or more programs, the at least one memory and the computer code configured, with the at least one processor, to cause the apparatus at least to:

generate content lock information for a content lock, wherein the content lock information enables control of audio signal processing associated with audio signals related to one or more audio sources based on a position and/or orientation input;

obtain the audio signals related to the one or more audio sources;

analyse the audio signals to generate information related to the one or more audio sources; and

transmit the audio signals, the information related to the one or more audio sources and the content lock information to at least one further apparatus.

10. The apparatus as claimed in claim 9 , wherein the apparatus is further configured to cause at least one of:

capture the audio signals; or

receive the audio signals from at least one audio capture apparatus.

11. The apparatus as claimed in claim 9 , wherein the apparatus is configured to further cause:

capture at least one image, the image being associated with the one or more audio sources; and

transmit the at least one image with the audio signals, the information related to the one or more audio sources and the content lock information to the at least one further apparatus.

12. An apparatus comprising

at least one processor and

at least one non-transitory memory including computer code for one or more programs, the at least one memory and the computer code configured, with the at least one processor, to cause the apparatus at least to:

receive at least one audio signal;

receive information associated with at least one audio source, wherein the at least one audio signal is related to the at least one audio source;

receive content lock information for a content lock, the content lock information associated with the at least one audio source;

receive at least one position and/or orientation input relative to the at least one audio source; and

process the at least one audio signal based on the information associated with at least one audio source and the content lock information, further based on the position and/or orientation input.

13. The apparatus as claimed in claim 12 , where the apparatus is further configured to cause:

receive at least one image; and

image process the at least one image based on the content lock information and the position and/or orientation input.

14. The apparatus as claimed in claim 12 , wherein the apparatus caused to receive the content lock information is further configured to cause receiving at least one of:

a trigger parameter configured to activate the content lock;

an identifier configured to identify the at least one audio source; or

at least one content lock type to be applied to the at least one audio source.

15. The apparatus as claimed in claim 14 , wherein the at least one content lock type is at least one of:

a translational lock for locking the at least one audio source translationally;

a rotational lock for locking the at least one audio source rotationally;

a head lock for locking the at least one audio source translationally and rotationally;

a body lock for locking the at least one audio source rotationally and for not locking the at least one audio source translationally;

a hard lock for locking the at least one audio source with no motion; or

a soft lock for locking the at least one audio source within a range of values.

16. The apparatus as claimed in claim 14 , wherein the trigger parameter comprises at least one of:

a viewport range defined in at least one of: azimuth or elevation;

a time range; or

an object identifier.

17. The apparatus as claimed in claim 12 , wherein the apparatus, based on the position and/or orientation input, is further configured to cause:

determine an occurrence of trigger event defined by a trigger parameter based on the position and/or orientation input;

select a lock type processing based on a content lock type of the determined trigger event; and

apply the selected lock type processing to the at least one audio signal.

18. The apparatus as claimed in claim 17 , wherein the at least one selected lock type processing comprises locking at least one of:

a gain associated with the at least one audio source; or

a spatial extent associated with the at least one audio source.

19. A method comprising

generating content lock information for a content lock, wherein the content lock is associated with at least one audio source, wherein the content lock information enables control of audio signal processing associated with audio signals related to the at least one audio source based on a position and/or orientation input relative to the at least one audio source; and

providing the content lock information for the processing associated with the audio signals.

20. A method comprising:

receiving at least one audio signal;

receiving information associated with at least one audio source, wherein the at least one audio signal is related to the at least one audio source; and

receiving content lock information for a content lock, the content lock information associated with the at least one audio source;

receiving at least one position and/or orientation input relative to the at least one audio source; and

processing the at least one audio signal based on the information associated with at least one audio source and the content lock information, further based on the position and/or orientation input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2020
From: MATE, SUJEET SHYAMSUNDAR; VASILACHE, ADRIANA; LAAKSONEN, LASSE; JARVINEN, KARI; ERONEN, ANTTI; LEPPANEN, JUSSI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 053249/0252 →
Priority Claims (1)
GB 1800920 · Jan 19, 2018 · national
Continuity (1)
Related Publication 20200344563A1 · Oct 29, 2020