IP Library Granted Patent US 12,058,511
Granted Patent B2
US 12,058,511 · App. 17/593,705 · Granted Aug 6, 2024

Sound field related rendering

Inventors: Mikko-Ville Laitinen (Espoo, FI); Juha Vilkamo (Helsinki, FI); Lasse Laaksonen (Tampere, FI)
Assignee: Nokia Technologies Oy
H04S7/30G10L19/008H04S3/008H04S2400/01H04S2400/03H04S2420/03H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,058,511
App. No.
17/593,705
Granted
Aug 6, 2024
Kind
B2
Abstract

An apparatus including circuitry configured to: obtain at least two audio signals; determine a type of the at least two audio signals; process the at least two audio signals configured to be rendered based on the determined type of the at least two audio signals.

Claims (89)

1. An apparatus comprising:

at least one processor; and

at least one non-transitory memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

obtain at least two audio signals;

obtain at least one parameter associated with the at least two audio signals;

determine a type of the at least two audio signals based, at least partially, on the at least one parameter; and

process the at least two audio signals for rendering based, at least partially, on the determined type of the at least two audio signals.

2. The apparatus as claimed in claim 1 , wherein the at least two audio signals are at least one of:

transport audio signals; or

previously processed audio signals.

3. The apparatus as claimed in claim 1 , wherein determining the type of the at least two audio signals comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to one of:

extract and decode at least one type indicator from the at least one parameter; or

in response to the at least one parameter representing a spatial audio aspect associated with the at least two audio signals, analyse the at least one parameter to determine the type of the at least two audio signals.

4. The apparatus as claimed in claim 3 , wherein analysing the at least one parameter to determine the type of the at least two audio signals comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:

determine a broadband left or right channel to total energy ratio based on the at least two audio signals;

determine a higher frequency left or right channel to total energy ratio based on the at least two audio signals;

determine a sum to total energy ratio based on the at least two audio signals;

determine a subtract to target energy ratio based on the at least two audio signals; and

determine the type of the at least two audio signals based on at least one of:

the broadband left or right channel to total energy ratio;

the higher frequency left or right channel to total energy ratio based on the at least two audio signals;

the sum to total energy ratio based on the at least two audio signals; or

the subtract to target energy ratio.

5. The apparatus as claimed in claim 1 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to determine at least one type parameter associated with the type of the at least two audio signals.

6. The apparatus as claimed in claim 5 , wherein processing the at least two audio signals for rendering comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to convert the at least two audio signals based on the at least one type parameter associated with the type of the at least two audio signals.

7. The apparatus as claimed in claim 1 , wherein the type of the at least two audio signals comprises at least one of:

a capture microphone arrangement;

a capture microphone separation distance;

a capture microphone parameter;

a transport channel identifier;

a spaced audio signal type;

a downmix audio signal type;

a coincident audio signal type; or

a transport channel arrangement.

8. The apparatus as claimed in claim 1 , wherein processing the at least two audio signals for rendering comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to at least one of:

convert the at least two audio signals into an ambisonic audio signal representation;

convert the at least two audio signals into a multichannel audio signal representation; or

downmix the at least two audio signals into fewer audio signals.

9. The apparatus as claimed in claim 1 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to generate at least one prototype signal based on the at least two audio signals and the type of the at least two audio signals.

10. A method comprising:

obtaining at least two audio signals;

obtaining at least one parameter associated with the at least two audio signals;

determining a type of the at least two audio signals based, at least partially, on the at least one parameter; and

processing the at least two audio signals for rendering based, at least partially, on the determined type of the at least two audio signals.

11. The method as claimed in claim 10 , wherein the at least two audio signals are at least one of:

transport audio signals; or

previously processed audio signals.

12. The method as claimed in claim 10 , wherein determining the type of the at least two audio signals based on the at least one parameter further comprises one of:

extracting and decoding at least one type signal from the at least one parameter; or

in response to the at least one parameter representing a spatial audio aspect associated with the at least two audio signals, analysing the at least one parameter to determine the type of the at least two audio signals.

13. The method as claimed in claim 12 , wherein analysing the at least one parameter to determine the type of the at least two audio signals further comprises:

determining a broadband left or right channel to total energy ratio based on the at least two audio signals;

determining a higher frequency left or right channel to total energy ratio based on the at least two audio signals;

determining a sum to total energy ratio based on the at least two audio signals;

determining a subtract to target energy ratio based on the at least two audio signals; and

determining the type of the at least two audio signals based on at least one of:

the broadband left or right channel to total energy ratio;

the higher frequency left or right channel to total energy ratio based on the at least two audio signals;

the sum to total energy ratio based on the at least two audio signals; or

the subtract to target energy ratio.

14. The method as claimed in claim 10 , further comprises at least one of:

determining at least one type parameter associated with the type of the at least two audio signals; or

processing the at least two audio signals based on the determined type of the at least two audio signals comprises converting the at least two audio signals based on the at least one type parameter associated with the type of the at least two audio signals.

15. The method as claimed in claim 10 , wherein processing the at least two audio signals further comprises at least one of:

converting the at least two audio signals into an ambisonic audio signal representation;

converting the at least two audio signals into a multichannel audio signal representation; or

downmixing the at least two audio signals into fewer audio signals.

16. The method as claimed in claim 10 , wherein processing the at least two audio signals further comprises generating at least one prototype signal based on the at least two audio signals and the type of the at least two audio signals.

17. A non-transitory computer-readable medium comprising program instructions stored thereon for performing at least the following:

causing obtaining of at least two audio signals;

causing obtaining of at least one parameter associated with the at least two audio signals;

determining a type of the at least two audio signals based, at least partially, on the at least one parameter; and

processing the at least two audio signals for rendering based, at least partially, on the determined type of the at least two audio signals.

18. The non-transitory computer-readable medium as claimed in claim 17 , wherein the at least two audio signals are at least one of:

transport audio signals; or

previously processed audio signals.

19. The non-transitory computer-readable medium as claimed in claim 17 , wherein the program instructions stored thereon for performing determining the type of the at least two audio signals comprises program instructions for performing one of:

extracting and decoding at least one type signal from the at least one parameter; or

in response to the at least one parameter representing a spatial audio aspect associated with the at least two audio signals, analysing the at least one parameter to determine the type of the at least two audio signals.

20. The non-transitory computer-readable medium as claimed in claim 19 , wherein the program instructions stored thereon for performing analysing the at least one parameter to determine the type of the at least two audio signals comprises program instructions for performing one of:

determining a broadband left or right channel to total energy ratio based on the at least two audio signals;

determining a higher frequency left or right channel to total energy ratio based on the at least two audio signals;

determining a sum to total energy ratio based on the at least two audio signals;

determining a subtract to target energy ratio based on the at least two audio signals; and

determining the type of the at least two audio signals based on at least one of:

the broadband left or right channel to total energy ratio;

the higher frequency left or right channel to total energy ratio based on the at least two audio signals;

the sum to total energy ratio based on the at least two audio signals; or

the subtract to target energy ratio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2021
From: LAITINEN, MIKKO-VILLE; VILKAMO, JUHA TAPIO; LAAKSONEN, LASSE
To: NOKIA TECHNOLOGIES OY
Reel/Frame 057713/0220 →
Priority Claims (1)
GB 1904261 · Mar 27, 2019 · national
Continuity (1)
Related Publication 20220174443A1 · Jun 2, 2022