IP Library Granted Patent US 10,602,297
Granted Patent B2
US 10,602,297 · App. 15/828,881 · Granted Mar 24, 2020

Processing audio signals

Inventors: Xueru Zhang (Wilsele, BE); Eric Chambatte (Leuven, BE); Denis Kutuzov (Leuven, BE); Nilesh Madhu (Kessel-Lo, BE); Abid Rashid (Calcot, GB)
Assignee: NXP B.V.
H04S7/303H04M3/568H04R1/406H04S2400/01H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,602,297
App. No.
15/828,881
Granted
Mar 24, 2020
Kind
B2
Abstract

The disclosure relates to a processing multi-channel audio signals, an example embodiment including a method of processing a multi-channel audio signal, the method comprising: determining a location of sound sources ( 101, 102 ) within the signal; applying a rotation operation to the signal, a direction of the rotation operation dependent on the location of the sound sources in the signal; and generating a rotated audio signal.

Claims (73)

1. A method of processing a multi-channel audio signal, the method comprising:

determining a location of sound sources within the audio signal;

applying a rotation operation to the audio signal, a direction of the rotation operation dependent on the location of the sound sources in the signal;

generating a rotated audio signal;

wherein determining the location of sound sources within the signal comprises comparing the signal to pre-determined calibration information associated with a recording device; and

transforming the audio signal into the frequency domain;

wherein generating the rotated audio signal comprises transforming the signal into the time domain after the rotation operation has been applied to the signal.

2. The method of claim 1 ,

wherein determining the location of sound sources comprises classifying sound sources as located in a first region or a second region relative to a recording device.

3. The method of claim 2 ,

wherein the first region is in front of the recording device and the second region is behind the recording device.

4. The method of claim 2

wherein applying the rotation operation to the signal comprises:

separating the signal into a first signal and a second signal, the first signal comprising the sound sources classified as located in the first region, and the second signal comprising sound sources classified as located in the second region;

applying a first rotation operation to the first signal to generate a rotated first signal; and

applying a second rotation operation to the second signal to generate a rotated second signal.

5. The method of claim 4 ,

wherein generating the rotated audio signal comprises

combining the rotated first signal with the rotated second signal to form the rotated audio signal.

6. The method of claim 4 :

wherein the first and second rotation operations rotate signals in opposite directions by a same rotation angle.

7. The method of claim 1 ,

wherein determining the location of sound sources comprises

determining the location of each of a plurality of sound sources within the audio signal.

8. The method of claim 7 ,

wherein determining the location of sound sources further comprises

determining a direction of arrival of each sound source at the recording device.

9. The method of claim 7 ,

wherein applying a rotation operation comprises:

generating a rotation matrix relating the sound source locations to desired sound source locations; and

applying the rotation matrix to the signal.

10. The method of claim 1 ,

wherein determining a location of sound sources within the signal comprises

estimating the location of the sound sources using a regression algorithm.

11. The method of claim 1 :

wherein determining the location of sound sources within the signal comprises

establishing the location of sound sources by determining the values of s for which the function ∥y−Hs∥ 2 +λ∥s∥ 2 is a minimum,

where y is a matrix of size M×1 representing the observed signals, with M the number of channels in the audio signal, s is a vector with size N×1 representing a vector of the sound source locations with N the number of possible sound source candidates, H is the calibration matrix with size M×N, and λ is the Lagrange multiplier.

12. An audio processing device comprising:

an input for receiving a multi-channel audio signal;

a processor operable to perform the method of claim 1 on the signal; and

an output for outputting the rotated audio signal.

13. An article of manufacture including at least one non-transitory, tangible machine readable storage medium containing executable machine instructions for causing a processor to perform the method according to claim 1 .

14. A method of processing a multi-channel audio signal, the method comprising:

determining a location of sound sources within the audio signal;

applying a rotation operation to the audio signal, a direction of the rotation operation dependent on the location of the sound sources in the signal; and

generating a rotated audio signal;

wherein determining the location of sound sources comprises classifying sound sources as located in a first region or a second region relative to a recording device.

wherein applying a rotation operation to the signal comprises:

separating the signal into a first signal and a second signal, the first signal comprising the sound sources classified as located in the first region, and the second signal comprising sound sources classified as located in the second region;

applying a first rotation operation to the first signal to generate a rotated first signal; and

applying a second rotation operation to the second signal to generate a rotated second signal.

15. An audio processing device comprising:

an input for receiving a multi-channel audio signal;

a processor operable to,

determine a location of sound sources within the audio signal;

apply a rotation operation to the audio signal, a direction of the rotation operation dependent on the location of the sound sources in the signal; and

generate a rotated audio signal;

wherein determine the location of sound sources includes,

classify sound sources as located in a first region or a second region relative to a recording device.

wherein apply the rotation operation to the signal includes,

separate the signal into a first signal and a second signal, the first signal including the sound sources classified as located in the first region, and the second signal including sound sources classified as located in the second region;

apply a first rotation operation to the first signal to generate a rotated first signal; and

apply a second rotation operation to the second signal to generate a rotated second signal; and

an output for outputting the rotated audio signal.

16. The device of claim 15 ,

wherein generating the rotated audio signal comprises

combining the rotated first signal with the rotated second signal to form the rotated audio signal.

17. The device of claim 15 :

wherein the first and second rotation operations rotate signals in opposite directions by a same rotation angle.

18. The device of claim 15 ,

wherein determining the location of sound sources comprises

determining the location of each of a plurality of sound sources within the audio signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: NXP B.V.
To: GOODIX TECHNOLOGY (HK) COMPANY LIMITED
Reel/Frame 053455/0458 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2017
From: ZHANG, XUERU; CHAMBATTE, ERIC; KUTUZOV, DENIS; MADHU, NILESH; RASHID, ABID
To: NXP B.V.
Reel/Frame 044273/0632 →
Priority Claims (1)
EP 16206555 · Dec 23, 2016 · regional
Continuity (1)
Related Publication 20180184225A1 · Jun 28, 2018