IP Library Granted Patent US 9,888,335
Granted Patent B2
US 9,888,335 · App. 13/378,338 · Granted Feb 6, 2018

Method and apparatus for processing audio signals

Inventors: Antti Eronen (Tampere, FI); Pasi Ojala (Kirkkonummi, FI)
Assignee: Nokia Technologies Oy
H04S7/302H04M3/568H04R1/406H04R3/005H04R5/027H04R27/00H04R2227/003H04S3/008H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,888,335
App. No.
13/378,338
Granted
Feb 6, 2018
Kind
B2
Abstract

An apparatus ( 300 ) comprises—one or more inputs (IN 1 , IN 2 ) to receive two or more different audio signals (S 1 , S 2 ),—an input (IN —VDI1 ) to receive a direction signal (S VDI1 ) and—a signal processing unit ( 100 ) arranged to generate a processed audio signal (S AUDIOI ) from said two or more different audio signals (S 1 , S 2 ), said processed audio signal (S AUDIO1 ) comprising an enhanced audio signal (S ENC1 ) corresponding to a sound (SND 2 ) originating from a location (x 2 y 2 ) indicated by said direction signal (S VDI1 ).

Claims (46)

1. An apparatus comprising at least one processor and at least one memory including computer program code configured to, with the processor, cause the apparatus to:

receive two or more different audio signals from two or more microphones;

receive a direction signal based at least in part on a gaze location time satisfying a predetermined time period, wherein the direction signal is updated in response to the gaze location time satisfying the predetermined time period;

generate a processed audio signal from said two or more different audio signals, said processed audio signal comprising an enhanced audio signal corresponding to a sound originating from a location indicated by said direction signal;

determine one or more spatial parameters;

provide said one or more spatial parameters for controlling audio source locations;

modify the values of said one or more spatial parameters based on said direction signal wherein said spatial parameters comprise at least one of interchannel time difference parameters or interchannel level difference parameters;

provide the modified values of said spatial parameters in subsequent decoding of said processed audio signal; and

allocate a first bit rate audio transmission for said two or more different audio signals originating from the location indicated by said direction signal;

otherwise allocate a second bit rate audio transmission for said two or more different audio signals originating from locations other than the location indicated by said direction signal,

wherein the first bit rate audio transmission is greater than the second bit rate audio transmission.

2. The apparatus according to claim 1 wherein said direction selecting unit further comprises an electronic compass, an accelerometer, or a gyroscope.

3. The apparatus according to claim 1 comprising an interface for receiving said direction signal sent via a transmission path.

4. The apparatus according to claim 1 comprising a damping unit to reduce fluctuations in said direction information.

5. The apparatus according to claim 1 comprising two or more microphones arranged to operate as a directional microphone array, wherein the direction of maximum sensitivity of said directional microphone array is arranged to be adjusted based on said direction signal.

6. The apparatus according to claim 1 comprising a position detecting unit to determine the location of said direction selecting unit.

7. The apparatus according to claim 6 wherein said position detecting unit is based on a satellite navigation system.

8. The apparatus according to claim 1 , wherein said processed audio signal is binaural cue coded.

9. The apparatus according to claim 1 wherein said spatial parameters comprise parameters describing a direction of arrival of a sound.

10. A method, comprising:

receiving, at a signal processing unit, two or more audio signals from two or more microphones;

receiving a direction signal based at least in part on a gaze location time satisfying a predetermined time period, wherein the direction signal is updated in response to the gaze location time satisfying the predetermined time period;

generating a processed audio signal from said two or more different audio signals, said processed audio signal comprising an enhanced audio signal corresponding to a sound originating from a location indicated by said direction signal,

determine one or more spatial parameters;

providing said one or more spatial parameters for controlling audio source locations;

modifying the values of said one or more spatial parameters based on said direction signal wherein said spatial parameters comprise at least one of interchannel time difference parameters or interchannel level difference parameters;

providing the modified values of said spatial parameters in subsequent decoding of said processed audio signal; and

allocating a first bit rate audio transmission for said two or more different audio signals originating from the location indicated by said direction signal;

otherwise allocating a second bit rate audio transmission for said two or more different audio signals originating from locations other than the location indicated by said direction signal, wherein the first bit rate audio transmission is greater than the second bit rate audio transmission.

11. The method according to claim 10 wherein said direction selecting unit further comprises an electronic compass, an accelerometer, or a gyroscope.

12. The method according to claim 10 comprising receiving said direction signal sent via said transmission path.

13. A computer program product comprising at least one computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions including program code instructions for:

receiving two or more audio signals from two or more microphones;

receiving a direction signal based at least in part on a gaze location time satisfying a predetermined time period, wherein the direction signal is updated in response to the gaze location time satisfying the predetermined time period;

generating a processed audio signal from said two or more different audio signals, said processed audio signal comprising an enhanced audio signal corresponding to a sound originating from a location indicated by said direction signal,

determine one or more spatial parameters;

providing said one or more spatial parameters for controlling audio source locations;

modifying the values of said one or more spatial parameters based on said direction signal wherein said spatial parameters comprise at least one of interchannel time difference parameters or interchannel level difference parameters;

providing the modified values of said spatial parameters in subsequent decoding of said processed audio signal; and

allocating a first bit rate audio transmission for said two or more different audio signals originating from the location indicated by said direction signal;

otherwise allocating a second bit rate audio transmission for said two or more different audio signals originating from locations other than the location indicated by said direction signal, wherein the first bit rate audio transmission is greater than the second bit rate audio transmission.

14. The computer program product according to claim 13 , including program code instructions for:

receiving said direction signal sent via said transmission path.

15. The apparatus according to claim 1 further causing the apparatus to receive a command by a user interface to enhance the processed audio signal relating to said gaze location.

16. The method according to claim 10 further comprising receiving a command by a user interface to enhance the processed audio signal relating to said gaze location.

17. The computer program product according to claim 13 , including program code instructions for receiving a command by a user interface to enhance the processed audio signal relating to said gaze location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035316/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2012
From: ERONEN, ANTTI; OJALA, PASI
To: NOKIA CORPORATION
Reel/Frame 027858/0639 →
Continuity (1)
Related Publication 20120163606A1 · Jun 28, 2012