IP Library Granted Patent US 7,903,137
Granted Patent B2
US 7,903,137 · App. 11/405,684 · Granted Mar 8, 2011

Videoconferencing echo cancellers

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,903,137
App. No.
11/405,684
Granted
Mar 8, 2011
Kind
B2
Abstract

A system may be configured to: receive remote audio signals and corresponding spatial indicators from remote systems; generate output signals for local speakers based on the remote audio signals and the corresponding spatial indicators; supply a microphone input signal to a first echo canceller in a series of echo cancellers, where each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus connecting the speakers; map each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator; for each position of the set of positions, combine any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller; transmit a resultant signal including at least an output of a last echo canceller of the series to the remote systems.

Claims (53)

1. A method for performing echo cancellation of audio signals comprising:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers˜wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series feeds the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

2. The method of claim 1 , wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

3. The method of claim 1 , wherein (a) through (f) are performed by one or more processors in a videoconferencing system.

4. The method of claim 1 further comprising:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

5. The method of claim 1 , wherein (a) through (f) are performed by one or more processors in a speakerphone.

6. The method of claim 1 , wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

7. The method of claim 1 further comprising:

repeating (a) through (f) a number of times.

8. A computer-readable memory medium configured to store program instructions, wherein the program instructions are executable to implement:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers, wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series feeds the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

9. The memory medium of claim 8 , wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

10. The memory medium of claim 8 , wherein the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

11. The memory medium of claim 8 , wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

12. The memory medium of claim 8 wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.

13. A system for performing echo cancellation of audio signals comprising:

a memory configured to store program instructions;

a processor configured to read and execute the program instructions from the memory, wherein the program instructions are executable by the processor to implement:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers, wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series couples to the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

14. The system of claim 13 , wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

15. The system of claim 13 further comprising the microphone and the plurality of speakers.

16. The system of claim 15 further comprising a display unit and a video camera.

17. The system of claim 13 , where the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

18. The system of claim 13 , wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

19. The system of claim 13 , wherein the program instructions are executable to further implement:

repeating (a) through (f) for each microphone in an array of microphones.

20. The system of claim 13 , wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2025
From: SL MIDCO 2, LLC; SL MIDCO 1, LLC; LO PLATFORM MIDCO, INC.; SERENOVA, LLC; LIFESIZE, INC.; TELESTRAT LLC; LIGHT BLUE OPTICS INC.; SERENOVA WFM, INC.
To: ENGHOUSE INTERACTIVE INC.
Reel/Frame 070932/0415 →
SECURITY INTEREST Recorded Mar 16, 2020
From: LIFESIZE, INC.
To: WESTRIVER INNOVATION LENDING FUND VIII, L.P.
Reel/Frame 052179/0063 →
SECURITY INTEREST Recorded Mar 2, 2020
From: SERENOVA, LLC; LIFESIZE, INC.; LO PLATFORM MIDCO, INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 052066/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2016
From: LIFESIZE COMMUNICATIONS, INC.
To: LIFESIZE, INC.
Reel/Frame 037900/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2006
From: OXFORD, WILLIAM V.; KENOYER, MICHAEL L.
To: LIFESIZE COMMUNICATIONS, INC.
Reel/Frame 018104/0982 →