Teleconferencing system with multi-channel imaging
View Patent ↗A method is disclosed that breaks the “one line, one location” paradigm of teleconferencing in the prior art. The teleconference bridge in the illustrative embodiment is able to utilize more than one audio channel from each location. By having access to more than one audio channel from a teleconference location's sound field, the bridge is able to create a multi-channel effect during a conference call. When more than one microphone is present in the first sound field, they can be used to create a multi-channel effect in a second or other sound field involved in a conference call that has more than one loudspeaker. With the bridge mimicking the multi-channel imaging in one room with the multi-channel imaging in another, the conference call participants can experience audio depth during a conference call and can experience two-dimensional imaging, depending on the microphone or speaker separation that is present.
1. A method comprising:
determining, at a teleconference bridge, the presence of
i) a first endpoint and a second endpoint at a first teleconference location, said teleconference bridge being able to receive audio signals from each of said first endpoint and said second endpoint, and
ii) a third endpoint and a fourth endpoint at a second teleconference location, said teleconference bridge being able to transmit audio signals to each of said third endpoint and said fourth endpoint,
wherein said first teleconference location and said second teleconference location are acoustically isolated from each other;
assigning
i) said first endpoint and said third endpoint to a first audio channel, and
ii) said second endpoint and said fourth endpoint to a second audio channel;
receiving
i) a first audio signal from said first endpoint, and
ii) a second audio signal from said second endpoint; and
transmitting
i) a third audio signal to all endpoints that have been assigned to said first audio channel at said second teleconference location, wherein said third audio signal is based on said first audio signal, and
ii) a fourth audio signal to all endpoints that have been assigned to said second audio channel at said second teleconference location, wherein said fourth audio signal is based on said second audio signal.
2. The method of claim 1 further comprising:
receiving
iii) a fifth audio signal from said third endpoint, and
iv) a sixth audio signal from said fourth endpoint; and
transmitting
iii) a seventh audio signal to all endpoints that have been assigned to said first audio channel at said first teleconference location, wherein said seventh audio signal is based on said fifth audio signal, and
iv) an eighth audio signal to all endpoints that have been assigned to said second audio channel at said first teleconference location, wherein said eighth audio signal is based on said sixth audio signal.
3. The method of claim 2 wherein said seventh audio signal further comprises a first attenuated signal, wherein said first attenuated signal is based on said sixth audio signal adjusted by a predetermined attenuation factor.
4. The method of claim 3 wherein said eighth audio signal further comprises a second attenuated signal, wherein said second attenuated signal is based on said fifth audio signal adjusted by said predetermined attenuation factor.
5. The method of claim 2 further comprising:
determining, at said teleconference bridge, the presence of iii) a fifth endpoint at said first teleconference location, wherein said teleconference bridge is also able to receive audio signals from said fifth endpoint;
assigning iii) said fifth endpoint to said first audio channel; and
receiving v) a ninth audio signal from said fifth endpoint;
wherein said third audio signal is based on at least one of said first audio signal and said ninth audio signal.
6. The method of claim 2 further comprising:
determining, at said teleconference bridge, the presence of
iii) a fifth endpoint at said first teleconference location, said teleconference bridge being able to receive audio signals from said fifth endpoint, and
iv) a sixth endpoint at said second teleconference location, said teleconference bridge being able to transmit audio signals to said sixth endpoint;
assigning iii) said fifth endpoint and said sixth endpoint to a third audio channel, wherein the assigning of endpoints to each of said first audio channel, said second audio channel, and said third audio channel is based on the relative positions of the endpoints at said first teleconference location and the relative positions of the endpoints at said second teleconference location coinciding with each other;
receiving v) a ninth audio signal from said fifth endpoint; and
transmitting v) a tenth audio signal to all endpoints that have been assigned to said third audio channel at said second teleconference location, wherein said tenth audio signal is based on said ninth audio signal.
7. The method of claim 6 further comprising:
transmitting, from said teleconference bridge, vi) an eleventh audio signal to said first endpoint;
receiving
vi) a twelfth audio signal from said second endpoint, and
vii) a thirteenth audio signal from said fifth endpoint; and
determining the relative positions of said first endpoint, said second endpoint, and said fifth endpoint, based on the amount of correlation of said twelfth audio signal with said eleventh audio signal and on the amount of correlation of said thirteenth audio signal with said eleventh audio signal.
8. A method comprising:
determining, at a teleconference bridge, the presence of
i) M 1 endpoints that each comprise a microphone, at a first teleconference location, M 1 being a integer greater than one, and
ii) N 2 endpoints that each comprise a loudspeaker, at a second teleconference location, N 2 being a integer greater than one,
wherein said teleconference bridge is able to receive audio signals from each of said M 1 endpoints and is able to transmit audio signals to each of said N 2 endpoints, and wherein said first teleconference location and said second teleconference location are acoustically isolated from each other;
assigning
i) a first nonempty subset of said M 1 endpoints and a second nonempty subset of said N 2 endpoints to a first audio channel, and
ii) a third nonempty subset of said M 1 endpoints and a fourth nonempty subset of said N 2 endpoints to a second audio channel,
wherein said first subset and said third subset are non-intersecting, and wherein said second subset and said fourth subset are non-intersecting;
receiving
i) a first audio signal from a first endpoint in said first subset, and
ii) a second audio signal from said second endpoint in said third subset; and
transmitting
i) a third audio signal to all endpoints in said second subset, wherein said third audio signal is based on said first audio signal, and
ii) a fourth audio signal to all endpoints in said fourth subset, wherein said fourth audio signal is based on said second audio signal.
9. The method of claim 8 further comprising:
determining, at a teleconference bridge, the presence of
iii) M 2 endpoints that each comprise a microphone, at said second teleconference location, M 2 being a integer greater than one, and
iv) N 1 endpoints that each comprise a loudspeaker, at said first teleconference location, N 1 being a integer greater than one,
wherein said teleconference bridge is able to receive audio signals from each of said M 2 endpoints and is able to transmit audio signals to each of said N 1 endpoints;
assigning
iii) a fifth nonempty subset of said M 2 endpoints and a sixth nonempty subset of said N 1 endpoints to said first audio channel, and
iv) a seventh nonempty subset of said M 2 endpoints and an eighth nonempty subset of said N 1 endpoints to said second audio channel,
wherein said fifth subset and said seventh subset are non-intersecting, and wherein said sixth subset and said eighth subset are non-intersecting;
receiving
iii) a fifth audio signal from a third endpoint in said fifth subset, and
iv) a sixth audio signal from a fourth endpoint in said seventh subset; and transmitting
iii) a seventh audio signal to all endpoints in said sixth subset, wherein said seventh audio signal is based on said fifth audio signal, and
iv) an eighth audio signal to all endpoints in said eighth subset, wherein said eighth audio signal is based on said sixth audio signal.
10. The method of claim 9 wherein M 1 is greater than N 2 .
11. The method of claim 9 wherein M 1 is less than N 2 .
12. The method of claim 9 wherein M 1 is greater than N 1 .
13. The method of claim 9 wherein M 1 is less than N 1 .
14. The method of claim 9 further comprising:
assigning v) a ninth nonempty subset of said M 1 endpoints to a third audio channel, wherein said first subset, said third subset, and said ninth subset are non-intersecting; and
receiving v) a ninth audio signal from a fifth endpoint in said ninth subset;
wherein said third audio signal and said fourth audio signal are also based on said ninth audio signal.
15. The method of claim 9 further comprising:
assigning v) a ninth nonempty subset of said N 2 endpoints to a third audio channel, wherein said second subset, said fourth subset, and said ninth subset are non-intersecting; and
transmitting v) a ninth audio signal to a fifth endpoint in said ninth subset;
wherein said ninth audio signal is based on said first audio signal and said second audio signal.
16. The method of claim 9 further comprising:
assigning v) a ninth, non-empty subset of said M 1 endpoints and a tenth, non-empty subset of said N 2 endpoints to a third audio channel, wherein said first subset, said third subset, and said ninth subset are non-intersecting and said second subset, said fourth subset, and said tenth subset are non-intersecting, and wherein the assigning of said ninth subset and said tenth subset to said third audio channel is based on the relative positions of the endpoints at said first teleconference location and the relative positions of the endpoints at said second teleconference location coinciding with each other;
receiving v) a ninth audio signal from a fifth endpoint in said ninth subset; and
transmitting v) a tenth audio signal to a sixth endpoint in said tenth subset;
wherein said tenth audio signal is based on said ninth audio signal.
17. The method of claim 16 further comprising:
transmitting, from said teleconference bridge, vi) an eleventh audio signal to said first endpoint;
receiving
vi) a twelfth audio signal from said second endpoint, and
vii) a thirteenth audio signal from said fifth endpoint; and
determining the relative positions of said first endpoint, said second endpoint, and said fifth endpoint, based on the amount of correlation of said twelfth audio signal with said eleventh audio signal and on the amount of correlation of said thirteenth audio signal with said eleventh audio signal.
18. A method comprising:
determining, at a teleconference bridge, the presence of
i) M 1 endpoints that each comprise a microphone, at a first teleconference location, M 1 being a integer greater than one,
ii) N 2 endpoints that each comprise a loudspeaker, at a second teleconference location, N 2 being a integer greater than one,
iii) M 2 endpoints that each comprise a microphone, at said second teleconference location, M 2 being a integer greater than one, and
iv) N 1 endpoints that each comprise a loudspeaker, at said first teleconference location, N 1 being a integer greater than one,
wherein said teleconference bridge is able to receive audio signals from each of said M 1 endpoints and said M 2 endpoints and is able to transmit audio signals to each of said N 2 endpoints and said N 1 endpoints, and wherein said first teleconference location and said second teleconference location are acoustically isolated from each other;
transmitting, from said teleconference bridge,
i) a first audio signal to a first endpoint of said N 2 endpoints, and
ii) a second audio signal to a second endpoint of said N 1 endpoints;
receiving
i) a third audio signal from a third endpoint of said M 2 endpoints,
ii) a fourth audio signal from a fourth endpoint of said M 2 endpoints,
iii) a fifth audio signal from a fifth endpoint of said M 1 endpoints, and
iv) a sixth audio signal from a sixth endpoint of said M 1 endpoints; and
determining
i) the relative positions of said first endpoint, said third endpoint, and said fourth endpoint with respect to one other, based on the amount of correlation of said third audio signal with said first audio signal and on the amount of correlation of said fourth audio signal with said first audio signal, and
ii) the relative positions of said second endpoint, said fifth endpoint, and said sixth endpoint with respect to one another, based on the amount of correlation of said fifth audio signal with said second audio signal and on the amount of correlation of said sixth audio signal with said second audio signal.
19. The method of claim 18 further comprising:
assigning
i) a first nonempty subset of said M 1 endpoints, a second nonempty subset of said N 2 endpoints, a third nonempty subset of said M 2 endpoints, and a fourth nonempty subset of said N 1 endpoints to a first audio channel, and
ii) a fifth nonempty subset of said M 1 endpoints, a sixth nonempty subset of said N 2 endpoints, a seventh nonempty subset of said M 2 endpoints, and an eighth nonempty subset of said N 1 endpoints to a second audio channel,
wherein said first subset and said fifth subset are non-intersecting, and wherein said second subset and said sixth subset are non-intersecting.
20. The method of claim 19 further comprising:
receiving
v) a seventh audio signal from said fifth endpoint in said first subset, and
vi) a eighth audio signal from said sixth endpoint in said fifth subset; and
transmitting
iii) a ninth audio signal to all endpoints in said second subset, wherein said ninth audio signal is based on said seventh audio signal, and
iv) a tenth audio signal to all endpoints in said sixth subset, wherein said tenth audio signal is based on said eighth audio signal.
21. The method of claim 20 wherein M 1 is greater than N 2 .
22. The method of claim 20 wherein M 1 is less than N 2 .
23. The method of claim 20 wherein M 1 is greater than N 1 .
24. The method of claim 20 wherein M 1 is less than N 1 .
25. The method of claim 20 further comprising:
assigning iii) a ninth nonempty subset of said M 1 endpoints to a third audio channel, wherein said first subset, said fifth subset, and said ninth subset are non-intersecting; and
receiving v) a eleventh audio signal from a seventh endpoint in said ninth subset;
wherein said ninth audio signal and said tenth audio signal are also based on said eleventh audio signal.
26. The method of claim 20 further comprising:
assigning iii) a ninth nonempty subset of said N 2 endpoints to a third audio channel, wherein said second subset, said sixth subset, and said ninth subset are non-intersecting; and
transmitting v) a eleventh audio signal to a seventh endpoint in said ninth subset;
wherein said eleventh audio signal is based on said seventh audio signal and said eighth audio signal.
27. The method of claim 20 further comprising:
assigning iii) a ninth nonempty subset of said M 1 endpoints and a tenth nonempty subset of said N 2 endpoints to a third audio channel, wherein said first subset, said fifth subset, and said ninth subset are non-intersecting and said second subset, said sixth subset, and said tenth subset are non-intersecting;
receiving v) a twelfth audio signal from a seventh endpoint in said ninth subset; and
transmitting v) a thirteenth audio signal to an eighth endpoint in said tenth subset, wherein said thirteenth audio signal is based on said twelfth audio signal; and
wherein the assigning of said ninth subset and said tenth subset to said third audio channel is based on the relative positions of said fifth endpoint and said seventh endpoint coinciding with the relative positions of said first endpoint and said eighth endpoint.