Conferencing device with microphone beamforming and echo cancellation
This disclosure describes an apparatus and method of an embodiment of an invention that is a conferencing device that includes a microphone array that further comprises a plurality of microphones; a processor configured to execute the following steps: performing a beamforming operation to combine the plurality of microphones into a plurality of combined signals that is greater in number than one and less in number than the plurality of microphone signals, each of the plurality of combined signals corresponding to a different fixed beam; wherein performing the beamforming operation includes applying beamforming weights to the signals from each microphone to achieve a desired pickup pattern that includes a main lobe and sidelobes together with nulls for each fixed beam; performing an acoustic echo cancellation operation generate a plurality of combined echo cancelled signals; and selecting one or more of the combined echo cancelled signals for transmission to the far end.
1. A conferencing apparatus, comprising:
a microphone array that further comprises a plurality of microphones where each microphone is configured to sense acoustic waves and the plurality of microphones are oriented to develop a corresponding plurality of microphone signals;
a processor, memory, and storage operably coupled to the microphone array, the processor configured to execute the following steps:
performing a beamforming operation to combine the plurality of microphone signals from the microphone array into a plurality of combined signals that is greater in number than one and less in number than the plurality of microphone signals, each of the plurality of combined signals corresponding to a different fixed beam;
wherein performing the beamforming operation includes applying beamforming weights to the signals from each microphone to achieve a desired pickup pattern that includes a main lobe and sidelobes together with nulls for each fixed beam;
performing an acoustic echo cancellation operation on the plurality of combined signals to generate a plurality of combined echo cancelled signals; and
selecting one or more of the combined echo cancelled signals for transmission to the far end.
2. The claim of claim 1 where selecting one or more of the combined echo cancelled signals uses the far end signal as information to inhibit the selecting from changing the selection of the combined echo cancelled signals while only the far end signal is active.
3. The claim of claim 1 where one or more of either the main lobe width, the sidelobe levels, and/or the position of one more nulls can be controlled to attenuate noise in one particular direction while focusing the beamforming in other directions.
4. The claim of claim 1 that further includes performing a direction of arrival determination.
5. The claim of claim 1 where the processor is further configured to noise filter the plurality of combined echo cancelled signals.
6. A method to manufacture conferencing apparatus, comprising:
providing a microphone array that further comprises a plurality of microphones where each microphone is configured to sense acoustic waves and the plurality of microphones are oriented to develop a corresponding plurality of microphone signals;
operably coupling a processor, memory, and storage to the microphone array, the processor configured to execute the following steps:
performing a beamforming operation to combine the plurality of microphone signals from the microphone array into a plurality of combined signals that is greater in number than one and less in number than the plurality of microphone signals, each of the plurality of combined signals corresponding to a different fixed beam;
wherein performing the beamforming operation includes applying beamforming weights to the signals from each microphone to achieve a desired pickup pattern that includes a main lobe and sidelobes together with nulls for each fixed beam;
performing an acoustic echo cancellation operation on the plurality of combined signals to generate a plurality of combined echo cancelled signals; and
selecting one or more of the combined echo cancelled signals for transmission to the far end.
7. The claim of claim 6 where selecting one or more of the combined echo cancelled signals uses the far end signal as information to inhibit the selecting from changing the selection of the combined echo cancelled signals while only the far end signal is active.
8. The claim of claim 6 where one or more of either the main lobe width, the sidelobe levels, and/or the position of one more nulls can be controlled to attenuate noise in one particular direction while focusing the beamforming in other directions.
9. The claim of claim 6 that further includes performing a direction of arrival determination.
10. The claim of claim 6 where the processor is further configured to noise filter the plurality of combined echo cancelled signals.
11. A method performed by a conferencing apparatus, comprising:
sensing acoustic waves with a plurality of microphones configured as a microphone array, the plurality of microphones are oriented to develop a corresponding plurality of microphone signals;
providing a processor, memory, and storage operably coupled to the microphone array, the processor configured to execute the following steps:
performing a beamforming operation to combine the plurality of microphone signals from the microphone array into a plurality of combined signals that is greater in number than one and less in number than the plurality of microphone signals, each of the plurality of combined signals corresponding to a different fixed beam;
wherein performing the beamforming operation includes applying beamforming weights to the signals from each microphone to achieve a desired pickup pattern that includes a main lobe and sidelobes together with nulls for each fixed beam;
performing an acoustic echo cancellation operation on the plurality of combined signals to generate a plurality of combined echo cancelled signals; and
selecting one or more of the combined echo cancelled signals for transmission to the far end.
12. The claim of claim 11 where selecting one or more of the combined echo cancelled signals uses the far end signal as information to inhibit the selecting from changing the selection of the combined echo cancelled signals while only the far end signal is active.
13. The claim of claim 11 where one or more of either the main lobe width, the sidelobe levels, and/or the position of one more nulls can be controlled to attenuate noise in one particular direction while focusing the beamforming in other directions.
14. The claim of claim 11 that further includes performing a direction of arrival determination.
15. The claim of claim 11 where the processor is further configured to noise filter the plurality of combined echo cancelled signals.
16. A non-transitory program storage device readable by a computing device that tangibly embodies a program of instructions executable by the computing device to perform a method performed by a conferencing apparatus, comprising:
sensing acoustic waves with a plurality of microphones configured as a microphone array, the plurality of microphones are oriented to develop a corresponding plurality of microphone signals;
providing a processor, memory, and storage operably coupled to the microphone array, the processor configured to execute the following steps:
performing a beamforming operation to combine the plurality of microphone signals from the microphone array into a plurality of combined signals that is greater in number than one and less in number than the plurality of microphone signals, each of the plurality of combined signals corresponding to a different fixed beam;
wherein performing the beamforming operation incudes applying beamforming weights to the signals from each microphone to achieve a desired pickup pattern that includes a main lobe and sidelobes together with nulls for each fixed beam;
performing an acoustic echo cancellation operation on the plurality of combined signals to generate a plurality of combined echo cancelled signals; and
selecting one or more of the combined echo cancelled signals for transmission to the far end.
17. The claim of claim 16 where selecting one or more of the combined echo cancelled signals uses the far end signal as information to inhibit the selecting from changing the selection of the combined echo cancelled signals while only the far end signal is active.
18. The claim of claim 16 where one or more of either the main lobe width, the sidelobe levels, and/or the position of one more nulls can be controlled to attenuate noise in one particular direction while focusing the beamforming in other directions.
19. The claim of claim 16 that further includes performing a direction of arrival determination.
20. The claim of claim 16 where the processor is further configured to noise filter the plurality of combined echo cancelled signals.