IP Library Granted Patent US 9,131,041
Granted Patent B2
US 9,131,041 · App. 13/656,298 · Granted Sep 8, 2015

Using an auxiliary device sensor to facilitate disambiguation of detected acoustic environment changes

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,131,041
App. No.
13/656,298
Granted
Sep 8, 2015
Kind
B2
Abstract

Audio input may be received at one or more microphones of a mobile device. Based on the audio input, a change in an acoustic environment of the device, such as a change in a direction of arrival of the audio input or a degradation in a quality of acoustic echo cancellation being performed upon the audio input, may be detected. A determination may be made that the detected change coincides with a non-acoustic physical event detected using an auxiliary sensor at the mobile device. The event may for example be device motion, a new proximate object, a change in a proximity of an object, a new heat source or a change in a heat level from a known heat source. Based on the determining, a signal processor, possibly comprising an audio beamformer or echo canceller, may be recalibrated, e.g. the audio beamformer or echo canceller may be caused to reconverge.

Claims (36)

1. A method of steering an audio beamformer of a mobile device, the method comprising:

based on audio input received at a microphone array of the mobile device, detecting a change in a direction of arrival of the audio input at a first time;

detecting a non-acoustic physical event at a second time using an auxiliary sensor at the mobile device;

determining that the first time of the change in the direction of arrival of the audio input coincides with the second time of the non-acoustic physical event; and

in response to determining that the change in the direction coincides with the non-acoustic physical event, steering the audio beamformer in a changed direction of arrival of the audio input.

2. The method of claim 1 wherein the auxiliary sensor is a motion sensor and wherein the non-acoustic physical event is a motion of the mobile device and wherein steering the audio beamformer in the changed direction comprises causing the audio beamformer to recoverge;

the method further comprising comparing the changed direction to the determined motion of the mobile device to corroborate the changed direction.

3. The method of claim 1 wherein the auxiliary sensor is a proximity sensor and wherein the non-acoustic physical event is a change in a proximity of an object.

4. The method of claim 1 wherein the auxiliary sensor is a heat sensor and wherein the non-acoustic physical event is a change in an amount of heat emitted by a heat source.

5. A method of performing acoustic echo cancellation at a mobile device, the method comprising:

detecting at a first time a degradation in a quality of acoustic echo cancellation being performed by an acoustic echo canceller upon audio input received at a microphone of the mobile device;

detecting a non-acoustic physical event at a second time using an auxiliary sensor at the mobile device;

determining that the first time of the degradation in the quality of the acoustic echo cancellation coincides with the second time of the non-acoustic physical event;

in response to determining that the degradation in the quality of the acoustic echo cancellation coincides with a non-acoustic physical event, causing the acoustic echo canceller to reconverge.

6. The method of claim 5 wherein the detecting of the degradation in the quality of acoustic echo cancellation comprises determining that an Echo Return Loss Enhancement (ERLE) measure has dropped below a threshold value.

7. The method of claim 5 wherein the auxiliary sensor is a motion sensor and wherein the non-acoustic physical event is a motion of the mobile device.

8. The method of claim 5 wherein the auxiliary sensor is a proximity sensor and wherein the non-acoustic physical event is a newly detected proximate object or a detected change in a proximity of an object.

9. The method of claim 5 wherein the auxiliary sensor is a heat sensor and wherein the non-acoustic physical event is a newly detected heat source or a detected change in an amount of heat emitted by a heat source.

10. A mobile device comprising a microphone array, an audio beamformer and an auxiliary sensor, the mobile device being operable to:

based on audio input received at the microphone array, detect a change in a direction of arrival of the audio input at a first time;

detect a non-acoustic physical event at a second time using an auxiliary sensor at the mobile device;

determine that the first time of the detected change in the direction of arrival of the audio input coincides with the first time of the non-acoustic physical event; and

in response to determining that the change in the direction coincides with the non-acoustic physical event, steer the audio beamformer in a changed direction of arrival of the audio input.

11. The mobile device of claim 10 wherein the auxiliary sensor is a motion sensor and wherein the non-acoustic physical event is a motion of the mobile device and wherein steering the audio beamformer in the changed direction comprises causing the audio beamformer to recoverge;

the mobile device being further operable to compare the changed direction to the determined motion of the mobile device to corroborate the changed direction.

12. The mobile device of claim 10 wherein the auxiliary sensor is a proximity sensor and wherein the non-acoustic physical event is a change in a proximity of an object.

13. The mobile device of claim 10 wherein the auxiliary sensor is a heat sensor and wherein the non-acoustic physical event is a change in an amount of heat emitted by a heat source.

14. A mobile device comprising a microphone, an acoustic echo canceller and an auxiliary sensor, the mobile device being operable to:

detect at a first time a degradation in a quality of acoustic echo cancellation being performed by the acoustic echo canceller upon audio input received at the microphone;

detect a non-acoustic physical event at a second time using an auxiliary sensor at the mobile device;

determine that the first time of the degradation in the quality of the acoustic echo cancellation coincides with the second time of the non-acoustic physical event; and

based on the determining, cause the acoustic echo canceller to reconverge.

15. The mobile device of claim 14 wherein the detecting of the degradation in the quality of acoustic echo cancellation comprises determining that an Echo Return Loss Enhancement (ERLE) measure has dropped below a threshold value.

16. The mobile device of claim 14 wherein the auxiliary sensor is a motion sensor and wherein the non-acoustic physical event is a motion of the mobile device.

17. The mobile device of claim 14 wherein the auxiliary sensor is a proximity sensor and wherein the non-acoustic physical event is a newly detected proximate object or a detected change in a proximity of an object.

18. The mobile device of claim 14 wherein the auxiliary sensor is a heat sensor and wherein the non-acoustic physical event is a newly detected heat source or a change in an amount of heat emitted by a heat source.

Assignments (6)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064271/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
CHANGE OF NAME Recorded Oct 16, 2014
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 034012/0111 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2013
From: LASKA, BRADY NICHOLAS; FORRESTER, CHRIS; ANGRIGNON, SYLVAIN; TETELBAUM, MICHAEL; GORDY, JAMES DAVID
To: RESEARCH IN MOTION LIMITED
Reel/Frame 029585/0799 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2012
From: RESEARCH IN MOTION CORPORATION
To: RESEARCH IN MOTION LIMITED
Reel/Frame 029503/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2012
From: GUPTA, MALAY
To: RESEARCH IN MOTION CORPORATION
Reel/Frame 029401/0523 →