IP Library Granted Patent US 11,127,413
Granted Patent B2
US 11,127,413 · App. 16/505,763 · Granted Sep 21, 2021

Audio alert audibility estimation method and system

Inventors: Sam Karimian Azari (Burnaby, CA); Mark Robert Every (Surrey, CA)
Assignee: BlackBerry Limited
G10L21/0224B60Q5/005G10L2021/02087G10L2021/02163
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,127,413
App. No.
16/505,763
Granted
Sep 21, 2021
Kind
B2
Abstract

A method and system of estimating human perception of audibility of audio alerts in the presence of background noise. In the audibility estimation system, a microphone generates an input signal corresponding to an audio alert. A processor receives the input signal and generates an audibility metric representing human perception of audibility of the audio alert based on a comparison between a background noise estimate and an audio alert estimate, and causes an action to be taken based on the audibility metric.

Claims (35)

1. A method of estimating human perception of the audibility of an audio alert in the presence of a background noise, the method comprising:

in an alert audibility estimation system,

obtaining an input signal from a microphone,

obtaining, from an audio alert generation system for generating the audio alert, a real-time stream including a reference signal corresponding to the audio alert as the audio alert is being generated by the audio alert generation system,

obtaining from the input signal, using the reference signal, a background noise estimate and audio alert estimate represented at the microphone,

calculating an audibility metric representing human perception of audibility of the audio alert based on a comparison between the background noise estimate and the audio alert estimate, the comparison including a short-time cross correlation and a frequency-weighting that correlates with human perception of relative loudness; and

taking an action based on the audibility metric.

2. The method of claim 1 , wherein the comparison is based on a signal-to-noise ratio of the audio alert estimate to the background noise estimate.

3. The method of claim 1 , wherein obtaining the background noise estimate is based on adaptively filtering the audio alert from the input signal using the reference signal.

4. The method of claim 1 , wherein obtaining the background noise estimate is based on a comparison between an acoustic power of the input signal when the audio alert is active and an acoustic power of the input signal when the audio alert is inactive.

5. The method of claim 1 , wherein taking an action based on the audibility metric comprises playing the audio alert louder.

6. The method of claim 1 , wherein taking an action based on the audibility metric comprises modifying one or more properties of the audio alert and repeating playback.

7. The method of claim 1 , wherein taking an action based on the audibility metric comprises providing visual or haptic feedback to a human.

8. The method of claim 1 , wherein the audio alert generation system includes a speaker and wherein receiving the real-time stream as the audio alert is being generated by the audio alert generation system includes receiving the real-time stream as the audio alert is being output by the speaker.

9. The method of claim 1 , wherein the audio alert estimate is determined by suppressing noise in the audio alert input signal received from the microphone.

10. An alert audibility estimation system for estimating human perception of the audibility of an audio alert in the presence of a background noise, the system comprising:

a processor;

a microphone for generating an input signal corresponding to the audio alert and the background noise; and

a memory storing processor executable instructions that, when executed by the processor, cause the processor to:

receive an audio input signal from a microphone;

receive, from an audio alert generation system for generating the audio alert, a real-time stream including a reference signal corresponding to the audio alert as the audio alert is being generated by the audio alert generation system;

obtain from the audio input signal, using the reference signal, a background noise estimate and audio alert estimate represented at the microphone;

calculate an audibility metric representing human perception of the audibility of the audio alert based on a comparison between the background noise estimate and the audio alert estimate, the comparison including a short-time cross correlation and a frequency-weighting that correlates with human perception of relative loudness; and

cause an action to be taken based on the audibility metric.

11. The system of claim 10 , wherein the comparison is based on a signal-to-noise ratio of the audio alert estimate to the background noise estimate.

12. The system of claim 10 , wherein the process is further configured to obtain the background noise estimate based on adaptively filtering the audio alert from the input signal using the reference signal.

13. The system of claim 10 , wherein the processor is further configured to obtain the background noise estimate based on a comparison between an acoustic power of the input signal when the audio alert is active and an acoustic power of the input signal when the audio alert is inactive.

14. The system of claim 10 , wherein the action to be taken is to modify one or more properties of the audio alert and repeat playback.

15. The system of claim 10 , wherein the action to be taken is to provide visual or haptic feedback to a human.

16. A non-transitory computer-readable storage medium storing processor-executable instructions to estimate human perception of the audibility of an audio alert in the presence of a background noise, wherein the processor-executable instructions, when executed by a processor in an alert audibility estimation system, are to cause the processor to:

receive an audio input signal from a microphone;

obtain, from an audio alert generation system for generating the audio alert, a real-time stream including a reference signal corresponding to the audio alert as the audio alert is being generated by the audio alert generation system;

obtain from the audio input signal, using the reference signal, a background noise estimate and audio alert estimate represented at the microphone;

calculate an audibility metric representing human perception of the audibility of the audio alert based on a comparison between the background noise estimate and the audio alert estimate, the comparison including a short-time cross correlation and a frequency-weighting that correlates with human perception of relative loudness; and

cause an action to be taken based on the audibility metric.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: 2236008 ONTARIO INC.
To: BLACKBERRY LIMITED
Reel/Frame 052583/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2019
From: QNX SOFTWARE SYSTEMS LIMITED
To: 2236008 ONTARIO INC.
Reel/Frame 049887/0099 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2019
From: EVERY, MARK ROBERT
To: QNX SOFTWARE SYSTEMS LIMITED
Reel/Frame 049765/0260 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2019
From: KARIMIAN AZARI, SAM
To: BLACKBERRY LIMITED
Reel/Frame 049695/0320 →
Continuity (1)
Related Publication 20210012788A1 · Jan 14, 2021
Cited By (7)
US 12,192,737 US 12,267,655 US 12,289,085 US 12,294,342 US 12,316,293 US 12,562,266 US 12,700,497