IP Library Granted Patent US 10,362,385
Granted Patent B1
US 10,362,385 · App. 15/912,516 · Granted Jul 23, 2019

Controlling perceived ambient sounds based on focus level

Inventors: Davide Di Censo (Sunnyvale, CA); Adam Boulanger (Palo Alto, CA); Joseph Verbeke (San Francisco, CA); Stefan Marti (Oakland, CA)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
H04R1/1083H04R1/1091H04R5/02H04R2420/01H04R2460/01H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,362,385
App. No.
15/912,516
Granted
Jul 23, 2019
Kind
B1
Abstract

In one embodiment, a focus application controls ambient sounds perceived by a user. In operation, the focus application determines a focus level associated with the user based on a biometric signal associated with the user. The focus application then determines an ambient awareness level based on the focus level. Subsequently, the focus application modifies at least one characteristic of an ambient sound perceived by the user based on the ambient awareness level.

Claims (44)

1. A method for controlling ambient sounds perceived by a user, the method comprising:

determining a focus level based a biometric signal associated with the user;

determining an ambient awareness level based on the focus level; and

modifying at least one characteristic of an ambient sound perceived by the user based on the ambient awareness level.

2. The method of claim 1 , wherein modifying at least one characteristic of the ambient sound perceived by the user comprises:

generating an ambient adjustment signal based on the ambient awareness level and an audio input signal received from a microphone in response to the ambient sound; and

generating a speaker signal based on the ambient adjustment signal.

3. The method of claim 2 , wherein generating the ambient adjustment signal comprises at least one of canceling, replicating, filtering, reducing, and augmenting the audio input signal based on the ambient awareness level.

4. The method of claim 3 , wherein canceling the ambient adjustment signal comprises generating an inverse version of the audio input signal.

5. The method of claim 1 , wherein determining the ambient awareness level comprises:

comparing the focus level to a threshold level; and

if the focus level exceeds the threshold level, then setting the ambient awareness level equal to a first value, or

if the focus level does not exceed the threshold level, then setting the ambient awareness level equal to a second value.

6. The method of claim 5 , further comprising, determining the threshold level based on at least one of a location of the user, a configurable parameter, and crowdsourced data.

7. The method of claim 1 , wherein determining the ambient awareness level comprises applying a mapping to the focus level, wherein the mapping specifies an inversely proportional relationship between the ambient awareness level and the focus level or a directly proportional relationship between the ambient awareness level and the focus level.

8. The method of claim 1 , further comprising receiving the biometric signal from an electroencephalography sensor, a heart rate sensor, a functional near-infrared spectroscopy sensor, a galvanic skin response sensor, an acceleration sensor, or an eye gaze sensor.

9. The method of claim 1 , wherein the speaker is mounted inside a vehicle or is included in a pair of headphones.

10. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to control ambient sounds perceived by a user by performing the steps of:

determining a focus level based a first biometric signal associated with the user;

determining an ambient awareness level based on the focus level; and

performing a passive noise cancellation operation, an active noise cancellation operation, or an acoustic transparency operation based on the ambient awareness level.

11. The one or more computer-readable storage media of claim 10 , wherein performing the passive noise cancellation operation, the active noise cancellation operation, or the acoustic transparency operation comprises:

generating an ambient adjustment signal based on the ambient awareness level and an audio input signal received from a microphone in response to the ambient sound; and

generating a speaker signal based on the ambient adjustment signal.

12. The one or more computer-readable storage media of claim 11 , wherein generating the ambient adjustment signal comprises at least one of canceling, replicating, filtering, reducing, and augmenting the audio input signal based on the ambient awareness level.

13. The one or more computer-readable storage media of claim 10 , wherein determining the ambient awareness level comprises:

comparing the focus level to a threshold level; and

if the focus level exceeds the threshold level, then setting the ambient awareness level equal to a first value, or

if the focus level does not exceed the threshold level, then setting the ambient awareness level equal to a second value.

14. The one or more computer-readable storage media of claim 13 , further comprising, determining the threshold level based on at least one of a location of the user, a configurable parameter, and crowdsourced data.

15. The one or more computer-readable storage media of claim 10 , wherein determining the ambient awareness level comprises applying a mapping to the focus level, wherein the mapping specifies an inversely proportional relationship between the ambient awareness level and the focus level or a directly proportional relationship between the ambient awareness level and the focus level.

16. The one or more computer-readable storage media of claim 10 , wherein the first biometric signal specifies neural activity associated with the user.

17. The one or more computer-readable storage media of claim 10 , wherein determining the focus level comprises:

estimating a task focus based on the first biometric signal, wherein the first biometric signal is received from a first sensor;

estimating a task demand based on a second biometric signal received from a second sensor; and

computing the focus level based on the task focus and the task demand.

18. The one or more computer-readable storage media of claim 10 , wherein determining the focus level comprises determining that the user is thinking of a trigger word based on the first biometric signal, and setting the focus level based on the trigger word.

19. A system for controlling ambient sounds perceived by a user, the system comprising:

a memory storing instructions; and

a processor that is coupled to the memory and, when executing the instructions, is configured to:

determine a focus level based on a biometric signal associated with the user;

generate an ambient adjustment signal based on the focus level and an audio input signal associated with an ambient sound; and

control a speaker associated with the user based on the ambient adjustment signal.

20. The system of claim 19 , wherein the user is a first occupant of a vehicle, and the audio input signal is received by at least one of a first microphone located on the exterior of the vehicle and a second microphone associated with a second occupant of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2018
From: DI CENSO, DAVIDE; BOULANGER, ADAM; VERBEKE, JOSEPH; MARTI, STEFAN
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 046870/0852 →
Cited By (4)
US 12,223,940 US 12,248,730 US 12,604,147 US 12,643,448