IP Library › Granted Patent US 11,432,067
Granted Patent B2
US 11,432,067 · App. 17/207,988 · Granted Aug 30, 2022

Cancelling noise in an open ear system

Inventors: Yonatan Wexler (Jerusalem, IL); Amnon Shashua (Mevaseret Zion, IL)
Assignee: OrCam Technologies Ltd.
H04R1/326G10L21/003G10L21/02H04R1/028H04R3/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,432,067
App. No.
17/207,988
Granted
Aug 30, 2022
Kind
B2
Abstract

System and methods for selectively amplifying audio signals are disclosed. In one implementation, a method includes receiving at least one image of a plurality of images captured by a wearable camera; receiving a first audio signal representative of the sounds captured by a microphone; determining a looking direction of a user; and processing the first audio signal by amplifying audio coming from the looking direction of the user and attenuating audio coming from at least one other direction; receiving a second audio signal representative of the sounds captured by a hearing interface device; transmitting the second audio signal to a speaker associated with the hearing interface device; transmitting an additional audio signal to the speaker, wherein the transmission of the additional audio signal at least partially overlaps the transmission of the second audio signal; and transmitting the processed first audio signal to the speaker.

Claims (73)

1. A system for selectively amplifying audio signals, the system comprising:

a microphone configured to capture sounds from an environment of a user;

a wearable camera configured to capture a plurality of images from the environment of the user;

a hearing interface device; and

at least one processor programmed to:

receive at least one image of the plurality of images;

receive a first audio signal representative of the sounds captured by the microphone;

determine, based on the at least one image, a looking direction of the user;

process the first audio signal to amplify audio coming from the looking direction of the user and attenuate audio coming from at least one other direction; and

transmit the processed first audio signal to the hearing interface device, wherein the hearing interface device includes a speaker, and wherein the hearing interface device is configured to:

receive a second audio signal;

transmit the second audio signal to the speaker;

transmit an additional audio signal to the speaker, wherein the transmission of the additional audio signal at least partially overlaps the transmission of the second audio signal; and

transmit the processed first audio signal to the speaker.

2. The system of claim 1 , wherein the additional audio signal includes at least one echo of the second audio signal.

3. The system of claim 1 , wherein the hearing interface device receives the additional audio signal from the at least one processor.

4. The system of claim 2 , wherein the hearing interface device is further configured to transmit the at least one echo to the speaker after a predetermined time delay.

5. The system of claim 1 , wherein the additional audio signal includes a stationary noise signal.

6. The system of claim 1 , wherein the additional audio signal has an amplitude lower than an amplitude of the second signal.

7. The system of claim 1 , wherein the hearing interface device is further configured to transmit the additional audio signal by:

transmitting a first echo to the speaker after a first time delay; and

transmitting a second echo to the speaker after a second time delay greater than the first time delay.

8. The system of claim 1 , wherein the hearing interface device is further configured to generate the at least one additional audio signal by:

identifying a portion of the second audio signal during a predetermined time window; and

repeating the identified portion after a predetermined time delay for a predetermined period of time.

9. The system of claim 1 , wherein the at least one processor is further programmed to generate the at least one additional audio signal by:

identifying a portion of the second audio signal during a predetermined time window; and

repeating the identified portion after a predetermined time delay for a predetermined period of time.

10. The system of claim 1 , wherein the processor is further programmed to:

identify, based on the at least one image and the looking direction of the user, an individual in the environment of the user;

determine whether the individual is an active speaker;

transmit an echo-on signal to the hearing interface device when the individual is an active speaker; and

transmit an echo-off signal to the hearing interface device when the individual is not the active speaker.

11. The system of claim 1 , wherein the hearing interface device is further configured to:

transmit the additional audio signal to the speaker in response to receiving the echo-on signal; and

cease transmitting the additional audio signal in response to receiving the echo-off signal.

12. The system of claim 1 , wherein the processor is further programmed to store the first audio signal in a buffer.

13. The system of claim 1 , wherein the hearing interface device includes an open ear type hearing interface device.

14. A method for selectively amplifying audio signals, the method comprising:

receiving at least one image of a plurality of images captured by a wearable camera;

receiving a first audio signal representative of the sounds captured by a microphone;

determining, based on the at least one image, a looking direction of a user; and

processing the first audio signal by amplifying audio coming from the looking direction of the user and attenuating audio coming from at least one other direction;

receiving a second audio signal representative of the sounds captured by a hearing interface device;

transmitting the second audio signal to a speaker associated with the hearing interface device;

transmitting an additional audio signal to the speaker, wherein the transmission of the additional audio signal at least partially overlaps the transmission of the second audio signal; and

transmitting the processed first audio signal to the speaker.

15. The method of claim 14 , wherein transmitting the additional audio signal includes transmitting at least one echo of the second audio signal.

16. The method of claim 15 , wherein transmitting the additional audio signal includes transmitting the at least one echo to the speaker after a predetermined time delay.

17. The method of claim 14 , wherein transmitting the additional audio signal includes transmitting a stationary noise signal.

18. The method of claim 14 , wherein the additional audio signal has an amplitude lower than an amplitude of the second signal.

19. The method of claim 14 , wherein transmitting the additional audio signal comprises:

transmitting a first echo of the second audio signal after a first time delay; and

transmitting a second echo of the second audio signal after a second time delay greater than the first time delay.

20. The method of claim 14 , wherein transmitting the additional audio signal comprises:

identifying a portion of the second audio signal during a predetermined time window; and

repeating the identified portion after a predetermined time delay for a predetermined period of time.

21. The method of claim 14 , further comprising:

identifying, based on the at least one image and the looking direction of the user, an individual in the environment of the user;

determining whether the individual is an active speaker;

transmitting an echo-on signal to the hearing interface device when the individual is an active speaker; and

transmitting an echo-off signal to the hearing interface device when the individual is not the active speaker.

22. A non-transitory computer-readable medium including instructions which when executed by at least one processor perform a method, the method comprising:

receiving at least one image of a plurality of images captured by a wearable camera;

receiving a first audio signal representative of the sounds captured by a microphone;

determining, based on the at least one image, a looking direction of a user; and

processing the first audio signal by amplifying audio coming from the looking direction of the user and attenuating audio coming from at least one other direction; and

receiving a second audio signal representative of the sounds captured by a hearing interface device;

transmitting the second audio signal to a speaker associated with the hearing interface device;

transmitting an additional audio signal to the speaker, wherein the transmission of the additional audio signal at least partially overlaps the transmission of the second audio signal; and

transmitting the processed first audio signal to the speaker.

23. The system of claim 1 , wherein the at least one processor is included in the hearing interface device, co-located with the hearing interface device, or located remotely from the hearing interface device.

24. The system of claim 1 , wherein the at least one processor includes a first processor disposed in the hearing interface device and a second processor located remotely from the hearing interface device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2021
From: WEXLER, YONATAN; SHASHUA, AMNON
To: ORCAM TECHNOLOGIES LTD.
Reel/Frame 055797/0334 →
Continuity (2)
Provisional Application 62993116 · Mar 23, 2020
Related Publication 20210297770A1 · Sep 23, 2021