IP Library Granted Patent US 11,915,705
Granted Patent B2
US 11,915,705 · App. 18/181,805 · Granted Feb 27, 2024

Facial movements wake up wearable

Inventors: Aviad Maizels (Ramat Hasharon, IL); Avi Barliya (Tel Aviv, IL); Yonatan Wexler (Jerusalem, IL)
Assignee: Q (Cue) Ltd.
G10L15/26G02B27/0093G06F40/58G06V10/141G06V10/60G06V10/82G06V40/171G06V40/174G06V40/176G10L13/02G10L13/027G10L13/04G10L15/16G10L15/25G06F3/015
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,915,705
App. No.
18/181,805
Granted
Feb 27, 2024
Kind
B2
Abstract

Wearable coherent light sensing systems and methods are disclosed. In one implementation, a system may include a wearable coherent light source configured to direct light towards a facial area; a wearable sensor configured to receive light source reflections and to output associated reflection signals; and a processor operable in an idle mode and in a high power mode. In the idle mode, the processor is configured to receive the reflection signals, process the reflection signals to identify trigger in the reflection signals, and automatically switch to the high power mode upon identification of the trigger. In the high power mode, the processor is configured to analyze the reflection signals to identify facial movements associated with silent speech. Following the identification of the facial movements associated with the silent speech, the processor is configured to decipher the facial movements and generate an output associated with the silent speech.

Claims (34)

1. A wearable coherent light sensing system, comprising:

at least one wearable coherent light source configured to direct light towards a portion of a cheek of a user;

at least one wearable sensor configured to receive light source reflections from the portion of the cheek and to output associated reflection signals;

at least one processor operable in an idle mode and in a high power mode;

wherein in the idle mode, the at least one processor is configured to receive the reflection signals from the at least one sensor, process the reflection signals to identify from reflection signals associated at least one movement in the portion of the cheek at least one trigger, and

automatically switch to the high power mode upon identification of the at least one trigger;

wherein in the high power mode, the at least one processor is configured to analyze the reflection signals from the portion of the cheek to identify facial movements associated with silent speech; and

wherein following the identification of the facial movements associated with the silent speech, the at least one processor is configured to decipher the facial movements in the portion of the cheek and generate an output associated with the silent speech.

2. The wearable coherent light sensing system of claim 1 , wherein the facial movements associated with silent speech include minute movements manifest in cheek skin of the portion of the cheek, and wherein the at least one processor is configured to generate the output associated with the silent speech by deciphering the movements manifest in the cheek skin.

3. The wearable coherent light sensing system of claim 1 , wherein the facial movements associated with silent speech include minute facial movements and wherein the at least one processor is configured to generate the output associated with the silent speech by deciphering the minute facial movements using speckle analysis.

4. The wearable coherent light sensing system of claim 1 , wherein the output includes non-vocalized words.

5. The wearable coherent light sensing system of claim 1 , wherein the output includes audio.

6. The wearable coherent light sensing system of claim 1 , wherein the output includes words subsequently vocalized following the silent speech.

7. The wearable coherent light sensing system of claim 1 , wherein a frame rate in the idle mode is lower than a frame rate in the high power mode.

8. The wearable coherent light sensing system of claim 7 , wherein the frame rate of the high power mode is between 100 to 200 frames per second.

9. The wearable coherent light sensing system of claim 1 , wherein while operating in the idle mode, the at least one processor is further configured to receive user input from a controller and to switch to the high power mode based on the received user input.

10. The wearable coherent light sensing system of claim 9 , wherein the controller includes a proximity sensor.

11. The wearable coherent light sensing system of claim 9 , wherein the controller includes a push button.

12. The wearable coherent light sensing system of claim 1 , wherein the at least one processor is further configured to determine a sequence of words from the identified deciphered facial movements.

13. The wearable coherent light sensing system of claim 12 , wherein determining the sequence of words involves using a neural network associated with personal training data.

14. The wearable coherent light sensing system of claim 1 , wherein the coherent light source and the at least one sensor are configured to be supported by an ear of the user.

15. The wearable coherent light sensing system of claim 14 , wherein the at least one coherent light source is configured, when supported by the ear, to illuminate the portion of the cheek of the user.

16. The wearable sensing system of claim 14 , wherein the at least one coherent light source is configured to direct a plurality of beams of coherent light toward different locations on the portion of the cheek resulting in an array of spots of at least 1 cm 2.

17. The wearable sensing system of claim 16 , wherein the at least one sensor is configured to assume, when supported by the ear, a distance of at least 5 mm from the portion of the cheek a skin surface.

18. A method for deciphering silent speech, the method comprising:

directing coherent light toward a portion of a cheek of a user;

receiving from at least one sensor, reflections of the coherent light from the portion of the cheek;

in an idle power mode, processing signals associated with the reflections to identify from reflection signals associated at least one movement in the portion of the cheek at least one trigger;

automatically switching to a high power mode upon identification of the at least one trigger, wherein in the high power mode a frame rate is higher than in the idle mode;

in the high power mode, analyzing the reflection signals from the portion of the cheek at the higher frame rate to identify facial movements associated with silent speech; and

deciphering the facial movements in the portion of the cheek to generate an output associated with the silent speech.

19. The method of claim 18 , wherein the reflections result from minute facial movements in cheek skin, and wherein deciphering includes extracting meaning from the movements in the cheek skin.

20. The method of claim 18 , wherein the reflections result from minute facial movements, and wherein deciphering includes using speckle analysis to extract meaning from the facial movements.

21. The method of claim 18 , wherein the at least one trigger is indicative of an intent of speech by the user even before such speech ever occurred.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2026
From: Q (CUE) LTD.
To: APPLE INC.
Reel/Frame 075350/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2026
From: Q (CUE) LTD.,
To: APPLE INC.
Reel/Frame 075504/0286 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2023
From: MAIZELS, AVIAD; BARLIYA, AVI; WEXLER, YONATAN
To: Q (CUE) LTD.
Reel/Frame 063091/0087 →
Continuity (4)
Continuation PCTIB2022056418 · Jul 12, 2022
Continuation In Part PCTUS2022054527 · May 16, 2022
Provisional Application 63229091 · Aug 4, 2021
Related Publication 20230230594A1 · Jul 20, 2023