IP Library Granted Patent US 12,142,282
Granted Patent B2
US 12,142,282 · App. 18/505,368 · Granted Nov 12, 2024

Interpreting words prior to vocalization

Inventors: Aviad Maizels (Ramat Hasharon, IL); Yonatan Wexler (Jerusalem, IL); Avi Barliya (Tel Aviv, IL)
Assignee: Q (Cue) Ltd.
G10L15/25G06F21/32G06Q20/40145G06V10/145G06V10/60G06V40/166G06V40/171G06V40/172G06V40/176G06V40/45G10L13/00G10L13/02G10L13/027G10L15/08G10L15/16G10L17/02G10L17/04G10L17/10G10L17/18G10L25/84H04L63/0861H04L63/108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,142,282
App. No.
18/505,368
Granted
Nov 12, 2024
Kind
B2
Abstract

Systems, methods, and computer program products are disclosed for removing noise from facial skin micromovement signals. Removing noise from facial skin micromovements includes, during a time period when an individual is involved in at least one non-speech-related physical activity, operating a light source in a manner enabling illumination of a facial skin region of the individual; receiving signals representing light reflections from the facial skin region; analyzing the received signals to identify a first reflection component indicative of prevocalization facial skin micromovements and a second reflection component associated with the at least one non-speech-related physical activity; and filtering out the second reflection component to enable interpretation of words from the first reflection component indicative of the prevocalization facial skin micromovements.

Claims (33)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for removing noise from facial skin micromovement signals, the operations comprising:

during a time period when an individual is involved in at least one non-speech-related physical activity, operating a light source in a manner enabling illumination of a facial skin region of the individual;

receiving signals representing light reflections from the facial skin region;

analyzing the received signals to identify a first reflection component indicative of prevocalization facial skin micromovements and a second reflection component associated with the at least one non-speech-related physical activity; and

filtering out the second reflection component to enable interpretation of words from the first reflection component indicative of the prevocalization facial skin micromovements.

2. The non-transitory computer readable medium of claim 1 , wherein the light source is a coherent light source.

3. The non-transitory computer readable medium of claim 1 , wherein the second reflection component is a result of walking.

4. The non-transitory computer readable medium of claim 1 , wherein the second reflection component is a result of running.

5. The non-transitory computer readable medium of claim 1 , wherein the second reflection component is a result of breathing.

6. The non-transitory computer readable medium of claim 1 , wherein the second reflection component is a result of blinking and is based on neural activation of at least one orbicularis oculi muscle.

7. The non-transitory computer readable medium of claim 1 , wherein, when the individual is concurrently involved in a first physical activity and a second physical activity, the operations further include identify a first portion of the second reflection component associated with the first physical activity and a second portion of the second reflection component associated with the second physical activity and filtering out the first portion of the second component and the second portion of the second component from the first component to enable interpretation of words from the prevocalization facial skin micromovements associated with the first component.

8. The non-transitory computer readable medium of claim 1 , wherein the operations further include receiving data from a mobile communications device, the data being indicative of the at least one non-speech-related physical activity.

9. The non-transitory computer readable medium of claim 8 , wherein the mobile communications device lacks a light sensor for detecting the light reflections.

10. The non-transitory computer readable medium of claim 8 , wherein the data received from the mobile communications device includes at least one of: data indicative of a heart rate of the individual, data indicative of blood pressure of the individual, or data indicative of movement of the individual.

11. The non-transitory computer readable medium of claim 1 , wherein the operations further include presenting the words in a synthesized voice.

12. The non-transitory computer readable medium of claim 1 , wherein the signals are received from a sensor associated with a wearable housing and wherein the instructions further include analyzing the signals to determine the at least one non-speech-related physical activity.

13. The non-transitory computer readable medium of claim 12 , wherein the sensor is an image sensor configured to capture at least one event in an environment of the individual, and wherein the at least one processor is configured to determine that the event is associated with the at least one non-speech-related physical activity.

14. The non-transitory computer readable medium of claim 1 , wherein the operations further include using a neural network to identify the second reflection component associated with the at least one non-speech-related physical activity.

15. The non-transitory computer readable medium of claim 1 , wherein the prevocalization facial skin micromovements correspond to one or more involuntary muscle fiber recruitments.

16. The non-transitory computer readable medium of claim 15 , wherein the involuntary muscle fiber recruitments are a result of an individual thinking of saying the words.

17. The non-transitory computer readable medium of claim 15 , wherein the one or more muscle fiber recruitments include recruitments of at least one of zygomaticus muscle fibers, orbicularis oris muscle fibers, genioglossus muscle fibers, risorius muscle fibers, or levator labii superioris alaeque nasi muscle fibers.

18. The non-transitory computer readable medium of claim 1 , wherein the signals are received at a rate of between 50 Hz and 200 Hz.

19. A method for removing noise from facial skin micromovement signals, the method comprising:

during a time period when an individual is involved in at least one non-speech-related physical activity, operating a light source in a manner enabling illumination of a facial skin region of the individual;

receiving signals representing light reflections from the facial skin region;

analyzing the received signals to identify a first reflection component indicative of prevocalization facial skin micromovements and a second reflection component associated with the at least one non-speech-related physical activity; and

filtering out the second reflection component to enable interpretation of words from the first reflection component indicative of the prevocalization facial skin micromovements.

20. A system for determining facial skin micromovements, the system comprising:

at least one processor configured to:

during a time period when an individual is involved in at least one non-speech-related physical activity, operate a light source in a manner enabling illumination of a facial skin region of the individual;

receive signals representing light reflections from the facial skin region;

analyze the received signals to identify a first reflection component indicative of prevocalization facial skin micromovements and a second reflection component associated with the at least one non-speech-related physical activity; and

filter out the second reflection component to enable interpretation of words from the first reflection component indicative of the prevocalization facial skin micromovements.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2026
From: Q (CUE) LTD.
To: APPLE INC.
Reel/Frame 075350/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2026
From: Q (CUE) LTD.,
To: APPLE INC.
Reel/Frame 075504/0286 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: MAIZELS, AVIAD; BARLIYA, AVI; KORNBLAU, GIORA; WEXLER, YONATAN
To: Q (CUE) LTD.
Reel/Frame 068324/0204 →
Continuity (7)
Continuation PCTIB2023057369 · Jul 19, 2023
Provisional Application 63487299 · Feb 28, 2023
Provisional Application 63441183 · Jan 26, 2023
Provisional Application 63438061 · Jan 10, 2023
Provisional Application 63394329 · Aug 2, 2022
Provisional Application 63390653 · Jul 20, 2022
Related Publication 20240071386A1 · Feb 29, 2024
Cited By (1)
US 12,271,798