IP Library Granted Patent US 12,105,785
Granted Patent B2
US 12,105,785 · App. 18/509,976 · Granted Oct 1, 2024

Interpreting words prior to vocalization

Inventors: Aviad Maizels (Ramat Hasharon, IL); Yonatan Wexler (Jerusalem, IL); Avi Barliya (Tel Aviv, IL)
Assignee: Q (Cue) Ltd.
G06F21/32A61B5/1176G06F16/532G06F40/40G06V20/50G06V40/166G06V40/171G06V40/172G06V40/176G10L13/02G10L15/08G10L15/20G10L15/22G10L15/25H04R1/028H04R1/10G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,105,785
App. No.
18/509,976
Granted
Oct 1, 2024
Kind
B2
Abstract

Systems, methods, and computer program products are disclosed for initiating content interpretation operations prior to vocalization of content to be interpreted. Initiating content interpretation operations prior to vocalization of content to be interpreted includes receiving signals representing facial skin micromovements; determining from the signals at least one word to be spoken prior to vocalization of the at least one word in an origin language; prior to the vocalization of the at least one word, instituting an interpretation of the at least one word; and causing the interpretation of the at least one word to be presented as the at least one word is spoken.

Claims (33)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to initiate content interpretation operations prior to vocalization of content to be interpreted, the operations comprising:

receiving signals representing facial skin micromovements;

determining from the signals at least one word to be spoken prior to vocalization of the at least one word in an origin language;

prior to the vocalization of the at least one word, instituting an interpretation of the at least one word; and

causing the interpretation of the at least one word to be presented as the at least one word is spoken.

2. The non-transitory computer readable medium of claim 1 , wherein the interpretation is a translation of the at least one word from the origin language into at least one target language other than the origin language.

3. The non-transitory computer readable medium of claim 2 , wherein the interpretation of the at least one word includes a transcription of the at least one word into text in the at least one target language.

4. The non-transitory computer readable medium of claim 2 , wherein the interpretation of the at least one word includes a speech synthetization of the at least one word in the at least one target language.

5. The non-transitory computer readable medium of claim 2 , further comprising receiving a selection of the at least one target language.

6. The non-transitory computer readable medium of claim 5 , wherein the selection of the at least one target language includes selections of a plurality of target languages, and wherein causing the interpretation of the at least one word to be presented includes simultaneously causing presentation in the plurality of languages.

7. The non-transitory computer readable medium of claim 1 , wherein the interpretation of the at least one word includes a transcription of the at least one word into text in the origin language.

8. The non-transitory computer readable medium of claim 7 , wherein presenting the interpretation of the at least one word includes outputting a textual display of the transcription together with a video of an individual associated with the facial skin micromovements.

9. The non-transitory computer readable medium of claim 1 , wherein receiving signals occurs via at least one detector of coherent light reflections from a facial region of a person vocalizing the at least one word.

10. The non-transitory computer readable medium of claim 9 , wherein causing the interpretation of the at least one word to be presented occurs concurrently with the at least one word being vocalized by the person.

11. The non-transitory computer readable medium of claim 1 , wherein causing the interpretation of the at least one word to be presented includes using a wearable speaker to output an audible presentation of the at least one word.

12. The non-transitory computer readable medium of claim 1 , wherein causing the interpretation of the at least one word to be presented includes transmitting sound signals over a network.

13. The non-transitory computer readable medium of claim 1 , further comprising determining at least one prospective word to be spoken following to the at least one word to be spoken, instituting an interpretation of the at least one prospective word prior to vocalization of the at least one word; and causing the interpretation of the at least one prospective word to be presented following presentation of the at least one word as the at least one word is spoken.

14. The non-transitory computer readable medium of claim 1 , wherein causing the interpretation of the at least one word to be presented includes transmitting a textual translation of the at least one word over a network.

15. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining from the signals at least one non-verbal interjection, and outputting a representation of the non-verbal interjection.

16. The non-transitory computer readable medium of claim 1 , wherein determining from the signals at least one word includes interpreting the facial skin micromovements using speckle analysis.

17. The non-transitory computer readable medium of claim 1 , wherein the signals representing facial skin micromovements correspond to muscle activation prior to the vocalization of the at least one word.

18. The non-transitory computer readable medium of claim 17 , wherein the muscle activation is associated with at least one specific muscle that includes: a zygomaticus muscle, an orbicularis oris muscle, a risorius muscle, a genioglossus muscle, or a levator labii superioris alaeque nasi muscle.

19. A method for initiating content interpretation prior to vocalization of content to be interpreted, the method comprising:

receiving signals representing facial skin micromovements;

determining from the signals at least one word to be spoken prior to vocalization of the at least one word in an origin language;

prior to the vocalization of the at least one word, instituting an interpretation of the at least one word; and

causing the interpretation of the at least one word to be presented as the at least one word is spoken.

20. A system for initiating content interpretation prior to vocalization of content to be interpreted, the system comprising:

at least one processor configured to:

receive signals representing facial skin micromovements;

determine from the signals at least one word to be spoken prior to vocalization of the at least one word in an origin language;

prior to the vocalization of the at least one word, institute an interpretation of the at least one word; and

cause the interpretation of the at least one word to be presented as the at least one word is spoken.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2026
From: Q (CUE) LTD.
To: APPLE INC.
Reel/Frame 075350/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2026
From: Q (CUE) LTD.,
To: APPLE INC.
Reel/Frame 075504/0286 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: MAIZELS, AVIAD; BARLIYA, AVI; KORNBLAU, GIORA; WEXLER, YONATAN
To: Q (CUE) LTD.
Reel/Frame 068324/0204 →
Continuity (10)
Continuation PCTIB2023057369 · Jul 19, 2023
Continuation In Part PCTIB2022056418 · Jul 12, 2022
Continuation In Part PCTIB2022054527 · May 16, 2022
Provisional Application 63487299 · Feb 28, 2023
Provisional Application 63441183 · Jan 26, 2023
Provisional Application 63438061 · Jan 10, 2023
Provisional Application 63394329 · Aug 2, 2022
Provisional Application 63390653 · Jul 20, 2022
Provisional Application 63229091 · Aug 4, 2021
Related Publication 20240079011A1 · Mar 7, 2024
Cited By (1)
US 12,400,652