EXTRACTING REACTIONS TO CONTENT FROM FACIAL MICROMOVEMENTS
Systems, methods, and non-transitory computer-readable media including instructions for detecting and utilizing facial skin micromovements are disclosed. In some non-limiting embodiments, the detection of the facial skin micromovements occurs using a speech detection system that may include a wearable housing, a light source (either a coherent light source or a non-coherent light source), a light detector, and at least one processor. One or more processors may be configured to analyze light reflections received from a facial region to determine the facial skin micromovements, and extract meaning from the determined facial skin micromovements. Examples of meaning that may be extracted from the determined facial skin micromovements may include words spoken by the individual (either silently spoken or vocally spoken), an identification of the individual, an emotional state of the individual, a heart rate of the individual, a respiration rate of the individual, or any other biometric, emotion, or speech-related indicator.
1 - 520 . (canceled)
521 . A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for extracting reactions to content based on facial skin micromovements, the operations comprising:
during a time period when an individual is consuming content, determining the facial skin micromovements of the individual based on reflections of light from a facial region of the individual;
determining at least one specific micro-expression from the facial skin micromovements;
accessing at least one data structure containing correlations between a plurality of micro-expressions and a plurality of non-verbalized perceptions;
based on the at least one specific micro-expression and the correlations in the data structure, determining a specific non-verbalized perception of the content consumed by the individual; and
initiating an action associated with the specific non-verbalized perception.
522 . The non-transitory computer readable medium of claim 521 , wherein the at least one specific micro-expression is imperceptible to a human eye.
523 . The non-transitory computer readable medium of claim 521 , wherein the facial skin micromovements used for determining the at least one specific micro-expression correspond to recruitment of at least one muscle from a group of muscles including: a zygomaticus muscle, a genioglossus muscle, an orbicularis oris muscle, a risorius muscle, or a levator labii superioris alaeque nasi muscle.
524 . The non-transitory computer readable medium of claim 521 , wherein the at least one specific micro-expression includes a sequence of micro-expressions associated with the specific non-verbalized perception.
525 . The non-transitory computer readable medium of claim 524 , wherein the operations further include determining a degree of the specific non-verbalized perception based on the sequence of micro-expressions, and determining an action to initiate based on the degree of the specific non-verbalized perception.
526 . The non-transitory computer readable medium of claim 521 , wherein the at least one data structure includes past non-verbalized perceptions of previously consumed content, and wherein the operations further comprise determining a degree of the specific non-verbalized perception relative to the past non-verbalized perceptions, and determining an action to initiate based on the degree of the specific non-verbalized perception.
527 . The non-transitory computer readable medium of claim 521 , wherein the non-verbalized perceptions include an emotional state of the individual.
528 . The non-transitory computer readable medium of claim 521 , wherein the operations further include determining an action to initiate based on the consumed content and the specific non-verbalized perception.
529 . The non-transitory computer readable medium of claim 521 , wherein the action initiated includes causing a transmission of a message reflecting a correlation between the specific non-verbalized perception and the consumed content.
530 . The non-transitory computer readable medium of claim 521 , wherein the action initiated includes storing in memory a correlation between the specific non-verbalized perception and the consumed content.
531 . The non-transitory computer readable medium of claim 521 , wherein the action includes determining additional content to be presented to the individual based on the specific non-verbalized perception and the consumed content.
532 . The non-transitory computer readable medium of claim 531 , wherein the consumed content is of a first type and the additional content is of a second type differing from the first type.
533 . The non-transitory computer readable medium of claim 521 , wherein the consumed content is part of a chat with at least one other individual and the action includes generating a visual representation of the specific non-verbalized perception in the chat.
534 . The non-transitory computer readable medium of claim 521 , wherein the action includes selecting an alternative manner for presenting the consumed content.
535 . The non-transitory computer readable medium of claim 521 , wherein the action varies based on a type of the consumed content.
536 . The non-transitory computer readable medium of claim 521 , wherein the operations further include operating at least one wearable coherent light source in a manner enabling illumination of a non-lip portion of a face of the individual, and receiving signals indicative of coherent light reflections from the non-lip portion of the face.
537 . The non-transitory computer readable medium of claim 536 , wherein the facial skin micromovements are determined based on speckle analysis of the coherent light reflections.
538 . The non-transitory computer readable medium of claim 521 , wherein the reflections of light are received by a wearable light detector.
539 . A method for extracting reactions to content based on facial skin micromovements, the method comprising:
during a time period when an individual is consuming content, determining the facial skin micromovements of the individual based on reflections of light from a facial region of the individual;
determining at least one specific micro-expression from the facial skin micromovements;
accessing a data structure containing correlations between a plurality of micro-expressions and a plurality of non-verbalized perceptions;
based on the at least one specific micro-expression and the correlations in the data structure, determining a specific non-verbalized perception of the content consumed by the individual; and
initiating an action associated with the specific non-verbalized perception.
540 . A system for extracting reactions to content based on facial skin micromovements, the system comprising:
at least one processor configured to:
during a time period when an individual is consuming content, determine the facial skin micromovements of the individual based on reflections of light from a facial region of the individual;
determine at least one specific micro-expression from the facial skin micromovements;
access a data structure containing correlations between a plurality of micro-expressions with a plurality of non-verbalized perceptions;
based on the at least one specific micro-expression and the correlations in the data structure, determine a specific non-verbalized perception of the content consumed by the individual; and
initiate an action associated with the specific non-verbalized perception.
541 - 560 . (canceled)