USING FACIAL MOVEMENTS TO GENERATE A CONVERSATIONAL RECORD

1 . A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for generating a common record based on differing source inputs, the operations comprising:

receiving via at least one sensor first non-audible signals indicative of verbalization of an individual;

interpreting first words of the individual at least in part using the first non-audible signals received from the at least one sensor;

receiving second signals generated by a source other than the individual;

performing speech recognition on the second signals to interpret second words from the source; and

using the first words and the second words to generate the record.

2 . The non-transitory computer readable medium of claim 1 , wherein the at least one sensor includes at least one light detector, and the first non-audible signals are indicative of facial skin movements.

3 . The non-transitory computer readable medium of claim 1 , wherein the at least one sensor includes at least one electrophysiological sensor, and the first non-audible signals are indicative of facial muscle activity or facial nerve activity.

4 . The non-transitory computer readable medium of claim 1 , wherein the second signals are received via at least one additional sensor including a microphone or a camera.

5 . The non-transitory computer readable medium of claim 4 , wherein the microphone includes a directional microphone for distinguishing between a first group of words spoken by the individual and a second group of words spoken by the source other than the individual.

6 . The non-transitory computer readable medium of claim 1 , wherein the second signals are received via a communication device.

7 . The non-transitory computer readable medium of claim 1 , wherein the generated record is an audio record.

8 . The non-transitory computer readable medium of claim 1 , wherein the operations further include using voice recognition to distinguish between a first group of words spoken by the individual and a second group of words generated by the source.

9 . The non-transitory computer readable medium of claim 1 , wherein the generated record is a textual record.

10 . The non-transitory computer readable medium of claim 1 , wherein the source is an additional individual and the record is a transcription of a conversation between the individual and the additional individual.

11 . The non-transitory computer readable medium of claim 10 , wherein the transcription includes a chronological recount of the conversation between the individual and the additional individual.

12 . The non-transitory computer readable medium of claim 1 , wherein the source is an electronic device outputting audible speech and the record includes a transcription of the audible speech.

13 . The non-transitory computer readable medium of claim 12 , wherein the electronic device includes at least one of a phone, a television, a radio, a public address system, or an IoT device.

14 . The non-transitory computer readable medium of claim 1 , wherein the operations further include projecting light from at least one light source on a non-lip portion of a face of the individual, such that the first non-audible signals are indicative of light reflections from the non-lip portion of the face.

15 . The non-transitory computer readable medium of claim 2 , wherein the at least one light detector includes a multi-pixel sensor array, and the operations further include generating images from the first non-audible signals and determining the first words from the images.

16 . The non-transitory computer readable medium of claim 15 , wherein the operations further include performing speckle analysis on the first non-audible signals to identify a speckle pattern, deriving information from the speckle pattern, and determining the first words from the derived information.

17 . The non-transitory computer readable medium of claim 1 , wherein the first non-audible signals used to interpret the first words are indicative of activity that occurred during subvocalization.

18 . The non-transitory computer readable medium of claim 9 , wherein the textual record is generated in a manner that visually differentiates the first words from the second words.

19 . The non-transitory computer readable medium of claim 18 , wherein visually differentiating the first words from the second words includes applying differing visual characteristics to the first words and the second words.

20 . The non-transitory computer readable medium of claim 1 , wherein interpreting the first words includes interpreting a first group of words articulated by the individual in an absence of perceptible vocalization by the individual and interpreting a second group of words vocalized by the individual.

21 . The non-transitory computer readable medium of claim 20 , wherein the record is generated in a manner visually differentiates the first group of words from the second group of words.

22 . The non-transitory computer readable medium of claim 9 , wherein the source includes a plurality of additional individuals and the textual record is generated in a manner visually differentiates from each other the second words spoken by the plurality of additional individuals.

23 . The non-transitory computer readable medium of claim 9 , wherein the operations further include determining a prompt from the first words and using the prompt and the second words to generate the textual record.

24 . The non-transitory computer readable medium of claim 23 , further comprising deriving metadata associated with the prompt for enabling later retrieval of the textual record using the metadata.

25 . The non-transitory computer readable medium of claim 23 , wherein the prompt is related to a specific group of the second words and the operations include highlighting the specific group of the second words in the textual record in response to the prompt.

26 . The non-transitory computer readable medium of claim 23 , wherein the prompt is related to a specific group of the second words and the operations include generating a task associated with the specific group of the second words based on the prompt.

27 . A method for generating a common record based on differing source inputs, the method comprising:

receiving via at least one sensor first non-audible signals indicative of verbalization of an individual;

interpreting first words of the individual at least in part using the first non-audible signals received from the at least one sensor;

receiving second signals generated by a source other than the individual;

performing speech recognition on the second signals to interpret second words from the source; and

using the first words and the second words to generate the record.

28 . A head mountable system for generating a common record based on differing source inputs, the head mountable system comprising:

a wearable housing configured to be worn on a head of an individual;

at least one sensor incorporated with the wearable housing and configured to receive first non-audible signals indicative of verbalization of the individual;

at least one additional sensor incorporated with the wearable housing for receiving second signals generated by a source other than the individual;

at least one processor configured to:

interpret first words of the individual at least in part using the first non-audible signals received from the at least one sensor;

perform speech recognition on the second signals to interpret second words from the source; and

use the first words and the second words to generate the record.