APPARATUS AND METHOD FOR USER EVALUATION
An apparatus for monitoring changes in symptoms of a patient is described. The apparatus includes a display for displaying information to a patient; a processing system configured to output to the display at least one of audio, video or both audio and video stimuli for eliciting a reaction in the patient; an audio and video capture device for capturing audio, video or both audio and video recordings of the patient performing an action as the stimuli is output by the display; a computer vision processor configured to determine from the audio, video or both audio and video recordings, one or more reactions of the patient in response to the stimuli and during a first period of time immediately after presentation of the stimuli to the patient, wherein the first period of time is less than 250 milliseconds.
1 . An apparatus for monitoring changes in symptoms of a patient, comprising:
a display for displaying information to a patient;
a processing system configured to output to the display at least one of audio, video or both audio and video stimuli for eliciting a reaction in the patient;
an audio and video capture device for capturing audio, video or both audio and video recordings of the patient performing an action as the stimuli is output by the display;
a computer vision processor configured to determine from the audio, video or both audio and video recordings, one or more reactions of the patient in response to the stimuli and during a first period of time immediately after presentation of the stimuli to the patient, wherein the first period of time is less than 250 ms.
2 . The system of claim 1 , wherein the one or more reactions of the patient to the stimuli during the first period of time comprises one or more microexpressions.
3 . The system of claim 2 , wherein the one or more microexpressions comprise one or more facial reactions within 250 milliseconds after presentation of the stimuli to the patient.
4 . The system of claim 3 , wherein the computer vision processor is configured to determine the one or more facial reactions as a function of movement of one or more action units associated with the face of the patient.
5 . The system of claim 4 , wherein the one or more action units comprise positions corresponding to specific regions on the face of the patient, and the movement of the one or more action units comprises a movement away from a baseline position of the one or more action units.
6 . The system of claim 1 , wherein the stimuli presented to the patient comprises presentation of a predetermined image selected to elicit a predetermined emotion to the patient on the display;
7 . The system of claim 1 , wherein the stimuli presented to the patient comprises a sequence of images, and the response is measured after presentation of each image of the sequence of images.
8 . The system of claim 1 , wherein the stimulus presented to the patient comprises one or more instructions relating to administration of medication, and wherein the computer vision processor is configured to determine from the audio, video or both audio and video recordings whether the patient has properly administered the medication according to the one or more instructions.
9 . The system of claim 8 , wherein the action performed in response to the stimulus presented to the patient comprises the action of the patient performing a requested step indicative of proper medication administration.
10 . The system of claim 1 , wherein the processor further correlates the determined one or more reactions of the patient to similar one or more reactions of a plurality of patients similarly situated to the patient along at least one dimension of disease to determine an individual baseline for the patient.
11 . The system of claim 10 , wherein subsequent determined one or more reactions for the patient are compared relative to the individual baseline for the patient.
12 . The system of claim 1 , wherein the computer vision processor determines the one or more reactions of the patient during a first short period of time after presentation of a stimulus to the patient in accordance with the movement of one or more action units associated with the face of the patient.
13 . The system of claim 1 , further comprising an audio processor for determining one or more audio reaction of the patient during a first short period of time after presentation of the stimulus to the patient.
14 . The system of claim 12 , wherein the processor presents the determined one or more reactions to a user of the system in accordance with a result received from the computer vision processor and the audio processor.
15 . The system of claim 1 , wherein the stimulus presented to the patient comprises a sequence of questions, at least one of the questions being presented in accordance with a response of the patient to a prior question.
16 . The system of claim 15 , wherein the computer vision processor is configured to determine an amount of time the patient takes to audibly respond to the prior questions.
17 . A method for monitoring changes in symptoms of a patient, the method comprising:
output, to a display, at least one of audio, video or both audio and video stimuli for eliciting a reaction in a patient;
capturing audio, video or both audio and video recordings of the patient performing an action as the stimuli is output to the display;
determine from the audio, video or both audio and video recordings, one or more reactions of the patient in response to the stimuli and during a first period of time immediately after presentation of the stimuli to the patient, wherein the first period of time is less than 250 ms.
18 . The method of claim 17 , wherein the action performed in response to the stimulus presented to the patient comprises one or more microexpressions within 250 milliseconds after presentation of the stimulus to the patient, and wherein the one or more microexpressions comprise movement of one or more action units of the face of the patient.
19 . The method of claim 17 , further comprising determining one or more audio reaction of the patient within 250 milliseconds after presentation of the stimulus to the patient.