Gaze based communications for locked-in hospital patients
Effective patient-centered care in a hospital relies heavily on the ability of patients to communicate their physical needs to care givers. If a patient is unable to speak, he has limited means of communicating at a time when he needs it the most. The embodiments presented here, generally referred to as EyeVoice, include unobtrusive eye-operated communication systems for locked-in hospital patients who cannot speak or gesture. EyeVoice provides an alternate means of communication, allowing hospital patients to communicate with their care givers using their eyes in place of their voices. Simply by looking at images and cells displayed on a computer screen placed in front of them, patients are able to: answer questions posed by caregivers; specify locations, types and degrees of pain and discomfort; request specific forms of assistance; ask or answer care related questions, and help direct his own care.
1. A system for communicating with locked-in patients, including:
a patient's visual display for displaying information to a patient in a healthcare setting;
a caregiver's visual display for a caregiver;
an eyetracker to monitor a gazepoint trace of the patient's eyes within the patient's visual display, wherein the eyetracker includes a camera mounted to the patient's visual display that images the patient's eye, an illumination source that illuminates the patient's eye, and one or more optical devices to determine the range from the camera to the patient's eye, and wherein the patient's visual display, the caregiver's visual display, and the camera are maneuverable to accommodate the position of the patient and the caregiver; and
a processor that
correlates the gazepoint trace of the patient's eyes with elements of the patient's visual display using the images of patient's eye and the range from the camera to the patient's eye,
infers the patient's awareness of a situation by verifying that the patient has looked at one or more designated elements of the patient's visual display, and
displays, on the caregiver's visual display, the images of the patient's eye and a gazepoint of the patient from the gazepoint trace, in addition to the same information displayed on the patient's visual display, providing the caregiver a) positive feedback that the eyetracking function is working, b) that the patient has his eyes opened or closed at any time, and c) an indication of what the patient is looking at as the patient looks around the patient's visual display and makes visual selections.
2. The system of claim 1 wherein a monitor of the patient's visual display and a second monitor of the caregiver's visual display are mounted back to back in an integrated unit.
3. The system of claim 1 , wherein the eyetracker further records the images of the patient's eyes.
4. A gaze-based system for administering a test to a person, including:
a person's visual display for displaying alternative answers to a plurality of questions;
a caregiver's visual display for a person administering the test;
an eyetracker that monitors the person's gazepoint trace within the person's visual display, wherein the eyetracker includes a camera mounted to the person's visual display that images the person's eye, an illumination source that illuminates the person's eye, and one or more optical devices to determine the range from the camera to the person's eye, and wherein the person's visual display, the caregiver's visual display, and the camera are maneuverable to accommodate the position of the person and the caregiver; and
a processor that
allows the person to select one of the displayed alternative answers by looking at the selected answer by correlating the person's gazepoint with the alternative answers displayed on the person's visual display using the images of person's eye and the range from the camera to the person's eye, and
displays, on the caregiver's visual display, images of the person's eye and a gazepoint of the person from the gazepoint trace, in addition to the same alternative answers displayed on the person's visual display, providing the caregiver a) positive feedback that the eyetracking function is working, b) that the person has his eyes opened or closed at any time, and c) an indication of what the person is looking at as the person looks around the person's visual display and makes visual selections.
5. The gaze-based system of claim 4 , wherein the test is a hearing assessment test, and wherein the plurality of questions include hearing-oriented questions.
6. The gaze-based system of claim 4 , wherein the test is an orientation and/or awareness test, and wherein the plurality of questions include orientation- and/or awareness-oriented questions.
7. The gaze-based system of claim 4 , wherein the test is a delirium test, and wherein the plurality of questions include delirium questions.
8. The gaze-based system of claim 7 , further comprising automatically recording the person's delirium answers and means for assessing the person's level of delirium based on a correctness of the person's delirium answers using the processor.
9. The gaze-based system of claim 4 , wherein the test is a pain-level assessment test, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative levels of pain, and wherein the means for allowing the person to select allows the person to designate a pain level by looking at a corresponding pain-level option on the person's visual display.
10. The gaze-based system of claim 4 , wherein the test allows a person to designate a location of pain, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative pain locations, and wherein the means for allowing the person to select allows the person to designate a pain location by looking at a corresponding pain-location option on the person's visual display.
11. The gaze-based system of claim 4 , wherein the test allows a person to designate a type of pain, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative pain types, and wherein the means for allowing the person to select allows the person to designate a pain type by looking at a corresponding pain-type option on the person's visual display.
12. A method for administering a test to a person using a gaze-based system, including:
displaying alternative answers to a plurality of questions using a person's visual display;
monitoring the person's gazepoint trace within the person's visual display using an eyetracker, wherein the eyetracker includes a camera mounted to the person's visual display that images the person's eye, an illumination source that illuminates the person's eye, and one or more optical devices to determine the range from the camera to the person's eye, and wherein the person's visual display, a caregiver's visual display, and the camera are maneuverable to accommodate the position of the person and the caregiver;
allowing the person to select one of the displayed alternative answers by looking at the selected answer by correlating the person's gazepoint with the alternative answers displayed on the person's visual display using a processor using the images of person's eye and the range from the camera to the person's eye; and
displaying, on the caregiver's visual display, images of the person's eye and a gazepoint of the person from the gazepoint trace, in addition to the same alternative answers displayed on the person's visual display, providing the caregiver a) positive feedback that the eyetracking function is working, b) that the person has his eyes opened or closed at any time, and c) an indication of what the person is looking at as the person looks around the person's visual display and makes visual selections.
13. The method of claim 12 , wherein the test is a hearing assessment test, and wherein the plurality of questions include hearing-oriented questions.
14. The method of claim 12 , wherein the test is an orientation and/or awareness test, and wherein the plurality of questions include orientation- and/or awareness-oriented questions.
15. The method of claim 12 , wherein the test is a delirium test, and wherein the plurality of questions include delirium questions.
16. The method of claim 12 , further comprising automatically recording the person's delirium answers and assessing the person's level of delirium based on a correctness of the person's delirium answers.
17. The method of claim 12 , wherein the test is a pain-level assessment test, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative levels of pain, and wherein the step of allowing the person to select comprises allowing the person to designate a pain level by looking at a corresponding pain-level option on the person's visual display.
18. The method of claim 12 , wherein the test allows a person to designate a location of pain, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative pain locations, and wherein the step of allowing the person to select comprises allowing the person to designate a pain location by looking at a corresponding pain-location option on the person's visual display.
19. The method of claim 12 , wherein the test allows a person to designate a type of pain, and wherein the alternative answers to the plurality of questions include two or more options corresponding to alternative pain types, and wherein the step of allowing the person to select comprises allowing the person to designate a pain type by looking at a corresponding pain-type option on the person's visual display.
20. The method of claim 12 , further comprising recording the images of the person's eye.