Sensory evoked response based attention evaluation systems and methods
The system and methods described herein determine a subject's indication of attention to a first and a second sensory stimuli. The system determines a sensory evoked response of the subject by calculating the statistical relationship between the subject's neural response to the stimuli and a signal feature of the first and the second sensory stimuli. A magnitude value of the sensory evoked response is extracted to determine whether the subject attended-to or ignored the sensory stimuli. The system will select the stimuli that elicited the greater indication of attention, and then trigger further processing by a computer. Such processing can include selecting future content for improving safety warnings, educational materials, or advertisements or further processing can include controlling and navigating a brain computer user interface.
1. A method comprising:
receiving, by a processor, a measurement of a neural response of a subject to a first sensory stimuli and a second sensory stimuli, wherein the first sensory stimuli corresponds to a first user-actuatable element of a user interface and the second sensory stimuli corresponds to a second user-actuatable element of the user interface;
receiving, by the processor, information related to the first sensory stimuli and the second sensory stimuli, wherein the information includes at least one signal feature of the first sensory stimuli and the second sensory stimuli;
determining, by the processor, a statistical relationship between the at least one signal feature of the first sensory stimuli and the second sensory stimuli and the measurement of the neural response of the subject;
identifying, by the processor, a first magnitude value comprised of a peak value of the determined statistical relationship between the at least one signal feature of the first sensory stimuli and the measurement of the neural response of the subject, and a second magnitude value comprised of a peak value of the determined statistical relationship between the at least one signal feature of the second sensory stimuli and the measurement of the neural response of the subject;
determining, by the processor, a first indication of the attention of the subject to the first sensory stimuli based on the identified first magnitude value, and a second indication of the attention of the subject to the second sensory stimuli based on the identified second magnitude;
comparing, by the processor, the determined first indication of attention of the subject to the determined second indication of the attention of the subject; and
selecting, by the processor, between the first user-actuatable element of the user interface and the second user-actuatable element of the user interface based on which user-actuatable element elicited the greater indication of the attention of the subject; and,
triggering, by a computer, further computer processing based on the selection of the user-actuatable element, wherein triggering further computer processing comprises actuating the selected element of the user interface.
2. The method of claim 1 , wherein the sensory stimuli includes at least one of an auditory, visual, or somatosensory stimuli.
3. The method of claim 1 , wherein the statistical relationship is a cross-correlation analysis between at least one signal feature of the sensory stimuli with the received measurement of the neural response.
4. The method of claim 1 , wherein the actuation of the first user-actuatable element causes the launch of a first software application or first software command and the actuation of the second user-actuatable element causes the launch of a second software application or second software command.
5. The method of claim 1 , wherein the actuation of the first user-actuatable element causes the selection of a first word or first symbol for inclusion in a communication and the actuation of the second user-actuatable element causes the selection of a second word or second symbol for inclusion in a communication.
6. The method of claim 1 , where the first and second user-actuatable elements comprise graphical icons on a device display.
7. A system comprising:
a plurality of stimuli devices configured to evoke a neural response of a subject;
one or more processors implementing a processing unit configured to determine an indication of the attention of the subject to a first sensory stimuli corresponding to a first user-actuatable element of a user interface and a second sensory stimuli corresponding to a second user-actuatable element of the user interface, by:
receiving a measurement of a neural response of a subject to the first sensory stimuli and the second sensory stimuli;
receiving information related to the first sensory stimuli and the second sensory stimuli wherein the information includes at least one signal feature of the first sensory stimuli and the second sensory stimuli;
determining a statistical relationship between the at least one signal feature of the first sensory stimuli and the second sensory stimuli and the measurements of the neural response of the subject;
identifying a first magnitude value comprised of a peak value of the determined statistical relationship between the at least one signal feature of the first sensory stimuli and the measurement of the neural response of the subject, and a second magnitude value comprised of a peak value of the determined statistical relationship between the at least one signal feature of the second sensory stimuli and the measurement of the neural response of the subject;
determining a first indication of the attention of the subject to the first sensory stimuli based on the identified first magnitude value, and a second indication of the attention of the subject to the second sensory stimuli based on the identified second magnitude;
comparing the determined first indication of attention of the subject to the determined second indication of the attention of the subject;
selecting between the first user-actuatable element of the user interface and the second user-actuatable element of the user interface based on which user-actuatable element elicited the greater indication of the attention of the subject; and,
one or more computers configured to trigger further computer processing based on the selection of the user-actuatable element, wherein triggering further computer processing comprises actuating the selected element of the user interface.
8. The system of claim 7 , wherein the sensory stimuli includes at least one of an auditory, visual, or somatosensory stimuli.
9. The system of claim 7 , wherein the statistical relationship is a cross-correlation analysis between at least one signal feature of the sensory stimuli with the received measurement of the sensory evoked neural response.
10. The system of claim 7 , wherein the actuation of the first user-actuatable element causes the launch of a first software application or first software command and the actuation of the second user-actuatable element causes the launch of a second software application or second software command.
11. The system of claim 7 , wherein the actuation of the first user-actuatable element causes the selection of a first word or first symbol for inclusion in a communication and the actuation of the second user-actuatable element causes the selection of a second word or second symbol for inclusion in a communication.
12. The system of claim 7 , where the first and second user-actuatable elements comprise graphical icons on a device display.