Audiovisual content selection
Systems and techniques are disclosed for aspects of audiovisual content selection based on collecting and processing physiological data. In an example, a system comprises: a sensor device with at one physiological sensor to capture physiological data from a human subject; an output device with a display device to output video and a speaker to output audio to the human subject; and a computing device with at least one processor to control an output of digital audiovisual data to a human subject via the output device, based on data processing operations including a comparison of an observed pattern of autonomic nervous system activity to a target pattern of autonomic nervous system activity.
1. A method for modulating autonomic nervous system activity of a video game participant, comprising:
measuring one or more physiological parameters of the video game participant, to determine a temporal pattern of autonomic nervous system activity of the video game participant during gameplay of a video game, wherein the temporal pattern of autonomic nervous system activity represents physiological signals over time generated in response to the gameplay by the video game participant;
performing a comparison of the measured temporal pattern of autonomic nervous system activity to a target temporal pattern of autonomic nervous system activity, wherein the target temporal pattern of autonomic nervous system activity represents desired physiological signals over time to achieve desired modulation of the autonomic nervous system for the video game participant, and wherein the measured temporal pattern and the target temporal pattern define change over time of at least one sensor signal corresponding to the autonomic nervous system activity:
selecting audiovisual content or a game function to present in the video game, based on the comparison, the audiovisual content or game function predicted to induce the target temporal pattern of autonomic nervous system activity of the video game participant; and
automatically control a presentation of the selected audiovisual content or game function to the video game participant in the video game, to induce the target temporal pattern of autonomic nervous system activity in the video game participant.
2. The method of claim 1 , wherein the measuring of the one or more physiological parameters includes acquiring data in real time and over different time periods to capture a series of measurements of the temporal pattern of autonomic nervous system activity or changes in the temporal pattern of autonomic nervous system activity.
3. The method of claim 2 , wherein the series of measurements of the temporal pattern of autonomic nervous system activity or changes in the temporal pattern of autonomic nervous system activity are provided based on measurements of one or more of: heart rate, heart rate variability, skin response, eye response, respiration, facial measurement, electroencephalogram (EEG), or muscle activity.
4. The method of claim 1 , wherein the temporal pattern of autonomic nervous system activity corresponds to a level of autonomic nervous system activity, and
wherein the temporal pattern of autonomic nervous system activity is based on: a current temporal pattern of autonomic nervous system activity measured during ongoing gameplay, or a historical temporal pattern of autonomic nervous system activity measured during past gameplay.
5. The method of claim 1 , wherein the video game comprises elements of one or more of: computer-driven gaming, betting, education, training, entertainment, role playing, or simulation, and
wherein the video game is presented to the video game participant via one or more of: a video screen, a virtual reality system, a casino video machine, or an online casino interface.
6. The method of claim 1 , wherein the target temporal pattern of autonomic nervous system activity is utilized or the determined temporal pattern of autonomic nervous system activity is measured over different time periods within the video game to adjust the selected audiovisual content or game function in real-time or different time periods during the gameplay.
7. The method of claim 6 , wherein the selected audiovisual content or game function is integrated into the video game based on a target level of engagement or a target level of challenge for the video game participant, or based upon a level of engagement or challenge defined by physiologic responses in one or more other participants of the video game.
8. The method of claim 1 , further comprising determining one or more response scores based on multiple temporal patterns of autonomic nervous system activity determined during the gameplay of the video game, wherein the one or more response scores are determined based on one or more of: the multiple temporal patterns, time spent in a particular autonomic state, game achievements, or a level of engagement.
9. The method of claim 8 , further comprising displaying a visual representation of the multiple temporal patterns or the one or more response scores, corresponding to the gameplay of the video game, wherein the one or more response scores are used to provide feedback to the video game participant or to adjust future gameplay of the video game.
10. The method of claim 9 , wherein the visual representation includes comparisons of the multiple temporal patterns to known multiple temporal patterns for the video game participant or one or more other video game participants.
11. A non-transitory machine-readable storage medium comprising instructions, which when executed by one or more processors of a computing system, causes the computing system to perform operations that:
measure one or more physiological parameters of a video game participant, to determine a temporal pattern of autonomic nervous system activity an of the video game participant during gameplay of a video game, wherein the temporal pattern of autonomic nervous system activity represents physiological signals over time generated in response to the gameplay by the video game participant;
perform a comparison of the measured temporal pattern of autonomic nervous system activity to a target temporal pattern of autonomic nervous system activity, wherein the target temporal pattern of autonomic nervous system activity represents desired physiological signals over time to achieve desired modulation of the autonomic nervous system for the video game participant, and wherein the measured temporal pattern and the target temporal pattern define change over time of at least one sensor signal corresponding to the autonomic nervous system activity;
select audiovisual content or a game function to present in the video game, based on the comparison, the audiovisual content or game function predicted to induce the target temporal pattern of autonomic nervous system activity of the video game participant; and
automatically control a presentation of the selected audiovisual content or game function to the video game participant in the video game, to induce to the target temporal pattern of autonomic nervous system activity in the video game participant.
12. The non-transitory machine-readable storage medium of claim 11 , wherein the measure of the one or more physiological parameters includes data acquired in real time and over different time periods to capture a series of measurements of the temporal pattern of autonomic nervous system activity or changes in the temporal pattern of autonomic nervous system activity.
13. The non-transitory machine-readable storage medium of claim 12 , wherein the series of measurements of the temporal pattern of autonomic nervous system activity or changes in the temporal pattern of autonomic nervous system activity are provided based on measurements of one or more of: heart rate, heart rate variability, skin response, eye response, respiration, facial measurement, electroencephalogram (EEG), or muscle activity.
14. The non-transitory machine-readable storage medium of claim 11 , wherein the temporal pattern of autonomic nervous system activity corresponds to a level of autonomic nervous system activity, and
wherein the temporal pattern of autonomic nervous system activity is based on: a current temporal pattern of autonomic nervous system activity measured during ongoing gameplay, or a historical temporal pattern of autonomic nervous system activity measured during past gameplay.
15. The non-transitory machine-readable storage medium of claim 11 , wherein the video game comprises elements of one or more of: computer-driven gaming, betting, education, training, entertainment, role playing, or simulation, and
wherein the video game is presented to the video game participant via one or more of: a video screen, a virtual reality system, a casino video machine, or an online casino interface.
16. The non-transitory machine-readable storage medium of claim 11 , wherein the target temporal pattern of autonomic nervous system activity is utilized or the determined temporal pattern of autonomic nervous system activity is measured over different time periods within the video game to adjust the selected audiovisual content or game function in real-time or different time periods during the gameplay.
17. The non-transitory machine-readable storage medium of claim 16 , wherein the selected audiovisual content or game function is integrated into the video game based on a target level of engagement or a target level of challenge for the video game participant, or based upon a level of engagement or challenge defined by physiologic responses in one or more other participants of the video game.
18. The non-transitory machine-readable storage medium of claim 11 , wherein the instructions further cause the computing system to perform operations that determine one or more response scores based on multiple temporal patterns of autonomic nervous system activity determined during the gameplay of the video game, wherein the one or more response scores are determined based on one or more of: the multiple temporal patterns, time spent in a particular autonomic state, game achievements, or a level of engagement.
19. The non-transitory machine-readable storage medium of claim 18 , wherein the instructions further cause the computing system to perform operations that display a visual representation of the multiple temporal patterns or the one or more response scores, corresponding to the gameplay of the video game, wherein the one or more response scores are used to provide feedback to the video game participant or to adjust future gameplay of the video game.
20. The non-transitory machine-readable storage medium of claim 19 , wherein the visual representation includes comparisons of the multiple temporal patterns to known multiple temporal patterns for the video game participant or one or more other video game participants.