Methods and Systems for Obtaining, Analyzing, and Generating Vision Performance Data and Modifying Media Based on the Vision Performance Data
The present specification describes methods and systems for modifying a media, such as Virtual Reality, Augmented Reality, or Mixed Reality (VR/AR/MxR) media based on a vision profile and a target application. In embodiments of the specification, a Sensory Data Exchange (SDE) is created that enables identification of various vision profiles for users and user groups. The SDE may be utilized to modify one or more media in accordance with each type of user and/or user group.
1 . A method of improving or treating a condition experienced by a user, while said user is experiencing media using a computing device with a display comprising
acquiring a first value for at least one of a plurality of data using said computing device;
acquiring a second value for the at least one of the plurality of data using said computing device;
using said first value and second value, determining a change in at least one of the plurality of data over time;
based upon said change in the at least one of the plurality of data over time, determining a degree of said condition; and
based upon determining a degree of said condition, modifying said media.
2 . The method of claim 1 wherein the computing device is a virtual reality, augmented reality, or mixed reality view device.
3 . The method of claim 2 wherein the virtual reality, augmented reality, or mixed reality view device comprises at least one of a camera configured to acquire eye movement data, a sensor configured to detect a rate and/or direction of head movement, a sensor configured to detect a heart rate, and an EEG sensor to detect brain waves.
4 . The method of claim 3 wherein the eye movement data comprises rapid scanning, saccadic movement, blink rate data, fixation data, pupillary diameter, and palpebral fissure distance.
5 . The method of claim 2 wherein the condition is at least one of comprehension, fatigue, engagement, performance, symptoms associated with visually-induced motion sickness secondary to visual-vestibular mismatch, symptoms associated with post-traumatic stress disorder, double vision related to accommodative dysfunction, vection due to unintended peripheral field stimulation, vergence-accommodation disorders, fixation disparity, blurred vision and myopia, headaches, difficulties in focusing, disorientation, postural instability, visual discomfort, eyestrain, dry eye, eye tearing, foreign body sensation, feeling of pressure in the eyes, aching around the eyes, nausea, stomach discomfort, potential phototoxicity from overexposure to screen displays, hormonal dysregulation arising from excessive blue light exposure, heterophoria, decrease in positive emotions, and increase in negative emotions.
6 . The method of claim 2 wherein the plurality of data comprises at least one of rapid scanning, saccadic movement, fixation, blink rate, pupillary diameter, speed of head movement, direction of head movement, heart rate, motor reaction time, smooth pursuit, palpebral fissure distance, degree and rate of brain wave activity, degree of convergence, and degree of convergence.
7 . The method of claim 2 wherein the modifying of media comprises at least one of increasing a contrast of the media, decreasing a contrast of the media, making an object of interest that is displayed in the media larger in size, making an object of interest that is displayed in the media smaller in size, increasing a brightness of the media, decreasing a brightness of the media, increasing an amount of an object of interest displayed in the media shown in a central field of view and decreasing said object of interest in a peripheral field of view, decreasing an amount of an object of interest displayed in the media shown in a central field of view and increasing said object of interest in a peripheral field of view, changing a focal point of content displayed in the media to a more central location, removing objects from a field of view and measuring if a user recognizes said removal, increasing an amount of color in said media, increasing a degree of shade in objects shown in said media changing RGB values of said media based upon external data, demographic or trending data.
8 . The method of claim 2 wherein the condition is comprehension.
9 . The method of claim 2 wherein the change is at least one of increased rapid scanning, increased saccadic movement, decreased fixation, increased blink rate, increased pupillary diameter, increased head movement, increased heart rate, decreased reaction time, decreased separation of the eyelids, changes in brain wave activity, and increased smooth pursuit.
10 . The method of claim 9 wherein the degree of the condition is a decreased comprehension of the user.
11 . The method of claim 10 wherein, based on said decreased comprehension of the user, said media is modified by at least one of increasing a contrast of the media, making an object of interest that is displayed in the media larger in size, increasing a brightness of the media, increasing an amount of an object of interest displayed in the media shown in a central field of view and decreasing said object of interest in a peripheral field of view, changing a focal point of content displayed in the media to a more central location, removing objects from a field of view and measuring if a user recognizes said removal, increasing an amount of color in said media, increasing a degree of shade in objects shown in said media, and changing RGB values of said media based upon external data, demographic or trending data.
12 . The method of claim 2 wherein the condition is fatigue.
13 . The method of claim 12 wherein the change is at least one of decreased fixation, increased blink rate, and changes in convergence and divergence.
14 . The method of claim 13 wherein the degree of the condition is an increased fatigue of the user.
15 . The method of claim 14 wherein, based on said increased fatigue of the user, said media is modified by at least one of increasing a contrast of the media, making an object of interest that is displayed in the media larger in size, increasing a brightness of the media, and increasing or introduction more motion.
16 . A method of improving comprehension experienced by a user, while the user is experiencing media through a virtual reality, augmented reality, or mixed reality view device, the method comprising:
acquiring a first value for a plurality of data;
acquiring a second value for the plurality of data;
using the first value and the second value to determine a change in the plurality of data over time;
based upon the change in the plurality of data over time, determining a degree of reduced comprehension of the user; and
modifying media based upon determining a degree of reduced comprehension.
17 . The method of claim 16 wherein acquiring the first value and the second value of the plurality of data comprises acquiring at least one or more of: a sensor configured to detect basal body temperature, heart rate, body movement, body rotation, body direction, body velocity, or body amplitude; a sensor configured to measure limb movement, limb rotation, limb direction, limb velocity, or limb amplitude; a pulse oximeter; a sensor configured to measure auditory processing; a sensor configured to measure gustatory and olfactory processing; a sensor to measure pressure; an input device such as a traditional keyboard and mouse and or any other form of controller to collect manual user feedback; an electroencephalograph; an electrocardiograph; an electromyograph; an electrooculograph; an electroretinography; and a sensor configured to measure galvanic skin response.
18 . The method of claim 16 wherein the plurality of data comprises at least one or more of: palpebral fissure, blink rate, pupil size, pupil position, gaze direction, gaze position, vergence, fixation position, fixation duration, fixation rate; fixation count; saccade position, saccade angle, saccade magnitude, pro-saccade, anti-saccade, inhibition of return, saccade velocity, saccade rate, screen distance, head direction, head fixation, limb tracking, weight distribution, frequency domain (Fourier) analysis, electroencephalography output, frequency bands, electrocardiography output, electromyography output, electrooculography output, electroretinography output, galvanic skin response, body temperature, respiration rate, oxygen saturation, heart rate, blood pressure, vocalizations, inferred efferent responses, respiration, facial expression, olfactory processing, gustatory processing, and auditory processing.
19 . The method of claim 16 wherein modifying the media comprises modifying by at least one of: increasing a contrast of the media, making an object of interest that is displayed in the media larger in size, increasing a brightness of the media, increasing an amount of an object of interest displayed in the media shown in a central field of view and decreasing said object of interest in a peripheral field of view, changing a focal point of content displayed in the media to a more central location, removing objects from a field of view and measuring if a user recognizes said removal, increasing an amount of color in said media, increasing a degree of shade in objects shown in said media, and changing RGB values of said media based upon external data (demographic or trending data).
20 . The method of claim 16 wherein the modifying the media comprises modifying to provide a predefined increase in comprehension.