Remote computing analysis for cognitive state data metrics
Remote computing analysis for cognitive state data metrics is performed. Cognitive state data from a plurality of people is collected as they interact with a rendering. The cognitive state data includes video facial data collected on one or more local devices from the plurality of people. Information is uploaded to a remote server. The information includes the cognitive state data. A facial expression metric based on a plurality of image classifiers is calculated for each individual within the plurality of people. Cognitive state information is generated for each individual, based on the facial expression metric for each individual. The cognitive state information for each individual within the plurality of people who interacted with the rendering is aggregated. The aggregation is based on the facial expression metric for each individual. The cognitive state information that was aggregated is displayed on at least one of the one or more local devices.
1. A computer-implemented method for analysis comprising:
collecting cognitive state data from a plurality of people as they interact with a rendering, wherein the cognitive state data includes video facial data, collected on one or more local devices, from the plurality of people;
uploading information to a remote server, wherein the information includes the cognitive state data;
calculating a facial expression metric, based on a plurality of image classifiers, for each individual within the plurality of people;
generating cognitive state information for each individual, based on the facial expression metric for each individual;
aggregating the cognitive state information for each individual within the plurality of people who interacted with the rendering, based on the facial expression metric for each individual; and
displaying, with the rendering, the cognitive state information that was aggregated, on at least one of the one or more local devices, wherein the displaying includes an avatar visualization of the aggregated cognitive state information, wherein the visualization is based on an average of the cognitive state data collected from the plurality of people.
2. The method of claim 1 wherein the cognitive state information includes a cognitive state metric.
3. The method of claim 1 wherein the aggregated cognitive state information includes aggregated cognitive state metrics.
4. The method of claim 3 further comprising deriving norms for the plurality of people.
5. The method of claim 4 wherein the norms for the plurality of people are based on the aggregated cognitive state information.
6. The method of claim 4 wherein the norms for the plurality of people are based on contextual information.
7. The method of claim 4 wherein the norms are derived based on cognitive state event temporal signatures.
8. The method of claim 1 further comprising collecting further cognitive state data from a first individual and comparing the further cognitive state data from the first individual with the aggregated cognitive state information.
9. The method of claim 1 further comprising associating the cognitive state information that was aggregated with the rendering.
10. The method of claim 1 further comprising synchronizing the aggregated cognitive state information with the rendering.
11. The method of claim 1 further comprising capturing contextual information about the rendering.
12. The method of claim 11 wherein the contextual information includes a timeline, a progression of webpages, or an actigraph.
13. The method of claim 1 further comprising inferring cognitive states based on the cognitive state data collected from the plurality of people.
14. The method of claim 1 wherein the calculating includes using an image classifier from a plurality of image classifiers to detect one or more faces in the facial data.
15. The method of claim 1 further comprising tracking eyes to identify the rendering with which interacting is accomplished.
16. The method of claim 15 wherein the tracking of the eyes identifies a portion of the rendering on which the eyes are focused.
17. The method of claim 16 further comprising recording of eye dwell time on the rendering and associating information on the eye dwell time to the rendering and to the cognitive state data.
18. The method of claim 1 wherein aggregation of the cognitive state information is performed on a demographic basis so that cognitive state information is grouped based on the demographic basis.
19. The method of claim 1 wherein the cognitive state information includes two or more cognitive state metrics for an individual within the plurality of people.
20. The method of claim 19 wherein the aggregating further comprises aggregating the two or more cognitive state metrics for the individual with two or more cognitive state metrics for an additional individual within the plurality of people.
21. The method of claim 20 wherein the aggregating is further based on a comparison of matched cognitive state metrics for the individual and the additional individual.
22. The method of claim 1 further comprising creating a visual representation of one or more of the aggregated cognitive state information and cognitive state information on an individual from the plurality of people.
23. The method of claim 22 wherein the visual representation displays the aggregated cognitive state information on a demographic basis, wherein the demographic basis includes at least one of age, ethnicity, and gender.
24. A computer program product embodied in a non-transitory computer readable medium for analysis, the computer program product comprising code which causes one or more processors to perform operations of:
collecting cognitive state data from a plurality of people as they interact with a rendering, wherein the cognitive state data includes video facial data, collected on one or more local devices, from the plurality of people;
uploading information to a remote server, wherein the information includes the cognitive state data;
calculating a facial expression metric, based on a plurality of image classifiers, for each individual within the plurality of people;
generating cognitive state information for each individual, based on the facial expression metric for each individual;
aggregating the cognitive state information for each individual within the plurality of people who interacted with the rendering, based on facial expression metric for each individual; and
displaying the cognitive state information that was aggregated, with the rendering, on at least one of the one or more local devices, wherein the displaying includes an avatar visualization of the aggregated cognitive state information, wherein the visualization is based on an average of the cognitive state data collected from the plurality of people.
25. A system for analysis comprising:
a memory which stores instructions;
one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
collect cognitive state data from a plurality of people as they interact with a rendering, wherein the cognitive state data includes video facial data, collected on one or more local devices, from the plurality of people;
upload information to a remote server, wherein the information includes the cognitive state data;
calculate a facial expression metric, based on a plurality of image classifiers, for each individual within the plurality of people;
generate cognitive state information for each individual, based on the facial expression metric for each individual;
aggregate the cognitive state information for each individual within the plurality of people who interacted with the rendering, based on facial expression metric for each individual; and
display the cognitive state information that was aggregated, with the rendering, on at least one of the one or more local devices, wherein displaying includes an avatar visualization of the aggregated cognitive state information, wherein the visualization is based on an average of the cognitive state data collected from the plurality of people.