Generation, administration and analysis of user experience testing
Systems and methods for generating, administering and analyzing a user experience study are provided. In particular, intents can be generated from a user experience study by applying one or more screener questions to participants and subjecting the screened participants to one or more tasks. Corresponding clickstreams and success data for each participant engaging in the tasks can be recorded. The success and clickstream data can also be aggregated for all the screened participants as aggregated results. Video data including audio for each of the screened participants can also be recorded.
1. A method for generating intents from a user experience study comprising:
applying at least one screener question to a plurality of participants;
subjecting the screened participants to at least one task;
recording clickstream and success data for each participant engaging in the at least one task, wherein the clickstream data is mapped as a branched tree structure;
aggregating the success and clickstream data for all the screened participants into aggregated results, wherein the aggregated results include a likelihood of a given path taken in the branched tree structure;
filtering the aggregated clickstream data by a configured dimension; and
identifying features of the clickstream data that correspond to failure of the at least one task by feeding the aggregated clickstream data into a neural network.
2. The method of claim 1 , further comprising recording at least one validation criteria.
3. The method of claim 2 , wherein the at least one validation criteria defines the success.
4. The method of claim 1 , further comprising recording video data for each of the screened participants.
5. The method of claim 4 , further comprising transcribing audio data in the video data.
6. The method of claim 5 , further comprising synchronizing the transcribed audio data to times in the video data.
7. The method of claim 6 , further comprising searching the transcribed audio data.
8. The method of claim 7 , further comprising playing the video data at a time corresponding to the searched transcribed audio data.
9. The method of claim 6 , further comprising selecting a portion of the transcribed audio data and automatically generating a video clip edited from the video data corresponding to the timing of the selected portion.
10. The method of claim 1 , wherein the task includes at least one of a navigation task, a survey, a click test, a card sorting, and a tree test.
11. A system for generating intents from a user experience study comprising:
a screener for applying at least one screener question to a plurality of participants;
an administrator for subjecting the screened participants to at least one task;
a results module for recording clickstream and success data for each participant engaging in the at least one task, wherein the clickstream data is mapped as a branched tree structure, aggregating the success and clickstream data for all the screened participants into aggregated results, wherein the aggregated results include a likelihood of a given path taken in the branched tree structure, and filtering the aggregated clickstream data by a configured dimension; and
a neural network for identifying features of the clickstream data that correspond to failure of the at least one task by consuming the aggregate clickstream data.
12. The system of claim 11 , wherein the results module is further for recording at least one validation criteria.
13. The system of claim 12 , wherein the at least one validation criteria defines the success.
14. The system of claim 11 , wherein the results module is further for recording video data for each of the screened participants.
15. The system of claim 14 , further comprising a transcriber for transcribing audio data in the video data.
16. The system of claim 15 , wherein the results module is further for synchronizing the transcribed audio data to times in the video data.
17. The system of claim 16 , wherein the results module is further for searching the transcribed audio data.
18. The system of claim 17 , wherein the results module is further for playing the video data at a time corresponding to the searched transcribed audio data.
19. The system of claim 16 , an automated clip generator for selecting a portion of the transcribed audio data and automatically generating a video clip edited from the video data corresponding to the timing of the selected portion.
20. The system of claim 11 , wherein the task includes at least one of a navigation task, a survey, a click test, a card sorting, and a tree test.