Method and System for the Asynchronous, Scalable Review of Video Responses to Video Scripts Utilizing Peer Evaluation
A method and system are described for asynchronous peer or proxy review of video-based responses. A database is provided that includes pointers to video-based speaking prompts, video-based responses associated with the prompts, and scores associated with the responses. A plurality of user participants record responses that are scored by other user participants or proxy scorers, and recorded response scripts are dynamically assigned to a plurality of scorers for scoring such that assignments are distributed to scorers participating in a common event having an event time window. A server is in communication with the database and further in communication with client devices for user participants or proxies. The server provides a web-based graphical user interface enabling user participants to playback prompts and record responses thereto within a response time window and scorers to determine scores for response scripts assigned by the assignments module to the scorer.
1 . A system for asynchronous peer or proxy review of video-based responses, comprising:
a database including pointers to:
(i) video-based speaking prompts,
(ii) video-based responses associated with the prompts, and
(iii) scores associated with the responses,
wherein a plurality of user participants record responses that are scored by other user participants or proxy scorers, and recorded response scripts are dynamically assigned to a plurality of scorers for scoring such that assignments are distributed to scorers participating in a common event having an event time window; and
a server in communication with the database and further in communication with client devices for user participants or proxies, wherein the server provides a web-based graphical user interface enabling:
(i) user participants to playback prompts and record responses thereto within a response time window, and
(ii) scorers to determine scores for response scripts assigned by the assignments module to the scorer.
2 . The system according to claim 1 , wherein scorers are assigned such that a user participant is not assigned to score that participant's own responses.
3 . The system according to claim 1 , wherein the number of response scripts assigned for scoring may vary by participant.
4 . The system according to claim 3 , wherein each user participant is tasked with scoring a minimum number of response scripts.
5 . The system according to claim 3 , wherein one or more proxies are assigned to score response scripts from user participants.
6 . The system according to claim 1 , wherein the event time window is associated with an event having a plurality of rounds, and based upon the scoring of a round, one or more of the user participants are eliminated from a next round, such that the next round begins with at least one fewer user participant.
7 . The system according to claim 1 , wherein each user participant in the event is assigned to score the same number of response scripts.
8 . The system according to claim 1 , wherein the scorers are dynamically reassigned as new participants enter an event within the event time window.
9 . A method for asynchronous peer or proxy review of video-based responses, comprising:
configuring a database with pointers to:
(i) video-based speaking prompts,
(ii) video-based responses associated with the prompts, and
(iii) scores associated with the responses,
wherein a plurality of user participants record responses that are scored by other user participants or proxy scorers, and recorded response scripts are dynamically assigned to a plurality of scorers for scoring such that assignments are distributed to scorers participating in a common event having an event time window; and
communicating, via a server, with a client device for a user participant or proxy, wherein the server provides a web-based graphical user interface enabling:
(i) user participants to playback prompts and record responses thereto within a response time window, and
(ii) scorers to determine scores for response scripts assigned by the assignments module to the scorer.
10 . The method according to claim 9 , wherein scorers are assigned such that a user participant is not assigned to score that participant's own responses.
11 . The method according to claim 9 , wherein the number of response scripts assigned for scoring may vary by participant.
12 . The method according to claim 9 , wherein each user participant is tasked with scoring a minimum number of response scripts.
13 . The method according to claim 9 , wherein the event time window is associated with an event having a plurality of rounds, and based upon the scoring of a round, one or more of the user participants are eliminated from a next round, such that the next round begins with at least one fewer user participant.
14 . The method according to claim 9 , wherein each user participant in the event is assigned to score the same number of response scripts.
15 . The method according to claim 9 , wherein the scorers are dynamically reassigned as new participants enter an event within the event time window.
16 . A method for asynchronous peer or proxy review of video-based responses, comprising:
receiving a media file of a video-based speaking prompt;
associating the speaking prompt with an event and providing, via graphical user interface, the media file to a plurality of user participants that are participating in the event and are tasked with recording a video-based response associated with the speaking prompt;
dynamically assigning a recorded response to a plurality of scorers comprised of user participants, proxy scorers, or a combination thereof, such that assignments are distributed, via a graphical user interface, to scorers participating in a common event having an event time window;
receiving scores from the plurality of scorers indicating evaluations of the recorded response; and
associating, in a plurality of database tables, the received scores with the recorded response, the user participant that created the response, and the scorers that provided the respective evaluations.
17 . The method according to claim 16 , wherein the number of response scripts assigned for scoring may vary by participant.
18 . The method according to claim 16 , wherein each user participant is tasked with scoring a minimum number of response scripts.
19 . The method according to claim 16 , wherein the event time window is associated with an event having a plurality of rounds, and based upon the scoring of a round, one or more of the user participants are eliminated from a next round, such that the next round begins with at least one fewer user participant.