Electronic template generation, data extraction and response detection
A file receiver receives an electronic structure file that includes structure-file data associated with a spatial arrangement and detects a content object for processing that includes content-object data. A file transformation engine transforms the structure-file data from the structure file into an electronic record. A rendering engine renders an image of the transformed structure-file data arranged in the spatial arrangement. An interface engine detects an input corresponding to specification of a position of a data segment. A parsing engine defines a segment-position specification indicative of the position. A template engine generates an electronic template that associates an identifier of the data segment with the segment-position specification and associates the electronic template with a template identifier. A record classifier determines that the content object corresponds to the template identifier. The parsing engine further extracts, using the segment-position specification, a portion of the content-object data that corresponds to the data segment.
1. A system for assessing extracted portions of content objects, the system comprising:
one or more data processors; and
a non-transitory, computer-readable storage medium containing instructions which when executed on the one or more data processors, cause the one or more data processors to perform actions including:
detecting a set of assessment content objects for processing, each assessment content object of the set of assessment content objects including content-object data arranged according to a spatial arrangement, each assessment content object of the set of assessment content objects being associated with an identifier corresponding to a student;
for each assessment content object of at least some of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data;
identifying an answer indicated in the portion of the content-object data based at least partly on generating a first statistic corresponding to the portion of the content-object data and comparing the first statistic to one or more thresholds; and
generating a score to be associated with the assessment content object based at least partly on the answer indicated in the portion of the content-object data, the score indicative as to whether the answer was accurate;
aggregating the scores associated with the at least some of the set of assessment content objects;
generating a second statistic based on the aggregated scores; and
facilitating a presentation of the second statistic as indicative of accuracies of the answers indicated in the portions of the content-object data from at least some of the set of assessment content objects.
2. The system for assessing extracted portions of content objects as recited in claim 1 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion includes converting the extracted portion of the content-object data to text; and
generating the score includes automatically assessing the text.
3. The system for assessing extracted portions of content objects as recited in claim 1 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion of the content-object data includes automatically evaluating the portion of the content-object data to identify the answer.
4. The system for assessing extracted portions of content objects as recited in claim 1 , wherein the set of assessment content objects is larger than the at least some of the set of assessment content objects, and wherein the actions further include:
for another assessment content object of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data; and
identifying an answer indicated in the portion of the content-object data; and
generating a score to be associated with the assessment content object based at least partly on the answer;
re-aggregating the scores associated with the at least some of the set of assessment content objects and the score associated with the other assessment content object;
generating an updated statistic based on the re-aggregated scores; and
facilitating an updated presentation of the updated statistic.
5. The system for assessing extracted portions of content objects as recited in claim 1 , wherein the facilitating the presentation of the second statistic includes:
facilitating the presentation of the second statistic on an interface that includes an input field to accept an input characterizing an extracted portion of content-object data from another assessment content object, the input being configured to influence a score to be associated with the other assessment content object.
6. The system for assessing extracted portions of content objects as recited in claim 1 , wherein the second statistic includes an average, median, mode, range, extremum, or distribution of the scores.
7. The system for assessing extracted portions of content objects as recited in claim 1 , wherein the score includes a score for the answer.
8. A computer-implemented method for assessing extracted portions of content objects, the method comprising:
detecting a set of assessment content objects for processing, each assessment content object of the set of assessment content object s including content-object data arranged according to a spatial arrangement, each assessment content object of the set of assessment content objects being associated with an identifier corresponding to a student;
for each assessment content object of at least some of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data;
identifying an answer indicated in the portion of the content-object data based at least partly on generating a first statistic corresponding to the portion of the content-object data and comparing the first statistic to one or more thresholds; and
generating a score to be associated with the assessment content object based at least partly on the answer indicated in the portion of the content-object data, the score indicative as to whether the answer was accurate;
aggregating the scores associated with the at least some of the set of assessment content objects;
generating a second statistic based on the aggregated scores; and
facilitating a presentation of the second statistic as indicative of accuracies of the answers indicated in the portions of the content-object data from at least some of the set of assessment content objects.
9. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion includes converting the extracted portion of the content-object data to text; and
generating the score includes automatically assessing the text.
10. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion of the content-object data includes automatically evaluating the portion of the content-object data to identify the answer.
11. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein the set of assessment content objects is larger than the at least some of the set of assessment content objects, and wherein the method further comprises:
for another assessment content object of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data; and
identifying an answer indicated in the portion of the content-object data; and
generating a score to be associated with the assessment content object based at least partly on the answer;
re-aggregating the scores associated with the at least some of the set of assessment content objects and the score associated with the other assessment content object;
generating an updated statistic based on the re-aggregated scores; and
facilitating an updated presentation of the updated statistic.
12. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein facilitating the presentation of the second statistic includes:
facilitating the presentation of the second statistic on an interface that includes an input field to accept an input characterizing an extracted portion of content-object data from another assessment content object, the input being configured to influence a score to be associated with the other assessment content object.
13. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein the second statistic includes an average, median, mode, range, extremum, or distribution of the scores.
14. The computer-implemented method for assessing extracted portions of content objects as recited in claim 8 , wherein the score includes a score for the assessment content object.
15. A computer-program product tangibly embodied in a non-transitory, machine-readable storage medium, including instructions configured to cause one or more data processors to perform actions including:
detecting a set of assessment content objects for processing, each assessment content object of the set of assessment content objects including content-object data arranged according to a spatial arrangement, each assessment content object of the set of assessment content objects being associated with an identifier corresponding to a student;
for each assessment content object of at least some of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data;
identifying an answer indicated in the portion of the content-object data based at least partly on generating a first statistic corresponding to the portion of the content-object data and comparing the first statistic to one or more thresholds; and
generating a score to be associated with the assessment content object based at least partly on the answer indicated in the portion of the content-object data, the score indicative as to whether the answer was accurate;
aggregating the scores associated with the at least some of the set of assessment content objects;
generating a second statistic based on the aggregated scores; and
facilitating a presentation of the second statistic as indicative of accuracies of the answers indicated in the portions of the content-object data from at least some of the set of assessment content objects.
16. The computer-program product as recited in claim 15 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion includes converting the extracted portion of the content-object data to text; and
generating the score includes automatically assessing the text.
17. The computer-program product as recited in claim 15 , wherein, for an assessment content object of the at least some of the set of assessment content objects:
identifying the answer indicated in the portion of the content-object data includes automatically evaluating the portion of the content-object data to identify the answer.
18. The computer-program product as recited as recited in claim 15 , wherein the set of assessment content objects is larger than the at least some of the set of assessment content objects, and wherein the actions further include:
for another assessment content object of the set of assessment content objects:
determining that the assessment content object corresponds to an identifier of a template for a particular assessment, the template identifying segment-position specification that at least partly defines an area in which an answer for a question is to have been provided;
identifying a portion of the content-object data as corresponding to an answer area for the question based on the segment-position specification and the spatial arrangement;
extracting the portion of the content-object data; and
identifying an answer indicated in the portion of the content-object data; and
generating a score to be associated with the assessment content object based at least partly on the answer;
re-aggregating the scores associated with the at least some of the set of assessment content objects and the score associated with the other assessment content object;
generating an updated statistic based on the re-aggregated scores; and
facilitating an updated presentation of the updated statistic.