Scalable and effective document summarization framework
Systems, methods, and apparatuses are disclosed for adaptively generating a summary of web-based content based on an attribute of a mobile communication device having transmitted a request for the web-based content. By adaptively generating the summary based on an attribute of the mobile communication device such as an amount of visual space available or a number of characters permitted in the interface, a display of the web-based content may be controlled on the mobile communication device in a way that was not previously available. This enables control of displaying web-based content that has been adaptively generated to be displayed on limited display screens based on a learned attribute of the mobile communication device requesting the web-based content.
1. A summarization engine comprising:
a memory configured to store a document including textual information;
an interface configured to receive a viewing request from a communication device, the viewing request corresponding to the document; and
a processor configured to:
in response to receiving the viewing request, determine a target summary length, wherein the target summary length identifies a targeted length for a generated summary;
assign each sentence structure, of a plurality of sentence structures of the document, a weighted score based on the target summary length; and
generate, in accordance with a summarization policy, a summary of the document based on one or more weighted scores associated with one or more sentence structures of the plurality of sentence structures.
2. The summarization engine of claim 1 , wherein the processor is configured to generate the weighted score by:
determining a position of each sentence structure within the document; and
generating the weighted score of each sentence structure based on the position of each corresponding sentence structure.
3. The summarization engine of claim 1 , wherein the processor is configured to generate the weighted score by:
determining a content of each sentence structure within the document; and
generating the weighted score of each sentence structure based on the content of each corresponding sentence structure.
4. The summarization engine of claim 1 , wherein the processor is configured to generate the weighted score by:
identifying one or more tokens from each sentence structure, wherein each identified token corresponds to a token type; and
generating the weighted score of each sentence structure based on the token type of each identified token of each corresponding sentence structure.
5. The summarization engine of claim 1 , wherein the processor is configured to generate the weighted score by:
identifying one or more lexical cues from each sentence structure; and
generating the weighted score of each sentence structure based on the one or more lexical cues of each corresponding sentence structure.
6. The summarization engine of claim 1 , wherein the target summary length is included in the viewing request; and
wherein the processor is configured to determine the target summary length by extracting the target summary length from the viewing request.
7. The summarization engine of claim 1 , wherein the target summary length corresponds to an attribute of the communication device transmitting the viewing request.
8. A method for generating a summary of a document, the method comprising:
receiving, through an interface, a viewing request from a communication device, the viewing request corresponding to a document including textual information;
in response to receiving the viewing request, determining a target summary length;
assigning each sentence structure, of a plurality of sentence structures of the document, a weighted score based on the target summary length; and
generating, in accordance with a summarization policy, a summary of the document.
9. The method of claim 8 , comprising generating the weighted score by:
determining a position of each sentence structure within the document; and
generating the weighted score of each sentence structure based on the position of each corresponding sentence structure.
10. The method of claim 8 , comprising generating the weighted score by:
determining a content of each sentence structure within the document; and
generating the weighted score of each sentence structure based on the content of each corresponding sentence structure.
11. The method of claim 8 , comprising generating the weighted score by:
identifying one or more tokens from each sentence structure, wherein each identified token corresponds to a token type; and
generating the weighted score of each sentence structure based on the token type of each identified token of each corresponding sentence structure.
12. The method of claim 8 , wherein assigning each sentence structure the weighted score based on the target summary length comprises:
scoring each sentence structure as it appears in the document; and
scoring each sentence structure as it appears in a partial summary including one or more sentence structures already selected from the document.
13. The method of claim 8 , comprising selecting, from candidate summaries, the summary based on a function.
14. The method of claim 8 , comprising:
considering each sentence structure included in the document;
revising each sentence score corresponding to a considered sentence structure; and
adding a sentence structure, determined to have a score exceeding a threshold, to a candidate summary.
15. The method of claim 8 , comprising:
considering each sentence structure in the document that appears after every sentence structure in a partial summary;
revising each sentence score corresponding to a considered sentence structure; and
adding a sentence structure, determined to have a score exceeding a threshold, to a candidate summary.
16. The method of claim 8 , comprising:
considering each sentence structure in the document that appears at a tho beginning or end of a paragraph in the document;
revising each sentence score corresponding to a considered sentence structure; and
adding a sentence structure, determined to have a score exceeding a threshold, to a candidate summary.
17. A method for generating a summary of a document, the method comprising:
receiving, through an interface, a viewing request from a communication device, the viewing request corresponding to a document including textual information;
in response to receiving the viewing request, determining a target summary length;
assigning each sentence structure, of a plurality of sentence structures of the document, a weighted score based on the target summary length; and
generating a summary of the document based on one or more weighted scores associated with one or more sentence structures of the plurality of sentence structures.
18. The method of claim 17 , wherein the target summary length is included in the viewing request; and
wherein the method comprises determining the target summary length by extracting the target summary length from the viewing request.
19. The method of claim 17 , wherein the target summary length corresponds to an attribute of the communication device transmitting the viewing request.
20. The method of claim 17 , comprising selecting, from a plurality of candidate summaries, the summary based on a function.