Paragraph property detection and style reconstruction engine
Embodiments of the present disclosure provide for analyzing paragraphs in a fixed format document to determine style clusters or groupings of each paragraph. In certain embodiments, the paragraphs are grouped into style clusters based on a first property. Each style cluster is then further divided into sub-groups based on a second property. Once the sub-groups have been determined, a third property associated with each paragraph in each sub-group is normalized based on a dominant one of the at least the third property.
1. A method for converting a fixed format document containing text runs with common formatting into a flow format document, the method comprising the acts of:
analyzing a fixed format document to determine a plurality of properties associated with a plurality of paragraphs contained in the fixed format document, wherein the determined plurality of properties include a paragraph property and a character property;
associating each paragraph property and each character property with a discrete value or with a continuous value, wherein the discrete value comprises a numerical value and the continuous value comprises a numerical interval;
determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph;
grouping each of the plurality of paragraphs into clusters according to a common dominant character property;
dividing each cluster of paragraphs into a plurality of sub-clusters of paragraphs, wherein each sub-cluster of paragraphs has a common paragraph property discrete value or a common character property discrete value that is different from the common dominant character property discrete value;
for the paragraphs in each of the plurality of sub-clusters, determining that the paragraphs have a common paragraph property or a common character property associated with a plurality of different intervals of continuous values, and normalizing those plurality of different intervals to a single numerical value;
associating the single numerical value with the common paragraph property or common character property previously associated with the continuous value;
determining a style for each paragraph of the document based on: (a) the dominant common character property discrete value; (b) the common paragraph property discrete value or the common character property discrete value that is different from the dominant common character property discrete value; and (c) the normalized single numerical value of the common paragraph property or common character property that was previously associated with the continuous value; and
mapping each paragraph to a flow format document with its determined style.
2. The method of claim 1 , wherein determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph includes determining a percentage of common discrete values associated with a common character property associated with each respective paragraph exceeding a predetermined threshold value.
3. The method of claim 1 , wherein the paragraph property comprises a paragraph alignment property, a line indentation property, a line spacing property, a paragraph spacing property, paragraph border property or a paragraph shading property.
4. The method of claim 1 , wherein the character property comprises a font typeset property, a font color property, a font size property, a font effect property, or a character shading property.
5. The method of claim 4 , wherein the font effect property comprises an underline, strikethrough, bold, or italic property.
6. The method of claim 4 , wherein the style comprises a Heading style or a Normal style.
7. The method of claim 6 , wherein the Normal style comprises the most frequently occurring paragraph style.
8. The method of claim 7 , wherein the most frequently occurring paragraph style is determined based on the greatest number of characters associated with a specific paragraph style.
9. A system for converting a fixed format document containing text elements into a flow format document, the system comprising:
a document processing unit; and
a memory containing computer executable constructions which, when executed by the document processing unit, cause the system to perform:
analyzing a fixed format document to determine a plurality of properties associated with a plurality of paragraphs contained in the fixed format document, wherein the determined plurality of properties include a paragraph property and a character property;
associating each paragraph property and each character property with a discrete value or with a continuous value, wherein the discrete value comprises a numerical value and the continuous value comprises a numerical interval;
determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph;
grouping each of the plurality of paragraphs into clusters according to a common dominant character property;
dividing each cluster of paragraphs into a plurality of sub-clusters of paragraphs, wherein each sub-cluster of paragraphs has a common paragraph property discrete value or a common character property discrete value that is different from the common dominant character property discrete value;
for the paragraphs in each of the plurality of sub-clusters, determining that the paragraphs have a common paragraph property or a common character property associated with a plurality of different intervals of continuous values, and normalizing those plurality of different intervals to a single numerical value;
associating the single numerical value with the common paragraph property or common character property previously associated with the continuous value;
determining a style for each paragraph of the document based on: (a) the dominant common character property discrete value; (b) the common paragraph property discrete value or the common character property discrete value that is different from the dominant common character property discrete value; and (c) the normalized single numerical value of the common paragraph property or common character property that was previously associated with the continuous value; and
mapping each paragraph to a flow format document with its determined style.
10. The system of claim 9 , wherein determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph includes determining a percentage of common discrete values associated with a common character property associated with each respective paragraph exceeding a predetermined threshold value.
11. The system of claim 9 , wherein the paragraph property comprises a paragraph alignment property, a line indentation property, a line spacing property, a paragraph spacing property, paragraph border property or a paragraph shading property.
12. The system of claim 9 , wherein the character property comprises a font typeset property, a font color property, a font size property, a font effect property, or a character shading property.
13. The system of claim 12 , wherein the font effect property comprises an underline, strikethrough, bold, or italic property.
14. The system of claim 12 , wherein the style comprises a Heading style or a Normal style.
15. The system of claim 14 , wherein the Normal style comprises the most frequently occurring paragraph style.
16. The system of claim 15 , wherein the most frequently occurring paragraph style is determined based on the greatest number of characters associated with a specific paragraph style.
17. A hardware non-transitory computer-readable storage medium encoding computer executable instructions that, when executed by at least one processor, performs a method for converting a fixed format document containing text elements into a flow format document, the method comprising:
analyzing a fixed format document to determine a plurality of properties associated with a plurality of paragraphs contained in the fixed format document, wherein the determined plurality of properties include a paragraph property and a character property;
associating each paragraph property and each character property with a discrete value or with a continuous value, wherein the discrete value comprises a numerical value and the continuous value comprises a numerical interval;
determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph;
grouping each of the plurality of paragraphs into clusters according to a common dominant character property;
dividing each cluster of paragraphs into a plurality of sub-clusters of paragraphs, wherein each sub-cluster of paragraphs has a common paragraph property discrete value or a common character property discrete value that is different from the common dominant character property discrete value;
for the paragraphs in each of the plurality of sub-clusters, determining that the paragraphs have a common paragraph property or a common character property associated with a plurality of different intervals of continuous values, and normalizing those plurality of different intervals to a single numerical value;
associating the single numerical value with the common paragraph property or common character property previously associated with the continuous value;
determining a style for each paragraph of the document based on: (a) the dominant common character property discrete value; (b) the common paragraph property discrete value or the common character property discrete value that is different from the dominant common character property discrete value; and (c) the normalized single numerical value of the common paragraph property or common character property that was previously associated with the continuous value; and
mapping each paragraph to a flow format document with its determined style.
18. The hardware non-transitory computer-readable storage medium of claim 17 , wherein determining a dominant character property for each of the plurality of paragraphs based on a most commonly occurring character property discrete value within the respective paragraph includes determining a percentage of common discrete values associated with a common character property associated with each respective paragraph exceeding a predetermined threshold value.
19. The hardware non-transitory computer-readable storage medium of claim 17 , wherein the paragraph property comprises a paragraph alignment property, a line indentation property, a line spacing property, a paragraph spacing property, paragraph border property or a paragraph shading property.
20. The hardware non-transitory computer-readable storage medium of claim 17 , wherein the character property comprises a font typeset property, a font color property, a font size property, a font effect property, or a character shading property.
21. The hardware non-transitory computer-readable storage medium of claim 20 , wherein the font effect property comprises an underline, strikethrough, bold, or italic property.
22. The hardware non-transitory computer-readable storage medium of claim 20 , wherein the style comprises a Heading style or a Normal style.
23. The hardware non-transitory computer-readable storage medium of claim 22 , wherein the Normal style comprises the most frequently occurring paragraph style.
24. The hardware non-transitory computer-readable storage medium of claim 23 , wherein the most frequently occurring paragraph style is determined based on the greatest number of characters associated with a specific paragraph style.