Document processing for reducing data usage
Apparatuses and methods relate generally to reducing data usage by a document processing system. In one such method, a segmented layout of a page from a preprocessed image thereof is detected. Components of the layout are separated into one or more blocks. Each type of the one or more blocks are identified. A block of the one or more blocks identified as a text block is converted to text. Meta information for the block is stored. A formatted page for the page including the text and the meta information is constructed. It is determined whether the formatted page has a smaller storage size than the preprocessed image associated with the formatted page.
1 . A method for reducing data usage by a document processing system, comprising:
detecting a segmented layout of a page from a preprocessed image thereof;
separating components of the layout into one or more blocks;
identifying each type of the one or more blocks;
converting a block of the one or more blocks identified as a text block to text;
storing meta information for the block;
constructing a formatted page for the page including the text and the meta information;
determining whether the formatted page has a smaller storage size than the preprocessed image associated with the formatted page;
responsive to the formatted page not having a smaller storage size than the preprocessed image, processing the preprocessed image with a scan-to-store or scan-to-send operation of the document processing system; and
responsive to the formatted page having a smaller storage size than the preprocessed image, using the formatted page in place of the scan-to-store or scan-to-send operation of the preprocessed image.
2 . The method according to claim 1 , wherein the one or more blocks are two or more blocks, and wherein the block is a first block, the method further comprising:
separating a second block of the two or more blocks from the preprocessed image of the page identified as an image block;
converting the image block into an object; and
wherein the constructing of the formatted page for the page includes the text, the meta information, and the object.
3 . The method according to claim 2 , wherein the detecting, the separating of the first block, the separating of the second block, the identifying, the converting of the text block, and the converting of the image block are performed in software.
4 . The method according to claim 3 , wherein the software is LayoutLMv3.
5 . The method according to claim 1 , further comprising:
separating one or more lines of the layout;
converting the one or more lines of the layout into drawing commands;
wherein the constructing of the formatted page for the page includes the text, the meta information, the object, and the drawing commands.
6 . The method according to claim 5 , wherein:
the drawing commands are portable document format drawing commands; and
the formatted page is a portable document format page.
7 . The method according to claim 6 , wherein the image block is a picture or a table.
8 . The method according to claim 5 , further comprising responsive to the formatted page having a smaller storage size than the preprocessed image of the page, sending the formatted page from the document processing system in place of the preprocessed image.
9 . The method according to claim 5 , further comprising:
responsive to the formatted page having a smaller storage size than the preprocessed image of the page, storing the formatted page from the document processing system in place of the preprocessed image; and
distributing the formatted page responsive to a send command.
10 . The method according to claim 9 , wherein the formatted page is stored in page form.
11 . The method according to claim 10 , wherein the first block is converted to text with optical character recognition of the document processing system.
12 . An apparatus, comprising:
a document processing system with a system memory, a data storage, one or more processor units, and an interface;
the system memory configured to store program code including document services;
the interface coupled for receiving user requests for the document services;
wherein, in response to executing the program code, the document processing system is configured to initiate operations for implementing a process for reducing data usage, the process including:
detecting a segmented layout of a page from a preprocessed image thereof;
separating components of the layout into one or more blocks;
identifying each type of the one or more blocks;
converting a block of the one or more blocks identified as a text block to text;
storing meta information for the block;
constructing a formatted page for the page including the text and the meta information; and
determining whether the formatted page has a smaller storage size than the preprocessed image associated with the formatted page;
responsive to the formatted page not having a smaller storage size than the preprocessed image, processing the preprocessed image with a scan-to-store or scan-to-send operation of the document processing system; and
responsive to the formatted page having a smaller storage size than the preprocessed image, using the formatted page in place of the scan-to-store or scan-to-send operation of the preprocessed image.
13 . The apparatus according to claim 12 , wherein the one or more blocks are two or more blocks, and wherein the block is a first block, the process further comprising:
separating a second block of the two or more blocks from the preprocessed image of the page identified as an image block;
converting the image block into an object; and
wherein the constructing of the formatted page for the page includes the text, the meta information, and the object.
14 . The apparatus according to claim 13 , wherein the detecting, the separating of the first block, the separating of the second block, the identifying, the converting of the text block, and the converting of the image block are performed in software.
15 . The apparatus according to claim 13 , wherein the process further comprises:
separating one or more lines of the layout;
converting the one or more lines of the layout into drawing commands;
wherein the constructing of the formatted page for the page includes the text, the meta information, the object, and the drawing commands.
16 . The apparatus according to claim 15 , wherein:
the drawing commands are portable document format drawing commands;
the formatted page is a portable document format page; and
the image block is a picture or a table.
17 . The apparatus according to claim 15 , further comprising responsive to the formatted page having a smaller storage size than the preprocessed image of the page, sending the formatted page from the document processing system in place of the preprocessed image.
18 . The apparatus according to claim 15 , further comprising:
responsive to the formatted page having a smaller storage size than the preprocessed image of the page, storing the formatted page from the document processing system in place of the preprocessed image; and
distributing the formatted page responsive to a send command.
19 . The apparatus according to claim 18 , wherein the formatted page is stored in page form.
20 . The apparatus according to claim 19 , wherein the first block is converted to text with optical character recognition of the document processing system.