Performing electronic document segmentation using deep neural networks

1. A computer-implemented method comprising:

accessing, by a processing device, a document image that is a captured image of a document;

segmenting the document image into a plurality of overlapping strips;

generating a plurality of masks indicating one or more elements and element types in the plurality of overlapping strips by applying a predictive neural network to:

a given strip of the plurality of overlapping strips, and

a portion of a previously-generated mask of an adjacent strip of the plurality of overlapping strips, the portion of the previously-generated mask of the adjacent strip corresponding to a portion of the given strip that overlaps with the adjacent strip;

generating, from the plurality of masks, a combined mask that indicates elements and corresponding element types present in the document; and

creating, from the combined mask, a segmented electronic version of the document that identifies the elements and corresponding element types.

2. The method of claim 1 , further comprising generating a mask for a first strip by applying the predictive neural network to the first strip and a previously generated blank mask.

3. The method of claim 2 , wherein segmenting the document image into a plurality of overlapping strips comprises:

creating the first strip by extracting a first portion of the document image, wherein the first portion extends from an edge of the document image by a width and comprises an intermediate point; and

creating a second strip by extracting a second portion of the document image, wherein the second portion extends from the intermediate point by the width.

4. The method of claim 1 , wherein the predictive neural network comprises an encoder, a reconstruction decoder, a recurrent neural network, and a plurality of segmentation decoders.

5. The method of claim 4 , further comprising, for the given strip and corresponding portion of the previously-generated mask of the adjacent strip:

generating, utilizing the encoder and the recurrent neural network, one or more feature maps; and

generating, utilizing the plurality of segmentation decoders, one or more masks indicating the elements and the corresponding element types present in the given strip.

6. The method of claim 5 , wherein generating, utilizing the plurality of segmentation decoders, the one or more masks indicating the elements and the corresponding element types present in the given strip comprises generating a respective mask for each element type utilizing the plurality of segmentation decoders.

7. The method of claim 6 , further comprising combining the respective mask for each element type for each strip to generate a plurality of combined masks, each combined mask indicating a respective element type present in the document.

8. The method as recited in claim 7 , further comprising generating, utilizing the reconstruction decoder, an electronic version of the document.

9. The method as recited in claim 8 , wherein creating, from the combined mask, the segmented electronic version of the document comprising combining the electronic version of the document and the plurality of combined masks.

10. The method of claim 1 , wherein an element type is one of a border, a field, a choice field, a background, a text box, a widget, or an image.

11. A non-transitory computer-readable medium having program code stored thereon that, when executed by a processing device, causes the processing device to perform operations comprising:

accessing a document image that is a captured image of a document;

segmenting the document image into a plurality of overlapping strips;

generating, utilizing a predictive neural network, a plurality of strip masks indicating one or more elements and element types in the plurality of overlapping strips;

generating, from the plurality of strip masks, a plurality of combined masks that each indicate elements of a given element type present in the document;

generating, utilizing the predictive neural network, an electronic version of the document; and

creating, from the plurality of combined masks and the electronic version of the document, a segmented electronic version of the document that identifies the elements and corresponding element types.

12. The non-transitory computer-readable medium of claim 11 , wherein generating the plurality of strip masks indicating one or more elements and element types in the plurality of overlapping strips comprises applying the predictive neural network to:

a given strip of the plurality of overlapping strips, and

a portion of a previously-generated mask of an adjacent strip of the plurality of overlapping strips, the portion of the previously-generated mask of the adjacent strip corresponding to a portion of the adjacent strip that overlaps with the given strip.

13. The non-transitory computer-readable medium of claim 12 , wherein the predictive neural network comprises an encoder, a reconstruction decoder, a recurrent neural network, and a plurality of segmentation decoders.

14. The non-transitory computer-readable medium of claim 13 , further comprising generating one or more feature maps for the plurality of overlapping strips utilizing the encoder and the recurrent neural network.

15. The non-transitory computer-readable medium of claim 14 , wherein generating, utilizing the predictive neural network, the electronic version of the document comprises generating the electronic version of the document from the one or more feature maps utilizing the reconstruction decoder.

16. The non-transitory computer-readable medium of claim 14 , wherein generating, from the plurality of strip masks, the plurality of combined masks that each indicate elements of a given element type present in the document comprises utilizing each segmentation decoder of the plurality of segmentation decoders to generate a combined mask for a respective element type.

17. A system comprising:

a computer memory device comprising an document image of a document and a predictive neural network; and

at least one processor configured to cause the system to:

segment the document image into a plurality of overlapping strips;

generate, utilizing the predictive neural network, a first plurality of strip masks indicating elements of a first element type in the plurality of overlapping strips;

generate, from the first plurality of strip masks, a first combined mask indicating elements of the first element type present in the document;

generate, utilizing the predictive neural network, a second plurality of strip masks indicating elements of a second element type in the plurality of overlapping strips;

generate, from the second plurality of strip masks, a second combined mask indicating elements of the first element type present in the document;

generate, utilizing the predictive neural network, an electronic version of the document; and

create, from the first and second combined masks and the electronic version of the document, a segmented electronic version of the document that identifies the elements of the first and second element type in the electronic version of the document.

18. The system of claim 17 , wherein the at least one processor is configured to cause the system to generate the first and second plurality of strip masks by applying the predictive neural network to: a given strip of the plurality of overlapping strips, and a portion of a previously-generated mask of an adjacent strip of the plurality of overlapping strips, the portion of the previously-generated mask of the adjacent strip corresponding to a portion of the adjacent strip that overlaps with the given strip.

19. The system of claim 17 , wherein:

the predictive neural network comprises an encoder, a reconstruction decoder, a recurrent neural network, and a plurality of segmentation decoders;

the at least one processor is configured to cause the system to:

generate one or more feature maps for the plurality of overlapping strips utilizing the encoder and the recurrent neural network; and

generate, utilizing the predictive neural network, the electronic version of the document by processing the one or more feature maps utilizing the reconstruction decoder.

20. The system of claim 19 , wherein the at least one processor is configured to cause the system to generate, from the first plurality of strip masks, the first combined mask by utilizing a first segmentation decoder of the plurality of segmentation decoders to generate the first combined mask from the one or more feature maps.