IP Library Granted Patent US 9,886,629
Granted Patent B2
US 9,886,629 · App. 15/138,349 · Granted Feb 6, 2018

Techniques for restoring content from a torn document

Inventors: Ajay Jain (Ghaziabad, IN); Ram Bhushan Agrawal (Noida, IN)
Assignee: Adobe Systems Incorporated
G06K9/00456G06K9/036G06K9/18G06K9/2081G06T7/0028G06T7/0085G06T7/408G06T2207/10008G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,886,629
App. No.
15/138,349
Granted
Feb 6, 2018
Kind
B2
Abstract

Disclosed are various embodiments for digitally restoring content from a torn document. A computing device obtains an image of a document that has a tear. The computing device identifies portions of the image separated by a gap region representing the tear in the document. Content in the portions of the image adjacent to the gap region is then identified. The position of a portion of the image is incrementally adjusted to reduce the gap region without overlapping the portions. The position of the portion is adjusted to align the content along a boundary between the portions of the image.

Claims (42)

1. A method for digitally restoring content from a torn document, the method comprising:

obtaining, from a client computing device, an image of a document that has a tear;

identifying, by a restoration service executed in a computing environment, portions of the image and a gap region representing the tear in the document, wherein the portions of the image are separated by the gap region;

distinguishing, by the restoration service, the gap region from the portions of the image based on a distinction between (i) a first characteristic of pixels included in the portions of the image and (ii) a second characteristic of pixels included in the gap region;

identifying, by the restoration service, content in each of the portions of the image adjacent to the gap region, wherein identifying the content comprises identifying characters in the portions of the image by performing optical character recognition (OCR) on the content present in the portions of the image; and

incrementally adjusting, by the restoration service, a position of at least one of the portions of the image relative to another of the portions of the image, to reduce separation in the gap region without overlapping the portions, wherein:

the position of the at least one portion is adjusted to align the content along a boundary between the portions of the image to form an identifiable sequence of the characters along the boundary, and

the adjustment of the position of the at least one portion is based on the first characteristic, wherein the first characteristic is present in pixels included in the at least one portion and in pixels included in the another of the portions of the image.

2. The method of claim 1 , further comprising coloring remaining pixels of the gap region based upon color sampling adjacent pixels, wherein said coloring occurs once the content is aligned along the boundary between the portions of the image.

3. The method of claim 1 , wherein the gap region is identified based upon identifying a region in which a color or texture at a perimeter of the document represented in the image is also present between portions of the document represented in the image.

4. The method of claim 1 , wherein the gap region is identified based upon input received from a user specifying a portion of the gap region.

5. The method of claim 1 , wherein said identifying the content further comprises identifying shapes of edges of the portions of the image adjacent to the gap region.

6. The method of claim 1 , wherein identifying the gap region comprises:

applying a binarization filter to the image to produce a binarized version of the image; and

performing a connected component analysis (CCA) on the binarized version of the image that removes clusters of pixels whose size is smaller than a threshold size, wherein a remaining cluster of pixels is the gap region.

7. The method of claim 1 , wherein said first characteristic comprises colors of pixels along edges of the portions of the image adjacent to the gap region, and identifying the content further comprises identifying the colors of pixels included in the portions of the image.

8. The method of claim 7 , wherein said aligning the content along the boundary comprises adjusting the position of the at least one portion of the image based upon aligning the colors of the pixels along the edges.

9. The method of claim 1 , further comprising converting a quadrilateral representation of the document captured in the portions of the image into a rectangular representation, wherein said converting comprises:

identifying a plurality of boundaries of the document captured in the portions of the image; and

performing a perspective correction upon the boundaries of the document.

10. The method of claim 1 , wherein said adjusting the position of the at least one of the portions of the image comprises adjusting at least one of a horizontal position, a vertical position, and an angular position of the at least one of the portions of the image.

11. A non-transitory computer-readable medium embodying a program comprising code for digitally restoring content from a torn document, the program, when executed in a computing device, causes the computing device to:

obtain an image of a document that has a tear;

identify portions of the image and a gap region representing the tear in the document, wherein the portions of the image are separated by the gap region;

distinguish the gap region from the portions of the image based on a distinction between (i) a first characteristic of pixels included in the portions of the image and (ii) a second characteristic of pixels included in the gap region;

identify content in each of the portions of the image adjacent to the gap region, wherein identifying the content comprises identifying characters in the portions of the image by performing optical character recognition (OCR) on the content present in the portions of the image; and

adjust a position of at least one of the portions of the image relative to another of the portions of the image, to reduce separation in the gap region without overlapping the portions, wherein:

the position of the at least one portion is adjusted to align the content along a boundary between the portions of the image to form an identifiable sequence of the characters along the boundary, and

the adjustment of the position of the at least one portion is based on the first characteristic, wherein the first characteristic is present in pixels included in the at least one portion and in pixels included in the another of the portions of the image.

12. The non-transitory computer-readable medium of claim 11 , the program further comprises code that colors any remaining pixels of the gap region based upon color sampling adjacent pixels, wherein said coloring occurs once the content is aligned along the boundary between the portions of the image.

13. The non-transitory computer-readable medium of claim 11 , wherein the program further comprises code that identifies the gap region based upon identifying a region in which a color or texture at a perimeter of the document represented in the image is also present between portions of the document represented in the image.

14. A computing device, comprising:

a memory for storing a restoration service comprising computer-implemented instructions for digitally restoring content from a torn document; and

a processor for executing the computer-implemented instructions of the restoration service and thereby causing the processor to:

obtain an image of a document that has a tear;

identify portions of the image and a gap region representing the tear in the document, wherein the portions of the image are separated by the gap region;

distinguish the gap region from the portions of the image based on a distinction between (i) a first characteristic of pixels included in the portions of the image and (ii) a second characteristic of pixels included in the gap region;

identify content in each of the portions of the image adjacent to the gap region, wherein identifying the content comprises identifying characters in the portions of the image by performing optical character recognition (OCR) on the content present in the portions of the image; and

adjust a position of at least one of the portions of the image relative to another of the portions of the image, to reduce separation in the gap region without overlapping the portions, wherein:

the position of the at least one portion is adjusted to align the content along a boundary between the portions of the image to form an identifiable sequence of the characters along the boundary, and

the adjustment of the position of the at least one portion is based on the first characteristic, wherein the first characteristic is present in pixels included in the at least one portion and in pixels included in the another of the portions of the image.

15. The computing device of claim 14 , wherein the computer-implemented instructions further cause the processor to color remaining pixels of the gap region based upon color sampling adjacent pixels, wherein said coloring occurs once the content is aligned along the boundary between the portions of the image.

Assignments (2)
CHANGE OF NAME Recorded Mar 6, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048525/0042 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2016
From: JAIN, AJAY; AGRAWAL, RAM BHUSHAN
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 038380/0673 →
Continuity (1)
Related Publication 20170308745A1 · Oct 26, 2017