IP Library Granted Patent US 10,038,818
Granted Patent B2
US 10,038,818 · App. 15/614,373 · Granted Jul 31, 2018

Local enhancement of large scanned documents

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,038,818
App. No.
15/614,373
Granted
Jul 31, 2018
Kind
B2
Abstract

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, determining at least one of the segments for enhancement, directing a user to take photographs with a smartphone to provide a separate segment image for the at least one of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment image to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the at least one of the segments.

Claims (47)

1. A method of enhancing image quality of an initial full image of a document, comprising:

enabling display of the initial full image on a display of a mobile device associated with a user;

subdividing the initial full image of the document into a number of segments;

determining at least one of the segments of the document for enhancement;

in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and

merging the separate segment image into the initial full image to provide an enhanced full image.

2. The method of claim 1 , wherein the capturing instruction further comprises an instruction to present on a display of the mobile device a view of the document having lines superimposed thereon according to the segments of the document, wherein the lines are configured to facilitating taking the photograph.

3. The method of claim 2 , further comprising:

in response to obtaining the separate segment image corresponding to the at least one of the segments, enabling display of a visual indicator on the at least one of the segments in the view of the document having the lines superimposed thereon corresponding to the segments.

4. The method of claim 1 , further comprising:

determining the number of segments according to at least a size of text in the initial full image and a desired height of text in the enhanced full image.

5. The method of claim 1 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a notebook application, a sticky note application, and an easel.

6. The method of claim 1 , further comprising:

enabling display of an arrow for indicating a next one of the segments to photograph and a navigation path across a subset of non-captured segments, wherein the next one of the segments follows the at least one of the segments on the navigation path and is recommended for being captured in a second separate segment image.

7. The method of claim 6 , further comprising:

in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, adjusting the navigation path to include the particular segment.

8. The method of claim 6 , further comprising:

in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, enabling an option to delete a segment image corresponding to the particular segment.

9. The method of claim 6 , further comprising:

in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, providing an option to indicate that a segment image corresponding to the particular segment is distinct from the next one of the segments.

10. A computer system, comprising:

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

enabling display of the initial full image on a display of a mobile device associated with a user;

subdividing the initial full image of the document into a number of segments;

determining at least one of the segments of the document for enhancement;

in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and

merging the separate segment image into the initial full image to provide an enhanced full image.

11. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:

determining the number of segments according to at least a size of text in the initial full image and a desired height of text in the enhanced full image.

12. The computer system of claim 10 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a notebook application, a sticky note application, and an easel.

13. The computer system of claim 10 , wherein the initial full image is provided by a photograph taken by the user with the mobile device.

14. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:

determining a quality of the separate segment image taken for the at least one of the segments; and

in accordance with a determination that the quality of the separate segment image is substantially low, automatically deleting the separate segment image.

15. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:

providing an option to delete an image in response to detecting an obstructions in the separate segment image.

16. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system, the one or more programs comprising instructions for:

enabling display of the initial full image on a display of a mobile device associated with a user;

subdividing the initial full image of the document into a number of segments;

determining at least one of the segments of the document for enhancement;

in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and

merging the separate segment image into the initial full image to provide an enhanced full image.

17. The non-transitory computer readable storage medium of claim 16 , wherein the capturing instruction further comprises an instruction to present on a display of the mobile device a view of the document having lines superimposed thereon according to the segments of the document, wherein the lines are configured to facilitating taking the photograph.

18. The non-transitory computer readable storage medium of claim 17 , wherein the one or more programs further comprise instructions for:

in response to obtaining the separate segment image corresponding to the at least one of the segments, enabling display of a visual indicator on the at least one of the segments in the view of the document having the lines superimposed thereon corresponding to the segments.

19. The non-transitory computer readable storage medium of claim 16 , wherein the mobile device includes memory storing one or more of: a program that is pre-loaded with the mobile device, a program that is installed from an application store, a program that is installed from a desktop, a program that is installed from media, and a program that is downloaded from a web site.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2023
From: MUFG BANK, LTD.
To: EVERNOTE CORPORATION
Reel/Frame 063116/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 8, 2021
From: EAST WEST BANK
To: EVERNOTE CORPORATION
Reel/Frame 057852/0078 →
SECURITY INTEREST Recorded Oct 6, 2021
From: EVERNOTE CORPORATION
To: MUFG UNION BANK, N.A.
Reel/Frame 057722/0876 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 048513/ 0003 Recorded Oct 22, 2020
From: HERCULES CAPITAL, INC.
To: EVERNOTE CORPORATION
Reel/Frame 054178/0892 →
SECURITY INTEREST Recorded Oct 19, 2020
From: EVERNOTE CORPORATION
To: EAST WEST BANK
Reel/Frame 054113/0876 →
SECURITY INTEREST Recorded Mar 5, 2019
From: EVERNOTE CORPORATION; EVERNOTE GMBH
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 048513/0003 →