IP Library Granted Patent US 9,674,396
Granted Patent B1
US 9,674,396 · App. 14/967,462 · Granted Jun 6, 2017

Matrix capture of large scanned documents

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,674,396
App. No.
14/967,462
Granted
Jun 6, 2017
Kind
B1
Abstract

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment images to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The initial full image may be provided by a photograph taken by the user with the smartphone. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the segments.

Claims (38)

1. A method of enhancing image quality of an initial full image of a document, comprising:

subdividing the initial full image of the document into a number of segments;

directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments; and

merging the separate segment images to provide an enhanced full image.

2. A method, according to claim 1 , wherein the number of segments depends upon a size of text in the initial full image and a desired height of text in the enhanced full image.

3. A method, according to claim 1 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a specialized Moleskine® notebook, a specialized Moleskine® sticky note, and an easel.

4. A method, according to claim 1 , wherein the initial full image is provided by a photograph taken by the user with the smartphone.

5. A method, according to claim 1 , wherein the view of the document having lines superimposed thereon corresponding to the segments provides a target to the user for photographing the segments.

6. A method, according to claim 1 , wherein, in response to the user successfully photographing a particular segment, a visual indicator is provided on the particular segment in the view of the document having lines superimposed thereon corresponding to the segments.

7. A method, according to claim 1 , wherein instructions for photographing non-captured segments are provided to the user on the screen of the smartphone.

8. A method, according to claim 7 , wherein the instructions include an arrow indicating a recommended next one of the segments to photograph and a recommended navigation path across non-captured segments.

9. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the navigation path is adjusted.

10. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to delete the segment image corresponding to the particular segment.

11. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to indicate that the corresponding segment image is for a different segment in the view of the document having lines superimposed thereon corresponding to the segments.

12. A method, according to claim 1 , wherein the smartphone automatically detects which of the segments has been photographed by the user.

13. A method, according to claim 1 , wherein a captured image is automatically deleted in response to a quality of the image being relatively low.

14. A method, according to claim 1 , wherein a user is provided with an option to delete an image in response to obstructions being detected in the image.

15. A method, according to claim 1 , wherein the smartphone includes at least one of: software that is pre-loaded with the smartphone, software that is installed from an app store, software that is installed from a desktop, software that is installed from media, and software that is downloaded from a Web site.

16. A method, according to claim 1 , wherein the smartphone uses an operating system selected from the group consisting of: iOS, Android OS, Windows Phone OS, Blackberry OS and mobile versions of Linux OS.

17. A non-transitory computer-readable medium containing software that enhances image quality of an initial full image of a document, the software comprising:

executable code that subdivides the initial full image of the document into a number of segments;

executable code that directs a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments; and

executable code that merges the separate segment images to provide an enhanced full image.

18. A non-transitory computer-readable medium, according to claim 17 , wherein the number of segments depends upon a size of text in the initial full image and a desired height of text in the enhanced full image.

19. A non-transitory computer-readable medium, according to claim 17 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a specialized Moleskine® notebook, a specialized Moleskine® sticky note, and an easel.

20. A non-transitory computer-readable medium, according to claim 17 , wherein the initial full image is provided by a photograph taken by the user with the smartphone.

21. A non-transitory computer-readable medium, according to claim 17 , wherein the view of the document having lines superimposed thereon corresponding to the segments provides a target to the user for photographing the segments.

22. A non-transitory computer-readable medium, according to claim 17 , wherein, in response to the user successfully photographing a particular segment, a visual indicator is provided on the particular segment in the view of the document having lines superimposed thereon corresponding to the segments.

23. A non-transitory computer-readable medium, according to claim 17 , wherein instructions for photographing non-captured segments are provided to the user on the screen of the smartphone.

24. A non-transitory computer-readable medium, according to claim 23 , wherein the instructions include an arrow indicating a recommended next one of the segments to photograph and a recommended navigation path across non-captured segments.

25. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the navigation path is adjusted.

26. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to delete the segment image corresponding to the particular segment.

27. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to indicate that the corresponding segment image is for a different segment in the view of the document having lines superimposed thereon corresponding to the segments.

28. A non-transitory computer-readable medium, according to claim 17 , wherein the smartphone automatically detects which of the segments has been photographed by the user.

29. A non-transitory computer-readable medium, according to claim 17 , wherein a captured image is automatically deleted in response to a quality of the image being relatively low.

30. A non-transitory computer-readable medium, according to claim 17 , wherein a user is provided with an option to delete an image in response to obstructions being detected in the image.

31. A non-transitory computer-readable medium, according to claim 17 , wherein the smartphone includes at least one of: software that is pre-loaded with the smartphone, software that is installed from an app store, software that is installed from a desktop, software that is installed from media, and software that is downloaded from a Web site.

32. A non-transitory computer-readable medium, according to claim 17 , wherein the smartphone uses an operating system selected from the group consisting of: iOS, Android OS, Windows Phone OS, Blackberry OS and mobile versions of Linux OS.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2023
From: MUFG BANK, LTD.
To: EVERNOTE CORPORATION
Reel/Frame 063116/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 8, 2021
From: EAST WEST BANK
To: EVERNOTE CORPORATION
Reel/Frame 057852/0078 →
SECURITY INTEREST Recorded Oct 6, 2021
From: EVERNOTE CORPORATION
To: MUFG UNION BANK, N.A.
Reel/Frame 057722/0876 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 040192/0720 Recorded Oct 22, 2020
From: SILICON VALLEY BANK
To: EVERNOTE CORPORATION
Reel/Frame 054145/0452 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 040240/0945 Recorded Oct 22, 2020
From: HERCULES CAPITAL, INC.
To: EVERNOTE CORPORATION; EVERNOTE GMBH
Reel/Frame 054213/0234 →
SECURITY INTEREST Recorded Oct 19, 2020
From: EVERNOTE CORPORATION
To: EAST WEST BANK
Reel/Frame 054113/0876 →
SECURITY INTEREST Recorded Oct 5, 2016
From: EVERNOTE CORPORATION; EVERNOTE GMBH
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 040240/0945 →
SECURITY AGREEMENT Recorded Sep 30, 2016
From: EVERNOTE CORPORATION
To: SILICON VALLEY BANK
Reel/Frame 040192/0720 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2016
From: PASHINTSEV, ALEXANDER; GORBATOV, BORIS; KITAINIK, LEONID
To: EVERNOTE CORPORATION
Reel/Frame 037867/0413 →