IP Library Granted Patent US 10,121,232
Granted Patent B1
US 10,121,232 · App. 15/384,956 · Granted Nov 6, 2018

Visual quality of photographs with handwritten content

Inventors: Boris Gorbatov (Sunnyvale, CA); Eugene Livshitz (San Mateo, CA); Alexander Pashintsev (Cupertino, CA); Ilia Buriak (Moscow, RU); Natalia Galaktionova (Moscow, RU)
Assignee: EVERNOTE CORPORATION
G06T5/002G01B11/02G01B11/24G06K9/4638G06T5/005G06T2207/20192
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,121,232
App. No.
15/384,956
Granted
Nov 6, 2018
Kind
B1
Abstract

Improving visual quality of a raster image includes detecting connectivity components, detecting defects in each of the connectivity components based on a characteristic line width thereof, detecting segments in each of the connectivity components, detecting joints based on geometry of the connectivity components, creating a structural graph based on the segments and joints, and correcting the raster image according to the structural graph and detected ones of the defects. The joints may correspond to linear joints, T-joints, or X-joints. Detecting types of joints may include determining a configuration of adjacent segments in a proximity of each of the joints. A characteristic line width may be determined by determining co-boundaries on opposite sides of each of the segments and determining average distances between the co-boundaries. The raster image may be a binary black-and-white image of a line drawing obtained from a photograph or a scan of a handwritten document.

Claims (38)

1. A method of improving visual quality of a raster image, comprising:

detecting connectivity components;

detecting defects in each of the connectivity components;

detecting segments in each of the connectivity components;

detecting joints based on geometry of the connectivity components;

creating a structural graph based on the segments and joints; and

correcting the raster image according to the structural graph and detected ones of the defects.

2. A method, according to claim 1 , wherein the joints correspond to one of: linear joints, T-joints, and X-joints.

3. A method, according to claim 2 , wherein detecting types of joints includes determining a configuration of adjacent segments in a proximity of each of the joints.

4. A method, according to claim 2 , wherein a linear joint is detected by determining that an angle between axes of two segments in a proximity of a joint is approximately 180 degrees.

5. A method, according to claim 4 , wherein the two segments are joined to correct the linear joint.

6. A method, according to claim 2 , wherein a T-joint is detected by determining that an angle between axes of a first segment and a second segment in a proximity of a joint is approximately 180 degrees, an angle between the axis of the first segment and an axis of a third segment in a proximity of a joint is approximately 90 degrees and an angle between axes of the second segment and the third segment in a proximity of a joint is approximately 90 degrees.

7. A method, according to claim 6 , wherein uneven angles between the first, second, and third segments are sharpened to correct the T-joint.

8. A method, according to claim 2 , wherein an X-joint is detected by determining that an angle between axes of a first segment and a second segment in a proximity of a joint is approximately 90 degrees, an angle between the axis of the second segment and an axis of a third segment in a proximity of a joint is approximately 90 degrees, an angle between the axis of the third segment and an axis of a fourth segment in a proximity of a joint is approximately 90 degrees, and an angle between axes of the fourth segment and the first segment in a proximity of a joint is approximately 90 degrees.

9. A method, according to claim 8 , wherein uneven angles between the first, second, third, and fourth segments are sharpened to correct the X-joint.

10. A method, according to claim 1 , wherein the defects include holes and minor deviations from the characteristic line width.

11. A method, according to claim 10 , wherein the defects are a result of artifact noise.

12. A method, according to claim 1 , wherein the characteristic line width is determined by determining co-boundaries on opposite sides of each of the segments and determining average distances between the co-boundaries.

13. A method, according to claim 1 , wherein the raster image is a binary black-and-white image of a line drawing obtained from one of: a photograph or a scan of a handwritten document.

14. A non-transitory computer readable medium containing software that improves visual quality of a raster image, the software comprising:

executable code that detects connectivity components;

executable code that detects defects in each of the connectivity components;

executable code that detects segments in each of the connectivity components;

executable code that detects joints based on geometry of the connectivity components;

executable code that creates a structural graph based on the segments and joints; and

executable code that corrects the raster image according to the structural graph and detected ones of the defects.

15. A non-transitory computer-readable medium, according to claim 14 , wherein the joints correspond to one of: linear joints, T-joints, and X-joints.

16. A non-transitory computer-readable medium, according to claim 15 , wherein detecting types of joints includes determining a configuration of adjacent segments in a proximity of each of the joints.

17. A non-transitory computer-readable medium, according to claim 15 , wherein a linear joint is detected by determining that an angle between axes of two segments in a proximity of a joint is approximately 180 degrees.

18. A non-transitory computer-readable medium, according to claim 17 , wherein the two segments are joined to correct the linear joint.

19. A non-transitory computer-readable medium, according to claim 15 , wherein a T-joint is detected by determining that an angle between axes of a first segment and a second segment in a proximity of a joint is approximately 180 degrees, an angle between the axis of the first segment and an axis of a third segment in a proximity of a joint is approximately 90 degrees and an angle between axes of the second segment and the third segment in a proximity of a joint is approximately 90 degrees.

20. A non-transitory computer-readable medium, according to claim 19 , wherein uneven angles between the first, second, and third segments are sharpened to correct the T-joint.

21. A non-transitory computer-readable medium, according to claim 15 , wherein an X-joint is detected by determining that an angle between axes of a first segment and a second segment in a proximity of a joint is approximately 90 degrees, an angle between the axis of the second segment and an axis of a third segment in a proximity of a joint is approximately 90 degrees, an angle between the axis of the third segment and an axis of a fourth segment in a proximity of a joint is approximately 90 degrees, and an angle between axes of the fourth segment and the first segment in a proximity of a joint is approximately 90 degrees.

22. A non-transitory computer-readable medium, according to claim 21 , wherein uneven angles between the first, second, third, and fourth segments are sharpened to correct the X-joint.

23. A non-transitory computer-readable medium, according to claim 14 , wherein the defects include holes and minor deviations from the characteristic line width.

24. A non-transitory computer-readable medium, according to claim 23 , wherein the defects are a result of artifact noise.

25. A non-transitory computer-readable medium, according to claim 14 , wherein the characteristic line width is determined by determining co-boundaries on opposite sides of each of the segments and determining average distances between the co-boundaries.

26. A non-transitory computer-readable medium, according to claim 14 , wherein the raster image is a binary black-and-white image of a line drawing obtained from one of: a photograph or a scan of a handwritten document.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2023
From: MUFG BANK, LTD.
To: EVERNOTE CORPORATION
Reel/Frame 063116/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 8, 2021
From: EAST WEST BANK
To: EVERNOTE CORPORATION
Reel/Frame 057852/0078 →
SECURITY INTEREST Recorded Oct 6, 2021
From: EVERNOTE CORPORATION
To: MUFG UNION BANK, N.A.
Reel/Frame 057722/0876 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT TERMINATION AT R/F 048513/ 0003 Recorded Oct 22, 2020
From: HERCULES CAPITAL, INC.
To: EVERNOTE CORPORATION
Reel/Frame 054178/0892 →
SECURITY INTEREST Recorded Oct 19, 2020
From: EVERNOTE CORPORATION
To: EAST WEST BANK
Reel/Frame 054113/0876 →
SECURITY INTEREST Recorded Mar 5, 2019
From: EVERNOTE CORPORATION; EVERNOTE GMBH
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 048513/0003 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2017
From: GORBATOV, BORIS; LIVSHITZ, EUGENE; PASHINTSEV, ALEXANDER; BURIAK, ILIA; GALAKTIONOVA, NATALIA
To: EVERNOTE CORPORATION
Reel/Frame 043101/0130 →
Continuity (1)
Provisional Application 62387248 · Dec 23, 2015