IP Library Granted Patent US 11,881,043
Granted Patent B2
US 11,881,043 · App. 17/057,104 · Granted Jan 23, 2024

Image processing system, image processing method, and program

Inventor: Yeongnam Chae (Tokyo, JP)
Assignee: RAKUTEN GROUP, INC.
G06V30/414G06V10/44G06V10/50G06V10/751G06V20/62G06V30/413
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,881,043
App. No.
17/057,104
Granted
Jan 23, 2024
Kind
B2
Abstract

An image processing system having at least one processor configured to: obtain a captured image of a document that includes a fixed part and an un-fixed part, the document being captured by an image reader or an image capture device; detect a feature part of the fixed part based on the captured image; obtain, in a case where the feature part is detected, a shaped image of the captured image such that a positional relationship of the feature part is aligned with a predetermined first positional relationship; and search for, in a case where the feature part is not detected, a substitute feature part of the fixed part based on the captured image, wherein in a case where the feature part is not detected, the at least one processor obtains the shaped image such that a position of the substitute feature part is aligned with a predetermined second position.

Claims (48)

1. An image processing system comprising at least one processor configured to:

obtain a captured image of a document that includes a fixed part and an un-fixed part, the document being captured by an image reader or an image capture device;

detect a feature part of the fixed part based on the captured image;

obtain, in a case where the feature part is detected, a shaped image of the captured image such that a positional relationship of the feature part is aligned with a predetermined first positional relationship; and

search for in a predetermined location, when the feature part is not detected, a substitute feature part of the fixed part based on the captured image, wherein

in a case where the feature part is not detected, the at least one processor obtains the shaped image such that a position of the substitute feature part is aligned with a predetermined second position.

2. The image processing system according to claim 1 , wherein

the at least one processor detects the substitute feature part from a sample image, and

in a case where the feature part is not detected, the at least one processor obtains the position of the substitute feature part in the sample image as the second position, and obtains the shaped image.

3. The image processing system according to claim 2 , wherein

the at least one processor searches for the substitute feature part by using a histogram based on the captured image.

4. The image processing system according to claim 1 , wherein

the at least one processor searches for the substitute feature part in an area determined based on a first position.

5. The image processing system according to claim 4 , wherein the predetermined location of the substitute feature part is within a predetermined distance of the first position.

6. The image processing system according to claim 1 , wherein

the at least one processor detects a plurality of feature parts,

the at least one processor obtains the shaped image such that positions of the plurality of feature parts are respectively aligned with first positions corresponding to the plurality of feature parts,

the at least one processor searches for the substitute feature part in a case where at least one of the feature parts is not detected, and

in a case where at least one of the feature parts is not detected, the at least one processor obtains the shaped image based on the substitute feature part.

7. The image processing system according to claim 6 , wherein

in a case where only some of the plurality of feature parts are detected, the at least one processor searches for a substitute feature part for each undetected feature part based on a positional relationship between the substitute feature part and the detected some of the feature parts.

8. The image processing system according to claim 7 , wherein

a number of the plurality of feature parts is equal to or more than three, and

the at least one processor searches for a candidate of a substitute feature part for each undetected feature part, and determines the substitute feature part based on a size of an area formed by the candidate and the detected some of the feature parts.

9. The image processing system according to claim 1 , wherein

in a case where the plurality of feature parts are not detected, the at least one processor searches for a substitute feature part for each undetected feature part based on a positional relationship between the substitute feature part and the other substitute feature parts.

10. The image processing system according to claim 9 , wherein

a number of the plurality of feature parts is equal to or more than three, and

the at least one processor searches for a candidate of a substitute feature part for each undetected feature part, and determines the substitute feature part based on a size of an area formed by the respective candidates of the undetected feature parts.

11. The image processing system according to claim 1 , wherein

the at least one processor searches for the predetermined substitute feature part.

12. The image processing system according to claim 1 , wherein

the feature part is a character or a symbol in the fixed part.

13. The image processing system according to claim 1 , wherein the at least one processor executes optical character recognition on the shaped image.

14. The image processing system according to claim 1 , wherein the processor corrects a skew of the captured image to create the shaped image.

15. The image processing system according to claim 1 , wherein the processor corrects a distortion of the captured image to create the shaped image.

16. An image processing method comprising:

obtaining a captured image of a document that includes a fixed part and an un-fixed part, the document being captured by an image reader or an image capture device;

detecting a feature part of the fixed part based on the captured image;

obtaining, in a case where the feature part is detected, a shaped image of the captured image such that a positional relationship of the feature part is aligned with a predetermined first positional relationship; and

searching for, in a predetermined location, when the feature part is not detected, a substitute feature part of the fixed part based on the captured image, wherein

in a case where the feature part is not detected, the image processing method obtains the shaped image such that a position of the substitute feature part is aligned with a predetermined second position.

17. A non-transitory computer-readable information storage medium for storing a program for causing a computer to:

obtain a captured image of a document that includes a fixed part and an un-fixed part, the document being captured by an image reader or an image capture device;

detect a feature part of the fixed part based on the captured image;

obtain, in a case where the feature part is detected, a shaped image of the captured image such that a positional relationship of the feature part is aligned with a predetermined first positional relationship; and

search for, in a predetermined location, when the feature part is not detected, a substitute feature part of the fixed part based on the captured image, wherein

in a case where the feature part is not detected, the computer obtains the shaped image such that a position of the substitute feature part is aligned with a predetermined second position.

Assignments (2)
CHANGE OF NAME Recorded Jul 13, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 056845/0831 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2020
From: CHAE, YEONGNAM
To: RAKUTEN, INC.
Reel/Frame 055346/0751 →
Continuity (1)
Related Publication 20210201069A1 · Jul 1, 2021