IP Library Granted Patent US 12,406,515
Granted Patent B2
US 12,406,515 · App. 17/884,825 · Granted Sep 2, 2025

Information processing apparatus, information processing method and non-transitory storage medium

Inventors: Go Oishi (Kanagawa, JP); Yusuke Muramatsu (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06V30/333G06T5/50G06V30/164G06V30/19147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,515
App. No.
17/884,825
Granted
Sep 2, 2025
Kind
B2
Abstract

The information processing apparatus according to the present disclosure synthesizes a handwriting image with a noise image to generate a synthesized image, generates a correct label indicative of handwriting pixels from the handwriting image, and applies the synthesized image and the correct label as learning data to generate a learning model.

Claims (33)

1. An information processing apparatus comprising:

at least one memory that stores a program; and

at least one processor that executes the program to:

acquire a handwriting image;

generate a correct label image by binarizing the acquired handwriting image, the correct label image being indicative of handwriting pixels in the acquired handwriting image;

obtain a first scan image generated by reading a blank sheet;

acquire a noise image by cutting a part of the obtained first scan image out, a position of the part being randomly determined from the obtained first scan image;

synthesize the acquired handwriting image and the acquired noise image to generate a synthesized image; and

use the synthesized image and the correct label image as learning data for generating a learning model that is usable for estimating handwriting pixels from an image.

2. The information processing apparatus according to claim 1 , wherein the handwriting image is obtained by performing at least one of a rotation processing, a cutting out processing, a magnification varying processing, and a brightness changing processing for a second scan image generated by reading a sheet including handwriting.

3. The information processing apparatus according to claim 1 , wherein a pixel value of the synthesized image is determined by comparing pixel values of corresponding pixels in the acquired handwriting image and the acquired noise image.

4. The information processing apparatus according to claim 1 , wherein the synthesized image is generated by synthesizing the acquired handwriting image, the acquired noise image, and an image including information associated with a background.

5. The information processing apparatus according to claim 1 , wherein the at least one processor executes the program to further:

generate the learning model for estimating handwriting pixels from an image by using the learning data.

6. The information processing apparatus according to claim 5 , wherein the at least one processor executes the program to further:

estimate handwriting pixels from a process target image by using the generated learning model.

7. The information processing apparatus according to claim 6 , wherein the at least one processor executes the program to further:

generate, based on a result of the estimating, an extracted image corresponding to handwriting and an extracted image corresponding to a background from the process target image.

8. The information processing apparatus according to claim 5 , wherein the handwriting pixels are estimated from a process target image by an extraction processing apparatus that is different from the information processing apparatus and uses the generated learning model for the estimation.

9. An information processing method comprising:

acquiring a handwriting image;

generating a correct label image by binarizing the acquired handwriting image, the correct label image being indicative of handwriting pixels in the acquired handwriting image;

obtaining a first scan image generated by reading a blank sheet;

acquiring a noise image by cutting a part of the obtained first scan image out, a position of the part being randomly determined from the obtained first scan image;

synthesizing the acquired handwriting image and the acquired noise image to generate a synthesized image; and

using the synthesized image and the correct label image as learning data for generating a learning model that is usable for estimating handwriting pixels from an image.

10. A non-transitory computer readable storage medium storing instructions that causes a computer to:

acquire a handwriting image;

generate a correct label image by binarizing the acquired handwriting image, the correct label image being indicative of handwriting pixels in the acquired handwriting image;

obtain a first scan image generated by reading a blank sheet;

acquire a noise image by cutting a part of the obtained first scan image out, a position of the part being randomly determined from the obtained first scan image;

synthesize the acquired handwriting image and the acquired noise image to generate a synthesized image; and

use the synthesized image and the correct label image as learning data for generating a learning model that is usable for estimating handwriting pixels from an image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2022
From: OISHI, GO; MURAMATSU, YUSUKE
To: CANON KABUSHIKI KAISHA
Reel/Frame 062192/0040 →
Priority Claims (1)
JP 2021-136149 · Aug 24, 2021 · national
Continuity (1)
Related Publication 20230062113A1 · Mar 2, 2023
References Cited (19)
US 7660483B2 · Nicholson · 2010 [cited by examiner]
US 8488181B2 · Wu · 2013 [cited by examiner]
US 10546217B2 · Albright et al. · 2020 [cited by applicant]
US RE47889E · Saund · 2020 [cited by examiner]
US 10671892B1 · Daskalov · 2020 [cited by examiner]
US 10984284B1 · Corcoran · 2021 [cited by examiner]
US 11295155B2 · Xu · 2022 [cited by examiner]
US 11341758B1 · Stoltenberg · 2022 [cited by examiner]
US 20130136315A1 · Kawamoto · 2013 [cited by examiner]
US 20190205632A1 · Yu · 2019 [cited by examiner]
US 20190392207A1 · Young · 2019 [cited by examiner]
US 20200311459A1 · Zagaynov · 2020 [cited by examiner]
JP 2010122791A · 2010 [cited by applicant]
JP 2020052513A · 2020 [cited by applicant]
JP 2021039424A · 2021 [cited by applicant]
C. Ramaiah, R. Plamondonm and V. Govindaraju, “A Sigma-Lognormal Model for Handwritten Text CAPTCHA Generation,” 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden, 2014, pp. 250-255, doi: 10.1… [cited by examiner]
Huseyin Kusetogullari, Amir Yavariabdi, Johan Hall, Niklas Lavesson, DIGITNET: a Deep Handwritten Digit Detection and Recognition Method Using a New Historical Handwritten Digit Dataset, Big Data Research, vol. 23, 2021… [cited by examiner]
Rowel Atienza, Data Augmentation for Scene Text Recognition, 2021, https://arxiv.org/abs/2108.06949 (Year: 2021). [cited by examiner]
Long “Fully Convolutional Networks for Semantic Segmentation”, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015: pp. 3431-3440. [cited by applicant]