IP Library › Granted Patent US 12,587,731
Granted Patent B2
US 12,587,731 · App. 18/029,096 · Granted Mar 24, 2026

Information processing apparatus, mobile machine, image capturing system, image capturing control method, and program

Inventors: Koichi Kudo (Kanagawa, JP); Aiko Ohtsuka (Tokyo, JP); Masuyoshi Yachida (Tokyo, JP); Hanako Bando (Ibaraki, JP)
Assignee: RICOH COMPANY, LTD.
H04N23/61G06V10/74G06V20/50H04N23/695H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,587,731
App. No.
18/029,096
Granted
Mar 24, 2026
Kind
B2
Abstract

An information processing apparatus for controlling an image capturing process for a robot that moves in a predetermined site to capture an image of a target object. The information processing apparatus includes a memory that stores a plurality of reference images that are captured images of the target object installed in the site, the captured images being obtained at a specific image capturing position and showing different appearances of the target object, such that each of the plurality of reference images is associated with an image capturing condition of the target object. Further, there is an image capturing control unit that captures an image of the target object by using the robot moved to the specific image capturing position, and an image capturing condition setting unit that sets an image capturing condition of the target object, based on the captured image of the target object and the stored reference images.

Claims (60)

1 . An information processing apparatus, comprising:

a memory which stores a reference image for a test object, the reference image being captured at a specific image capturing position, such that the reference image is associated with an image capturing condition information; and

processing circuitry configured to, for each meter of a plurality of meters:

specify an image capturing pattern associated with the reference image, wherein the image capturing pattern is indicated in the image capturing condition information;

control a mobile machine to move to an image capturing position for the meter according to the image capturing pattern;

set an image capturing condition corresponding to the image capturing position and according to the image capturing pattern, and

control the mobile machine to, at the image capturing position and according to the image capturing condition, capture of an image of the meter such that a value of the meter is readable in the image.

2 . The information processing apparatus according to claim 1 , wherein the memory stores a plurality of reference images showing different appearances of the test object, such that each of the plurality of reference images is associated with an image capturing condition of a corresponding meter of the plurality of meters.

3 . The information processing apparatus according to claim 1 , wherein

the memory stores each of a plurality of reference images of the meter under different sunlight conditions, and

the image capturing condition is based on the sunlight conditions corresponding to the reference images, in association with each other.

4 . The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to perform image matching between the captured image of the meter and the reference image, and

specify the image capturing pattern according to the image matching.

5 . The information processing apparatus according to claim 1 , wherein the image capturing condition includes an image capturing position and an image capturing direction in which an image of the meter is captured.

6 . The information processing apparatus according to claim 1 , wherein

the plurality of meters includes a first meter and a second meter,

the memory stores a plurality of reference images that are captured images of the first meter installed in a site, the captured images being obtained at the specific image capturing position and showing different appearances of the first meter, such that each of the plurality of reference images is associated with an image capturing condition of the second meter, and

the processing circuitry is further configured to

control capture of an image of the first meter by using the mobile machine moved to the specific image capturing position,

set an image capturing condition of the second meter, based on the captured image of the first meter and the stored reference images, and

control capture of an image of the second meter by using the set image capturing condition.

7 . The information processing apparatus according to claim 6 , wherein the first meter includes a test object different from the second meter installed at the site.

8 . A mobile machine comprising the information processing apparatus according to claim 1 .

9 . An image capturing system, comprising:

a mobile machine; and

an information processing apparatus including:

a memory which stores a reference image for a test object, the reference image being captured at a specific image capturing position, such that the reference image is associated with an image capturing condition information; and

processing circuitry configured to, for each meter of a plurality of meters:

specify an image capturing pattern associated with the reference image, wherein the image capturing pattern is indicated in the image capturing condition information;

control the mobile machine to move to an image capturing position for the meter according to the image capturing pattern,

set an image capturing condition corresponding to the image capturing position and according to the image capturing pattern; and

control the mobile machine to, at the image capturing position and according to the image capturing condition, capture of the image of the meter such that a value of the meter is readable in the image.

10 . The image capturing system according to claim 9 , wherein the memory stores a plurality of reference images showing different appearances of the test object, such that each of the plurality of reference images is associated with an image capturing condition of a corresponding meter of the plurality of meters.

11 . The image capturing system according to claim 9 , wherein

the plurality of meters includes a first meter and a second meter,

the memory stores a plurality of reference images that are captured images of the first meter installed in a site, the captured images being obtained at the specific image capturing position and showing different appearances of the first meter, such that each of the plurality of reference images is associated with an image capturing condition of the second meter, and

the processing circuitry is further configured to

control capture of an image of the first meter by using the mobile machine moved to the specific image capturing position,

set an image capturing condition of the second meter, based on the captured image of the first meter and the reference images stored in the memory, and

control capture of an image of the second meter by using the set image capturing condition.

12 . The image capturing system according to claim 11 , further comprising:

a communication terminal configured to display an image captured by the mobile machine, wherein

the communication terminal includes circuitry configured to

control a display to display an overhead-view image in which a predetermined area including a plurality of the second meters appears, and

accept designation of a predetermined region of the displayed overhead-view image,

the processing circuitry controls capture of an image of a specific second meter included in the designated predetermined region, and

the memory stores an image capturing condition under which the image of the specific second meter is captured, in association with the captured image of the first meter.

13 . The image capturing system according to claim 11 , further comprising:

a communication terminal configured to display an image captured by the mobile machine, wherein

the communication terminal includes circuitry configured to

control a display to display a plurality of captured images of the second meter, and

receive selection of a specific captured image among the plurality of displayed captured images, and

the memory stores an image capturing condition of the specific captured image in association with the captured image of the first meter.

14 . A non-transitory computer readable medium storing computer executable instructions which, when executed by an information processing apparatus cause the information processing apparatus to:

store a reference image for a test object, the reference image being captured at a specific image capturing position, such that the reference image is associated with an image capturing condition information; and

for each meter of a plurality of meters:

specify an image capturing pattern associated with the reference image, wherein the image capturing pattern is indicated in the image capturing condition information;

control a mobile machine to move to an image capturing position for the meter according to the image capturing pattern;

set an image capturing condition corresponding to the image capturing position and according to the image capturing pattern; and

control the mobile machine to, at the image capturing position and according to the image capturing condition, capture an image of the meter such that a value of the meter is readable in the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2023
From: KUDO, KOICHI; OHTSUKA, AIKO; YACHIDA, MASUYOSHI; BANDO, HANAKO
To: RICOH COMPANY, LTD.
Reel/Frame 063140/0121 →
Priority Claims (2)
JP 2020-165537 · Sep 30, 2020 · national
JP 2021-117332 · Jul 15, 2021 · national
Continuity (1)
Related Publication 20240022806A1 · Jan 18, 2024
References Cited (22)
US 20050088543A1 · Yoshii · 2005 [cited by applicant]
US 20090043422A1 · Lee et al. · 2009 [cited by applicant]
US 20110188779A1 · Sakanaga et al. · 2011 [cited by applicant]
US 20170061209A1 · Watanabe · 2017 [cited by applicant]
US 20170272623A1 · Yachida et al. · 2017 [cited by applicant]
US 20170303466A1 · Grufman · 2017 [cited by examiner]
US 20190335074A1 · Malkes et al. · 2019 [cited by applicant]
US 20200252543A1 · Lanka · 2020 [cited by examiner]
US 20210001487A1 · Ohtsuka et al. · 2021 [cited by applicant]
US 20210037214A1 · Itoh · 2021 [cited by applicant]
JP 11064050 · 1999 [cited by applicant]
JP 2005052926 · 2005 [cited by applicant]
JP 2005130326 · 2005 [cited by applicant]
JP 2007264832A · 2007 [cited by applicant]
JP 2009239501 · 2009 [cited by applicant]
JP 2011163766 · 2011 [cited by applicant]
JP 2017045166 · 2017 [cited by applicant]
JP 2021027390 · 2021 [cited by applicant]
Extended European Search Report issued Oct. 8, 2024 in corresponding European Patent Application No. 21875069.3. (14 pgs). [cited by applicant]
Merriaux Pierre et al: “The VIKINGS Autonomous Inspection Robot: Competing in the ARGOS Challenge”, IEEE Robotics & Automation Magazine, IEEE Service Center, Piscataway, NJ, US, vol. 26, No. 1, Mar. 1, 2019 (Mar. 1, 201… [cited by applicant]
Binhai Wang et al: “SmartGuard: An autonomous robotic system for inspecting substation equipment”, Journal of Field Robotics, vol. 29, No. 1, Nov. 16, 2011 (Nov. 16, 2011), pp. 123-137, XP055471462. [cited by applicant]
International Search Report and Written Opinion issued on Nov. 9, 2021 in PCT/JP2021/032442 filed on Sep. 3, 2021, 5 pages. [cited by applicant]