IP Library Granted Patent US 11,245,888
Granted Patent B2
US 11,245,888 · App. 16/968,986 · Granted Feb 8, 2022

Information processing apparatus, image capture apparatus, image processing system, and method of processing a plurality of captured images of a traveling surface where a moveable apparatus travels

Inventor: Tamon Sadasue (Kanagawa, JP)
Assignee: RICOH COMPANY, LTD.
H04N13/128E01C23/01G01C7/04G06T7/593H04N13/239H04N13/296G01B2210/52G06T2207/30184G06T2207/30252G06T2207/30256H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,245,888
App. No.
16/968,986
Granted
Feb 8, 2022
Kind
B2
Abstract

An information processing apparatus includes an acquisition unit configured to acquire a plurality of captured images of a traveling surface where a movable apparatus travels, each of the captured images including distance information in a depth direction transverse to the traveling surface, the plurality of captured images having been captured using a plurality of stereo image capture devices, and an image processing unit configured to stitch together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by identifying partially overlapping portions of one or more pairs of the images captured by respective stereo image capture devices which are adjacent in a width direction of the traveling surface.

Claims (49)

1. An information processing apparatus, comprising:

circuitry configured to

acquire a plurality of captured images of a traveling surface where a movable apparatus travels, the plurality of captured images having been captured using a plurality of stereo image capture devices;

calculate distance information in a depth direction transverse to the traveling surface from the acquired plurality of captured images;

stitch together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by identifying partially overlapping portions of one or more pairs of the images captured by respective stereo image capture devices which are adjacent in a width direction of the traveling surface;

measure a rutting depth on the traveling surface based on the distance information in the width direction of the traveling surface; and

exclude a side end of the traveling surface when measuring the rutting depth.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the plurality of stereo image capture devices synchronously.

3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to stitch together the plurality of images of the traveling surface captured by the respective stereo image capture devices, adjacent one to another, by correlating the distance information in overlapping portions of pairs of the images.

4. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to stitch together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by correlating the distance information of each pixel in the overlapping portion of pairs of the images.

5. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to create a depth map including data representing each pixel in each one of the plurality of captured images of the traveling surface based on the distance information.

6. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to correlate luminance of each pixel in the overlapping portion of the images that are captured by the respective stereo image capture devices.

7. The information processing apparatus according to claim 3 , wherein the distance information is obtained from the plurality of images captured and then stitched together.

8. The information processing apparatus according to claim 7 , wherein the circuitry is further configured to exclude any foreign matter on the traveling surface when measuring the rutting depth.

9. The information processing apparatus according to claim 1 , wherein each of the stereo image capture devices includes an image capture element configured to employ a simultaneous exposure and collective readout system, whereby each image is composed of pixels which were captured at the same time.

10. A movable apparatus, comprising:

a plurality of stereo image capture devices;

the information processing apparatus of claim 1 ;

a fixing member fixable to a housing of the movable apparatus to hold the plurality of stereo image capture devices used for capturing an image of the traveling surface; and

a movement driver including a motor configured to move the housing.

11. An image processing system, comprising:

a plurality of stereo image capture devices configured to capture a plurality of images of a traveling surface where a movable apparatus travels; and

an information processing apparatus including

circuitry configured to

acquire the plurality of captured images of the traveling surface from the plurality of stereo image capture devices;

calculate distance information in a depth direction transverse to traveling surface from the acquired plurality of captured images; and

stitch together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by identifying partially overlapping portions of one or more pairs of the images captured by respective stereo image capture devices which are adjacent in a width direction of the inspection surface;

measure a rutting depth on the traveling surface based on the distance information in the width direction of the traveling surface; and

exclude a side end of the traveling surface when measuring the rutting depth.

12. The image processing system of claim 11 , further comprising the movable apparatus, wherein the movable apparatus includes

a housing;

a fixing member fixable to the housing of the movable apparatus to hold the plurality of stereo image capture devices used for capturing the image of the traveling surface where the movable apparatus travels; and

a movement driver including a motor configured to move the housing.

13. A method of processing information comprising:

acquiring a plurality of captured images of a traveling surface where a movable apparatus travels, the plurality of captured images having been captured using a plurality of stereo image capture devices;

calculating distance information in a depth direction transverse to the traveling surface from the acquired plurality of captured images;

stitching together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by identifying partially overlapping portions of one or more pairs of the images captured by respective stereo image capture devices which are adjacent in a width direction of the traveling surface;

measuring a rutting depth on the traveling surface based on the distance information in the width direction of the traveling surface; and

excluding a side end of the traveling surface when measuring the rutting depth.

14. The method of claim 13 , wherein the stitching includes

determining a position for stitching the plurality of captured images where relative positions are correlated;

synthesizing the plurality of captured images into one image by stitching the plurality of captured images at the determined stitching position; and

generating three-dimensional point group information from the one image synthesized from the plurality of captured images.

15. The image processing system of claim 11 , wherein the circuitry is further configured to stitch together the plurality of images of the traveling surface captured by the respective stereo image capture devices, adjacent one to another, by correlating the distance information in overlapping portions of pairs of the images.

16. The image processing system of claim 15 , wherein the circuitry is further configured to stitch together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by correlating the distance information of each pixel in the overlapping portion of pairs of the images.

17. The image processing system of claim 15 , wherein the circuitry is further configured to create a depth map including data representing each pixel in each one of the plurality of captured images of the traveling surface based on the distance information.

18. The method of claim 13 , further comprising stitching together the plurality of images of the traveling surface captured by the respective stereo image capture devices, adjacent one to another, by correlating the distance information in overlapping portions of pairs of the images.

19. The method of claim 18 , further comprising stitching together the plurality of images of the traveling surface captured by the plurality of stereo image capture devices by correlating the distance information of each pixel in the overlapping portion of pairs of the images.

20. The method of claim 18 , further comprising creating a depth map including data representing each pixel in each one of the plurality of captured images of the traveling surface based on the distance information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: SADASUE, TAMON
To: RICOH COMPANY, LTD.
Reel/Frame 053456/0826 →
Priority Claims (2)
JP JP2018-051843 · Mar 19, 2018 · national
JP JP2019-047938 · Mar 15, 2019 · national
Continuity (1)
Related Publication 20210058598A1 · Feb 25, 2021