IP Library Granted Patent US 11,157,750
Granted Patent B2
US 11,157,750 · App. 16/266,588 · Granted Oct 26, 2021

Captured image check system and captured image check method

Inventors: Takahiko Yamazaki (Chiba, JP); Nobuyuki Kumakura (Kanagawa, JP); Masaki Shiratsuki (Kanagawa, JP); Yoko Yonekawa (Tokyo, JP); Akira Wada (Tokyo, JP)
Assignee: Toshiba Infrastructure Systems & Solutions Corporation
G06K9/00791G06K9/44G06K9/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,157,750
App. No.
16/266,588
Granted
Oct 26, 2021
Kind
B2
Abstract

According to an embodiment, a captured image check system includes a camera, an image data input unit, a camera view angle judge processor, a road surface state analysis judge processor, and an output unit. The camera photographs a road surface. The image data input unit inputs image data to be used for analyzing a state of the road surface. The camera view angle judge processor performs a judge process of determining whether or not an angle of view of the camera satisfies a first condition for analyzing the state of the road surface on the basis of the image data. The road surface state analysis judge processor performs a judge process of determining whether or not a second condition for analyzing the state of the road surface is satisfied on the basis of image data of the road surface. The output unit outputs results of the judge processes.

Claims (58)

1. A captured image check system, comprising:

a camera configured to photograph a road surface;

an image data input interface configured to input image data to be used for analyzing a state of the road surface photographed by the camera;

a camera view angle judge processor configured to perform a judge process of determining whether or not an angle of view of the camera satisfies a first condition for analyzing the state of the road surface on the basis of the image data input to the image data input interface;

a road surface state analysis judge processor configured to perform a judge process of determining whether or not a second condition for analyzing the state of the road surface is satisfied on the basis of image data of the road surface input to the image data input interface; and

an output interface configured to output a result of the judge process of the camera view angle judge processor and a result of the judge process of the road surface state analysis judge processor,

wherein the first condition is that the camera is facing a rear side or a front side,

wherein the camera view angle judge processor causes a frame indicating a range to be displayed on the image data and performs reception of an input indicating that the first condition is satisfied from a user or makes a judge of whether or not the first condition is satisfied through image processing as a process of determining whether or not the first condition is satisfied,

wherein the first condition further includes a condition that a traffic lane of the road surface that is a road surface state analysis target appears near a center of the image data,

wherein the camera view angle judge processor causes a grid-like frame divided into predetermined partitions to be displayed on the image data and performs reception of an input indicating that the first condition is satisfied from the user or makes a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied,

wherein the first condition further includes a condition that a horizon appears in a predetermined range on the image data, and

wherein the camera view angle judge processor causes a frame indicating a range in which the horizon is to be photographed to be displayed on the image data and performs reception of an input indicating that the first condition is satisfied from the user or makes a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied.

2. The captured image check system according to claim 1 ,

wherein the first condition further includes a condition that a body of a vehicle equipped with the camera that is photographing the road surface does not appear in the image data, and

wherein the camera view angle judge processor causes the image data to be displayed and performs reception of an input indicating that the first condition is satisfied from the user or makes a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied.

3. The captured image check system according to claim 1 ,

wherein the second condition is that a crack of the road surface is detected,

wherein the captured image check system further comprises a crack analyzer configured to detect a crack of the road surface from the image data and generate post-analysis image data by superimposing the detected crack on the image data, and

wherein the road surface state analysis judge processor causes the post-analysis image data generated by the crack analyzer to be displayed and performs reception of an input indicating that the second condition is satisfied from a user or makes a judge of whether or not the second condition is satisfied in accordance with whether or not the crack is able to be detected in the post-analysis image data as the judge process of determining whether or not the second condition is satisfied.

4. The captured image check system according to claim 1 , comprising:

a captured image check device provided within a vehicle that travels on a road on which a road surface is photographed; and

an external device provided in a place different from that of the road on which a road surface is photographed,

wherein the captured image check device includes the image data input interface and a communication unit configured to transmit the image data obtained through photographing by the camera to the external device, and

wherein the external device includes the camera view angle judge processor, the road surface state analysis judge processor, and the output interface.

5. The captured image check system according to claim 1 , comprising:

a captured image check device provided within a vehicle that travels on a road on which a road surface is photographed; and

an external device provided in a place different from that of the road on which a road surface is photographed,

wherein the captured image check device includes the camera, the image data input interface, and a communication unit configured to transmit the image data obtained through photographing by the camera to the external device, and

wherein the external device includes the camera view angle judge processor, the road surface state analysis judge processor, and the output interface.

6. The captured image check system according to claim 1 , further comprising:

a still-image converter configured to thin a moving image at a predetermined interval if the image data is a moving image and convert the moving image after thinning into image data of a still image.

7. A captured image check method, comprising:

inputting image data to be used for analyzing a state of a road surface photographed by a camera configured to photograph the road surface;

performing a first judge process of determining whether or not an angle of view of the camera satisfies a first condition for analyzing the state of the road surface on the basis of the image data input;

performing a second judge process of determining whether or not a second condition for analyzing the state of the road surface is satisfied on the basis of image data of the road surface input; and

outputting a result of the first judge process and a result of the second judge,

wherein the first condition is that the camera is facing a rear side or a front side,

wherein the captured image check method further comprising causing a frame indicating a range to be displayed on the image data and performing reception of an input indicating that the first condition is satisfied from a user or making a judge of whether or not the first condition is satisfied through image processing as a process of determining whether or not the first condition is satisfied,

wherein the first condition further includes a condition that a traffic lane of the road surface that is a road surface state analysis target appears near a center of the image data,

wherein the captured image check method further comprising causing a grid-like frame divided into predetermined partitions to be displayed on the image data and performing reception of an input indicating that the first condition is satisfied from the user or making a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied,

wherein the first condition further includes a condition that a horizon appears in a predetermined range on the image data, and

wherein the captured image check method further comprising—causing a frame indicating a range in which the horizon is to be photographed to be displayed on the image data and performing reception of an input indicating that the first condition is satisfied from the user or making a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied.

8. The captured image check method according to claim 7 ,

wherein the first condition further includes a condition that a body of a vehicle equipped with the camera that is photographing the road surface does not appear in the image data, and

wherein the captured image check method further comprising causing the image data to be displayed and performing reception of an input indicating that the first condition is satisfied from the user or making a judge of whether or not the first condition is satisfied through image processing as the process of determining whether or not the first condition is satisfied.

9. The captured image check method according to claim 7 ,

wherein the second condition is that a crack of the road surface is detected,

wherein the captured image check method further comprising detecting a crack of the road surface from the image data and generating post-analysis image data by superimposing the detected crack on the image data, and

wherein the captured image check method further comprising causing the post-analysis image data generated to be displayed and performing reception of an input indicating that the second condition is satisfied from a user or making a judge of whether or not the second condition is satisfied in accordance with whether or not the crack is able to be detected in the post-analysis image data as the judge process of determining whether or not the second condition is satisfied.

10. The captured image check method according to claim 7 ,

wherein the captured image check method is performed by a captured image check system including a captured image check device provided within a vehicle that travels on a road on which a road surface is photographed and an external device provided in a place different from that of the road on which a road surface is photographed,

wherein the inputting image data by the captured image check device,

wherein the transmitting the image data obtained through photographing by the camera to the external device by the captured image check device,

wherein the performing a first judge process by the external device,

wherein the performing a second judge process by the external device, and

wherein the outputting a result of the first judge process and a result of the second judge process by the external device.

11. The captured image check method according to claim 7 , further comprising:

thinning a moving image at a predetermined interval if the image data is a moving image and converting the moving image after thinning into image data of a still image.

Assignments (2)
MERGER Recorded Jul 29, 2025
From: TOSHIBA INFRASTRUCTURE SYSTEMS & SOLUTIONS CORPORATION
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 072239/0263 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2019
From: YAMAZAKI, TAKAHIKO; KUMAKURA, NOBUYUKI; SHIRATSUKI, MASAKI; YONEKAWA, YOKO; WADA, AKIRA
To: TOSHIBA INFRASTRUCTURE SYSTEMS & SOLUTIONS CORPORATION
Reel/Frame 048233/0833 →
Priority Claims (1)
JP JP2018-040201 · Mar 6, 2018 · national
Continuity (1)
Related Publication 20190279001A1 · Sep 12, 2019
Cited By (1)
US 12,442,773