IP Library Granted Patent US 11,080,535
Granted Patent B2
US 11,080,535 · App. 16/465,373 · Granted Aug 3, 2021

Facility inspection system and facility inspection method

Inventors: Nobuhiro Chihara (Tokyo, JP); Masahiko Honda (Tokyo, JP); Toshihide Kishi (Tokyo, JP); Masashi Shinbo (Tokyo, JP); Kiyotake Horie (Kodama-gun, JP)
Assignee: HITACHI HIGH-TECH FINE SYSTEMS CORPORATION
G06K9/00791B60M1/28B61L15/0081B61L23/00G01B11/002G06K9/0063
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,080,535
App. No.
16/465,373
Granted
Aug 3, 2021
Kind
B2
Abstract

A facility inspection system prevents a normal part from being detected as an abnormal part caused by a deviation in an alignment due to a presence/absence of a moving object in detecting the abnormal part in a surrounding environment of a vehicle moving on a track. The system includes a photographing device, storage device, separation unit, an alignment unit, and a extraction unit. The photographing device photographs the surrounding environment of the moving vehicle. The storage device stores a reference alignment point cloud and a reference difference-extraction point cloud for each position on the track. The separation unit separates the alignment point cloud from a three-dimensional point cloud. The alignment unit aligns the reference alignment point cloud and the alignment point cloud and outputs alignment information. The extraction unit extracts a difference between the three-dimensional point cloud deformed based on the alignment information and the reference difference-extraction point cloud.

Claims (42)

1. A facility inspection system comprising:

a photographing device that photographs an image of a surrounding environment of a vehicle moving on a track;

a storage device that stores a reference alignment point cloud and a reference difference-extraction point cloud for each position on the track;

an alignment area separation unit that separates an alignment point cloud from a three-dimensional point cloud obtained from the image;

an alignment unit that performs an alignment of the reference alignment point cloud and the alignment point cloud, the alignment unit outputting alignment information;

a difference extraction unit that extracts a difference between the three-dimensional point cloud deformed based on the alignment information and the reference difference-extraction point cloud; and

an alignment area choosing unit that determines an area among a plurality of candidate areas as an alignment area, the area including a predetermined count or more of three-dimensional points detected via the photographing device, determining the area by

determining whether a count of three-dimensional points in a first area of the plurality of candidate areas is equal to or greater than a threshold,

selecting the first area as the alignment area when the count of three-dimensional points on the first area is equal to or greater than the threshold, and

selecting a different area of the plurality of candidate areas to be the alignment area when the count of three-dimensional points on the first area is less than the threshold,

wherein the alignment point cloud is present in the alignment area, and

wherein the plurality of candidate areas each have a different priority order.

2. The facility inspection system according to claim 1 ,

wherein the alignment area separation unit outputs a point cloud in the three-dimensional point cloud as the alignment point cloud, and the point cloud is present in a predetermined space including few moving objects.

3. The facility inspection system according to claim 2 ,

wherein the predetermined space is a space obliquely upward, upward, or on a side surface side of the vehicle.

4. The facility inspection system according to claim 3 ,

wherein the predetermined space is configured so as to include:

a part of a utility pole disposed along the track and a beam between the utility poles; or

a part of a slope on the side surface side of the vehicle.

5. The facility inspection system according to claim 1 ,

wherein the storage device stores alignment area candidate information for each position on the track, and

the alignment area separation unit outputs a point cloud in the three-dimensional point cloud as the alignment point cloud, the point cloud being included in the alignment area candidate information.

6. The facility inspection system according to claim 5 , further comprising

an area retrieval unit that retrieves the alignment area candidate information from the storage device based on a current position of the vehicle.

7. The facility inspection system according to claim 6 ,

wherein the area retrieval unit narrows the alignment area candidate information based on a measuring range of the photographing device.

8. The facility inspection system according to claim 1 , further comprising

a neighborhood retrieval unit that retrieves the reference alignment point cloud and the reference difference-extraction point cloud from the storage device based on a current position of the vehicle.

9. The facility inspection system according to claim 1 ,

wherein the alignment area choosing unit chooses the plurality of candidate areas in accordance with priority orders, such that an area of the plurality of candidate areas with a higher priority order than an other area of the plurality of candidate areas is chosen first.

10. A facility inspection method comprising:

a step of photographing an image of a surrounding environment of a vehicle moving on a track by a photographing device;

a step of separating an alignment point cloud from a three-dimensional point cloud obtained from the image by an alignment area separation unit;

a step of performing an alignment of a reference alignment point cloud stored in a storage device and the alignment point cloud and outputting alignment information by an alignment unit;

a step of extracting a difference between the three-dimensional point cloud deformed based on the alignment information and a reference difference-extraction point cloud stored in the storage device by a difference extraction unit; and

a step of determining an area among a plurality of candidate areas as an alignment area, via an alignment area choosing unit, the area including a predetermined count or more of three-dimensional points detected via the photographing device, the step of determining including

determining whether a count of three-dimensional points in a first area of the plurality of candidate areas is equal to or greater than a threshold,

selecting the first area as the alignment area when the count of three-dimensional points on the first area is equal to or greater than the threshold, and

selecting a different area of the plurality of candidate areas to be the alignment area when the count of three-dimensional points on the first area is less than the threshold,

wherein the alignment point cloud is present in the alignment area, and

wherein the plurality of candidate areas each have a different priority order.

Assignments (3)
COMPANY SPLIT Recorded Sep 9, 2025
From: HITACHI HIGH-TECH SOLUTIONS CORPORATION
To: HITACHI HIGH-TECH CORPORATION
Reel/Frame 072888/0801 →
CHANGE OF NAME Recorded Dec 16, 2022
From: HITACHI HIGH-TECH FINE SYSTEMS CORPORATION
To: HITACHI HIGH-TECH SOLUTIONS CORPORATION
Reel/Frame 062151/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2019
From: CHIHARA, NOBUHIRO; HONDA, MASAHIKO; KISHI, TOSHIHIDE; SHINBO, MASASHI; HORIE, KIYOTAKE
To: HITACHI HIGH-TECH FINE SYSTEMS CORPORATION
Reel/Frame 049328/0762 →