IP Library › Granted Patent US 12,215,001
Granted Patent B2
US 12,215,001 · App. 17/911,049 · Granted Feb 4, 2025

Guide display device and crane equipped with same

Inventors: Iwao Ishikawa (Kagawa, JP); Takayuki Kosaka (Kagawa, JP); Keita Mashima (Kagawa, JP); Satoshi Kubota (Osaka, JP); Shigenori Tanaka (Osaka, JP); Masaya Nakahara (Osaka, JP); Koki Nakahata (Osaka, JP)
Assignees: TADANO LTD.; THE SCHOOL CORPORATION KANSAI UNIVERSITY
B66C13/46G01S17/89
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,215,001
App. No.
17/911,049
Granted
Feb 4, 2025
Kind
B2
Abstract

The present invention provides a guide display device capable of recognizing a feature in a work area while distinguishing whether the feature is a moving body or not. In a guide display device of a crane, 3D maps are created for continuous frames; an altitude value for each grid in a 3D map that is created at time closest to the current time is obtained as a first altitude value; altitude values for respective corresponding grids in a predetermined number of 3D maps other than the 3D map that is created at time closest to the current time are obtained, and the average of the altitude values is calculated as a second altitude value; and it is determined that the feature is a moving body when the difference between the first altitude value and the second altitude value exceeds a predetermined threshold.

Claims (33)

1. A guide display device of a crane, comprising:

a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,

wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,

wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,

wherein the data processing section acquires an altitude value of each grid cell as a first altitude value for the three-dimensional map created at a time closest to a current time,

wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second altitude value,

wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and

wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

2. A crane comprising the guide display device according to claim 1 .

3. A guide display device of a crane, comprising:

a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,

wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,

wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,

wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of the three-dimensional maps including the three-dimensional map created at a time closest to a current time, and calculates an average of the altitude value as a first average value,

wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second average value,

wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and

wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

4. A guide display device of a crane, comprising:

a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,

wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,

wherein the data processing section provides a label value for each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,

wherein the data processing section acquires the label value of each grid cell as a first label value for the three-dimensional map created at a time closest to a current time,

wherein the data processing section acquires the label value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the label value as a second label value,

wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and

wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

5. A guide display device of a crane, comprising:

a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point,

wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time,

wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell,

wherein the data processing section acquires, as a first ground object position, a position of the ground object in the three-dimensional map created at a time closest to a current time,

wherein the data processing section acquires, as a second ground object position, the position of the ground object in another three-dimensional map excluding the three-dimensional map created at a time closest to a current time,

wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and

wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2022
From: ISHIKAWA, IWAO; KOSAKA, TAKAYUKI; MASHIMA, KEITA; KUBOTA, SATOSHI; TANAKA, SHIGENORI; NAKAHARA, MASAYA; NAKAHATA, KOKI
To: TADANO LTD.; THE SCHOOL CORPORATION KANSAI UNIVERSITY
Reel/Frame 061063/0411 →
Priority Claims (1)
JP 2020-056811 · Mar 26, 2020 · national
Continuity (1)
Related Publication 20230106308A1 · Apr 6, 2023
References Cited (19)
US 9014848B2 · Farlow · 2015 [cited by examiner]
US 9498886B2 · Rosenstein · 2016 [cited by examiner]
US 11084692B2 · Kosaka et al. · 2021 [cited by applicant]
US 11907423B2 · Muhammad · 2024 [cited by examiner]
US 12032657B2 · Ishikawa · 2024 [cited by examiner]
US 12110213B2 · Ishikawa · 2024 [cited by examiner]
US 20180080882A1 · Boyer · 2018 [cited by examiner]
US 20180306589A1 · Holz · 2018 [cited by examiner]
US 20190196480A1 · Taylor · 2019 [cited by examiner]
US 20190196488A1 · Holmberg · 2019 [cited by examiner]
US 20220197306A1 · Cella · 2022 [cited by examiner]
US 20230123322A1 · Cella · 2023 [cited by examiner]
US 20230222454A1 · Cella · 2023 [cited by examiner]
JP 2019024151A · 2019 [cited by applicant]
Loupos K, Doulamis AD, Stentoumis C, Protopapadakis E, Makantasis K, Doulamis ND, Amditis A, Chrobocinski P, Victores J, Montero R, Menendez E. Autonomous robotic system for tunnel structural inspection and assessment. … [cited by examiner]
Liski, T., 2014. 3-D collision checking for improving machine operator's spatial awareness (Master's thesis). [cited by examiner]
Marshall, J.A., Bonchis, A., Nebot, E. and Scheding, S., 2016. Robotics in mining. Springer handbook of robotics, pp. 1549-1576. [cited by examiner]
Jun. 15, 2021, International Search Report issued for related PCT Application No. PCT/JP2021/012004. [cited by applicant]
Jun. 15, 2021, International Search Opinion issued for related PCT Application No. PCT/JP2021/012004. [cited by applicant]