IP Library › Granted Patent US 10,829,910
Granted Patent B2
US 10,829,910 · App. 15/553,663 · Granted Nov 10, 2020

Image display system for work machine, remote operation system for work machine, and work machine

Inventors: Hiroshi Yoshinada (Machida, JP); Takanobu Tanimoto (Toyonaka, JP)
Assignee: KOMATSU LTD.
E02F9/264B60R1/00E02F9/205E02F9/261B60R2300/302E02F3/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,829,910
App. No.
15/553,663
Granted
Nov 10, 2020
Kind
B2
Abstract

An image display system for a work machine includes an imaging device mounted to a work machine including a working unit having a working implement, an attitude detector detecting an attitude of the working unit, a distance detector determining information about distance to an object to be worked by the work machine, and a processor using information about position of the working implement obtained using an attitude of the working unit, and information about position of the object to be worked obtained from the information about distance from the work machine to an object to be worked, determined by the distance detector, generating an image of a portion corresponding to the working implement, on the object to be worked opposing the working implement, combining the generated image with an image of the object to be worked imaged by the imaging device, and displaying the combined image on a display device.

Claims (25)

1. An image display system for a work machine comprising:

an imaging device mounted to a work machine including a working unit having a working implement;

an attitude detection device configured to detect an attitude of the working unit;

a distance detection device configured to detect a distance from itself to a terrain surface that is an object to be worked by the work machine; and

a processing device configured to communicate with the imaging device, the attitude detection device and the distance detection device, the processing device being configured to generate an image of a portion corresponding to the working implement, by using a position of the working implement obtained from the attitude of the working unit communicated from the attitude detection device, and a position of the object to be worked obtained from the distance communicated from the distance detection device, on the object to be worked opposing the working implement, the processing device being configured to combine the generated image with an image of the object to be worked imaged by the imaging device, and the processing device being further configured to display the combined image on a display device, wherein

the distance detection device is disposed on a vehicle body of the work machine with the imaging device, the distance detection device having a detection surface facing forward of the work machine,

the working implement has a bucket, and

the processing device is further configured to generate a line image of a portion corresponding to tooth points of the bucket, on the object to be worked, as the image of the portion corresponding to the working implement, on the object to be worked opposing the working implement.

2. The image display system for a work machine according to claim 1 , wherein the processing device is further configured to generate a line image along a surface of the object to be worked, by using the position of the object to be worked, the processing device being configured to combine the line image with the image of the object to be worked, and the processing device being further configured to display the combined image on the display device.

3. The image display system for a work machine according to claim 2 , wherein the line image includes grids having a plurality of first line images, and a plurality of second line images crossing the plurality of first line images.

4. The image display system for a work machine according to claim 1 , wherein the processing device is further configured to generate an image of a straight line connecting the object to be worked and a side of one end in a width direction of the tooth points of the bucket, and an image of a straight line connecting the object to be worked and a side of another end in the width direction of the tooth points of the bucket, the processing device being configured to combine the generated image with the image of the object to be worked imaged by the imaging device, and the processing device being further configured to display the combined image on the display device.

5. The image display system for a work machine according to claim 1 , wherein the processing device is further configured to determine spatial position information about the working implement or the object to be worked, and the processing device is further configured to display the spatial position information on the display device.

6. The image display system for a work machine according to claim 1 , wherein the processing device is further configured to determine at least one of the position of the working implement, the attitude of the working unit, a position of the object to be worked, a relative attitude of the object to be worked, a relative distance between the working implement and the object to be worked, and a relative attitude of the working implement and the object to be worked to be displayed on the display device.

7. The image display system for a work machine according to claim 1 , wherein the processing device is further configured to determine an area occupied by the working implement in the image of the object to be worked, by using the attitude of the working unit, and the processing device is further configured to remove the determined area from information about a terrain of the object to be worked.

8. The image display system for a work machine according to claim 1 , wherein

the imaging device, the attitude detection device, and the distance detection device are provided in the work machine, and

the processing device and the display device are provided in a facility including an operation device configured to remotely control the work machine.

9. An image display system for a work machine comprising:

an imaging device mounted to a work machine including a working unit having a working implement;

an attitude detection device configured to detect an attitude of the working unit;

a distance detection device configured to detect a distance from itself to a terrain surface that is an object to be worked by the work machine; and

a processing device configured to communicate with the imaging device, the attitude detection device and the distance detection device, the processing device being configured to generate an image of a portion corresponding to the working implement, by using a position of the working implement obtained from the attitude of the working unit communicated from the attitude detection device, and a position of the object to be worked obtained from the distance communicated from the distance detection device, on the object to be worked opposing the working implement, the processing device being configured to combine the generated image with an image of the object to be worked imaged by the imaging device, and the processing device being further configured to display the combined image on a display device, wherein

the distance detection device is disposed on a vehicle body of the work machine with the imaging device, the distance detection device having a detection surface facing forward of the work machine,

the working implement has a bucket, and

the processing device is configured to generate a line image of a portion corresponding to tooth points of the bucket, on the object to be worked, as the image of the portion corresponding to the working implement, on the object to be worked opposing the working implement, and an image of a straight line connecting the object to be worked and a side of one end in a width direction of the tooth points of the bucket, and an image of a straight line connecting the object to be worked and a side of the other end in the width direction of the tooth points of the bucket, the processing device is configured to combine the generated images with the image of the object to be worked imaged by the imaging device, the processing device being further configured to display the combined image on a display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2017
From: YOSHINADA, HIROSHI; TANIMOTO, TAKANOBU
To: KOMATSU LTD.; OSAKA UNIVERSITY
Reel/Frame 043402/0239 →
Priority Claims (1)
JP 2015-044050 · Mar 5, 2015 · national
Continuity (1)
Related Publication 20180051446A1 · Feb 22, 2018
Cited By (2)
US 12,234,627 US 12,655,608