IP Library › Granted Patent US 11,549,238
Granted Patent B2
US 11,549,238 · App. 17/289,676 · Granted Jan 10, 2023

System and method for work machine

Inventors: Koichi Nakazawa (Tokyo, JP); Osamu Yatsuda (Tokyo, JP)
Assignee: KOMATSU LTD.
E02F9/262B60R11/04E02F9/264G06V20/56B60R2300/305B60Y2200/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,549,238
App. No.
17/289,676
Granted
Jan 10, 2023
Kind
B2
Abstract

A system includes a processor and a display. The processor acquires shape data indicative of a shape of the surroundings in a traveling direction of a work machine. The processor generates a guide line. The guide line is disposed spaced from the work machine. The guide line indicates the shape of the surroundings in the traveling direction of the work machine. The processor synthesizes a surrounding image and the guide line and generates an image including the surroundings image and the guide line. The display displays the image including the surroundings image and the guide line based on a signal from the processor. The system may further include the work machine, a camera that captures the surrounding image, and a sensor that measures the shape of surroundings.

Claims (70)

1. A system comprising:

a work machine including a vehicle body and a work implement attached to the vehicle body, the work implement including a blade;

a camera that captures a surrounding image in a traveling direction of the work machine;

a sensor that measures a shape of surroundings in the traveling direction of the work machine;

a processor configured to

acquire image data indicative of the surroundings image,

acquire shape data indicative of the shape of the surroundings in the traveling direction of the work machine,

generate a guide line that is disposed spaced away from the work machine and indicates the shape of the surroundings in the traveling direction of the work machine, a position of the guide line being determined based on a position of the blade such that the guide line is located a predetermined distance from the blade,

synthesize the surroundings image and the guide line, and

generate an image including the surroundings image and the guide line; and

a display that displays the image including the surroundings image and the guide line based on a signal from the processor.

2. The system according to claim 1 , wherein

the guide line indicates a shape of a surface of the surroundings of the work machine.

3. The system according to claim 1 , wherein

the guide line indicates an elevation difference of a surface of the surroundings of the work machine.

4. The system according to claim 1 , wherein

the position of the blade is a position of a lower end part of the blade, and

the predetermined distance is measured from the lower end part of the blade.

5. The work machine according to claim 1 , wherein

the surroundings image is an image from a viewpoint behind and above the work machine.

6. The system according to claim 1 , wherein

the processor is further configured to

generate a plurality of the guide lines disposed spaced from each other in the traveling direction of the work machine, and

generate the image including the surroundings image and the plurality of guide lines.

7. The system according to claim 6 , wherein

the plurality of guide lines are disposed at equal intervals along the traveling direction of the work machine.

8. The system according to claim 1 , wherein the processor is further configured to

synthesize a machine image indicative of the work machine, with the surroundings image and the guide line,

generate an image including the surroundings image, the guide line, and the machine image, and

cause the image to be displayed on the display.

9. The system according to claim 8 , wherein the machine image is a transparent image.

10. The system according to claim 1 , wherein

the guide line is generated to extend in a widthwise direction of the work machine perpendicular to the traveling direction, and

the predetermined distance is a distance from the blade in the traveling direction.

11. A method executed by a processor for displaying, on a display, the surroundings of a work machine including a vehicle body and a work implement attached to the vehicle body, the work implement including a blade, the method comprising:

acquiring image data indicative of a surroundings image in a traveling direction of the work machine;

acquiring shape data indicative of a shape of the surroundings in the traveling direction of the work machine;

generating a guide line that is disposed spaced from the work machine and indicates the shape of the surroundings in the traveling direction of the work machine, a position of the guide line being determined based on a position of the blade such that the guide line is located a predetermined distance from the blade;

synthesizing the surroundings image and the guide line and generating an image including the surroundings image and the guide line; and

displaying the image including the surroundings image and the guide line on the display.

12. The method according to claim 11 , wherein

the guide line indicates a shape of a surface of the surroundings of the work machine.

13. The method as in claim 11 , wherein

the guide line indicates an elevation difference of a surface of the surroundings of the work machine.

14. The method according to claim 11 , wherein

the position of the blade is a position of a lower end part of the blade, and

the predetermined distance is measured from the lower end part of the blade.

15. The method according to claim 11 , wherein

the surroundings image is an image from a viewpoint behind and above the work machine.

16. The method according to claim 11 , further comprising:

generating a plurality of the guide lines disposed spaced from each other in the traveling direction of the work machine,

synthesizing the surroundings image and the plurality of guide lines and generating an image including the surroundings image and the plurality of guide lines; and

displaying the image including the surroundings image and the plurality of guide lines on the display.

17. The method according to claim 16 , wherein

the plurality of guide lines are disposed at equal intervals along the traveling direction of the work machine.

18. The method according to claim 11 , further comprising:

synthesizing a machine image indicative of the work machine, with the surroundings image and the guide line,

generating an image including the surroundings image, the guide line, and the machine image, and

causing the image to be displayed on the display.

19. A system comprising:

a processor configured to

acquire image data indicative of a surroundings image in a traveling direction of a work machine including a vehicle body and a work implement attached to the vehicle body, the work implement including a blade,

acquire shape data indicative of surroundings in a traveling direction of the work machine,

generate a guide line that is disposed spaced from the work machine and indicates a shape of the surroundings in the traveling direction of the work machine, a position of the guide line being determined based on a position of the blade such that the guide line is located a predetermined distance from the blade,

synthesize the surroundings image and the guide line, and

generate an image including the surroundings image and the guide line; and

a display that displays the image including the surroundings image and the guide line based on a signal from the processor.

20. The system according to claim 19 , wherein

the position of the blade is a position of a lower end part of the blade, and

the predetermined distance is measured from the lower end part of the blade.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2021
From: NAKAZAWA, KOICHI; YATSUDA, OSAMU
To: KOMATSU LTD.
Reel/Frame 056075/0022 →
Priority Claims (1)
JP JP2019-008905 · Jan 23, 2019 · national
Continuity (1)
Related Publication 20210404151A1 · Dec 30, 2021