IP Library › Granted Patent US 12,637,840
Granted Patent B2
US 12,637,840 · App. 18/269,578 · Granted May 26, 2026

Work machine surroundings monitoring system, work machine, and work machine surroundings monitoring method

Inventors: Hirosuke Matsumoto (Tokyo, JP); Shun Yasaku (Tokyo, JP)
Assignee: KOMATSU LTD.
E02F9/261H04N5/2624H04N23/90E02F3/7636
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,637,840
App. No.
18/269,578
Granted
May 26, 2026
Kind
B2
Abstract

A work machine surroundings monitoring system includes a first display image generation unit that generates a first display image indicating surroundings of a work machine on the basis of a camera image of a camera that captures an image of the surroundings of the work machine, a second display image generation unit that generates a second display image in a display mode different from that of the first display image on the basis of camera images of a plurality of cameras that capture images of the surroundings of the work machine, and a display control unit that generates a signal for displaying the first display image on a part of a display screen, displaying the second display image on a part of the display screen, and displaying a boundary image at a boundary between the first display image and the second display image on the display screen.

Claims (70)

1 . A surroundings monitoring system for a work machine comprising:

a monitor;

a plurality of cameras for capturing images of surroundings of the work machine; and

a processor,

wherein the processor is configured to:

acquire camera images from the plurality of cameras;

generate a first display image including a front portion around the work machine on the basis of the camera images;

generate a second display image including a rear portion around the work machine, which is different from that of the first display image, on the basis of the camera images; and

display a symbol image indicating the work machine on the monitor, display the first display image and the second display image around the symbol image, and generate a signal for displaying a boundary image disposed between the first display image and the second display image.

2 . The work machine surroundings monitoring system according to claim 1 , wherein

the display mode different from that of the first display image is an image viewed from a viewpoint different from that of the first display image.

3 . The work machine surroundings monitoring system according to claim 1 , wherein

the first display image is a panoramic image, and the second display image is a bird's eye image.

4 . The work machine surroundings monitoring system according to claim 1 , wherein

the camera includes a first camera that acquires a first camera image and a second camera that acquires a second camera image, for generating the first display image, and a third camera that acquires a third camera image and a fourth camera that acquires a fourth camera image, for generating the second display image,

the work machine includes a front vehicle body, a rear vehicle body, and an articulate mechanism that connects the front vehicle body and the rear vehicle body,

the first camera and the second camera are provided in the front vehicle body, and

the third camera and the fourth camera are provided in the rear vehicle body.

5 . The work machine surroundings monitoring system according to claim 4 , wherein

the first display image includes surroundings of the front vehicle body,

the second display image includes surroundings of the rear vehicle body, and

the boundary image is displayed on a side portion of the articulate mechanism of the symbol image.

6 . The work machine surroundings monitoring system according to claim 4 , wherein

the first display image is a first viewpoint image viewed from a first viewpoint different from a position of the first camera and a position of the second camera, and

the second display image is a second viewpoint image viewed from a second viewpoint different from a position of the third camera and a position of the fourth camera.

7 . The work machine surroundings monitoring system according to claim 1 , wherein

the boundary image is generated so as to cover a non-display area where the first display image and the second display image are not displayed on the display screen.

8 . A work machine comprising:

working equipment that performs work at a work site;

a vehicle body that supports the working equipment;

a plurality of cameras for capturing images of surroundings of the vehicle body;

a monitor that displays an image captured by the camera; and

a processor

wherein the processor is configured to:

acquire camera images from the plurality of cameras;

generate a first display image including a front portion around the vehicle body on the basis of the camera images;

generate a second display image including a rear portion around the vehicle body, which is different from that of the first display image, on the basis of the camera images; and

display a symbol image indicating the work machine on the monitor, display the first display image and the second display image around the symbol image, and display a boundary image disposed between the first display image and the second display image.

9 . The work machine according to claim 8 , further comprising:

a front wheel and a rear wheel that support the vehicle body, wherein

the vehicle body includes a front vehicle body and a rear vehicle body,

the working equipment includes a blade disposed between the front wheel and the rear wheel, and

the front wheel is disposed in front of the blade, and the rear wheel is disposed behind the blade.

10 . The work machine according to claim 9 , wherein

at least one of the plurality of cameras is provided in the front vehicle body and captures an image of a front of the front vehicle body, and

at least one of the plurality of cameras is provided in the rear vehicle body and captures an image of a rear of the rear vehicle body.

11 . The work machine according to claim 10 , wherein

the camera includes a first camera and a second camera that are provided in the front vehicle body and capture images of front of the front vehicle body, and a third camera and a fourth camera that are provided in the rear vehicle body and capture images of rear of the rear vehicle body, and

the processor generates the first display image on the basis of camera images captured by the first camera and the second camera, and generates the second display image on the basis of camera images captured by the third camera and the fourth camera.

12 . A work machine surroundings monitoring method comprising:

acquiring camera images from the plurality of cameras for capturing images surroundings of the work machine;

generating a first display image including a front portion around the work machine on the basis of the camera images;

generating a second display image including a rear portion around the work machine, which is different from that of the first display image, on the basis of the camera images; and

displaying a symbol image indicating the work machine on the display screen, displaying the first display image and the second display image around the symbol image, and generating a signal for displaying a boundary image disposed between the first display image and the second display image.

13 . The work machine surroundings monitoring method according to claim 12 , wherein

a display mode different from that of the first display image is an image viewed from a viewpoint different from that of the first display image.

14 . The work machine surroundings monitoring method according to claim 12 , wherein

the first display image is a panoramic image, and

the second display image is a bird's eye image.

15 . The work machine surroundings monitoring method according to claim 12 , wherein

the camera includes a first camera that acquires a first camera image and a second camera that acquires a second camera image, for generating the first display image, and a third camera that acquires a third camera image and a fourth camera that acquires a fourth camera image, for generating the second display image,

the work machine includes a front vehicle body, a rear vehicle body, and an articulate mechanism that connects the front vehicle body and the rear vehicle body,

the first camera and the second camera are provided in the front vehicle body, and

the third camera and the fourth camera are provided in the rear vehicle body.

16 . The work machine surroundings monitoring method according to claim 15 , wherein

the first display image includes surroundings of the front vehicle body,

the second display image includes surroundings of the rear vehicle body, and

the boundary image is displayed on a side portion of the articulate mechanism of the symbol image.

17 . The work machine surroundings monitoring method according to claim 12 , wherein

the boundary image is generated so as to cover a non-display area where the first display image and the second display image are not displayed on the display screen.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2023
From: MATSUMOTO, HIROSUKE; YASAKU, SHUN
To: KOMATSU LTD.
Reel/Frame 064053/0779 →
Priority Claims (1)
JP 2021-025413 · Feb 19, 2021 · national
Continuity (1)
Related Publication 20240052602A1 · Feb 15, 2024
References Cited (24)
US 9457719B2 · Tanuki et al. · 2016 [cited by applicant]
US 10421400B2 · Imaizumi et al. · 2019 [cited by applicant]
US 10920403B2 · Izumikawa · 2021 [cited by applicant]
US 20130182066A1 · Ishimoto · 2013 [cited by applicant]
US 20140088824A1 · Shimoto · 2014 [cited by applicant]
US 20150217691A1 · Tanuki et al. · 2015 [cited by applicant]
US 20180027179A1 · Matsuzaki et al. · 2018 [cited by applicant]
US 20180222390A1 · Imaizumi et al. · 2018 [cited by applicant]
US 20190078292A1 · Takeichi · 2019 [cited by applicant]
US 20190093317A1 · Izumikawa · 2019 [cited by applicant]
US 20210287335A1 · Goto et al. · 2021 [cited by applicant]
CN 103828351A · 2014 [cited by applicant]
CN 107431789A · 2017 [cited by applicant]
JP 2012074929A · 2012 [cited by applicant]
JP 5066198B2 · 2012 [cited by applicant]
JP 2014064192A · 2014 [cited by applicant]
JP 5779244B2 · 2015 [cited by applicant]
JP 2018044328A · 2018 [cited by applicant]
JP 6597518B2 · 2019 [cited by applicant]
JP 6727971B2 · 2020 [cited by applicant]
JP 2020145581A · 2020 [cited by applicant]
WO 2017131243A1 · 2017 [cited by applicant]
WO 2017163823A1 · 2017 [cited by applicant]
WO 2018008542A1 · 2018 [cited by applicant]