IP Library Granted Patent US 11,939,746
Granted Patent B2
US 11,939,746 · App. 16/536,845 · Granted Mar 26, 2024

Surroundings monitoring system for work machine

Inventors: Yoshihisa Kiyota (Kanagawa, JP); Shunsuke Otsuki (Kanagawa, JP); Susumu Aizawa (Kanagawa, JP)
Assignee: SUMITOMO HEAVY INDUSTRIES, LTD.
E02F9/261B60R1/00E02F9/24H04N5/272H04N7/181B60R2300/105B60R2300/303B60R2300/307B60R2300/8033B60R2300/8093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,939,746
App. No.
16/536,845
Granted
Mar 26, 2024
Kind
B2
Abstract

A surroundings monitoring system for a work machine includes an image capturing unit configured to capture an image of surroundings of the work machine and a display device configured to display the image of the surroundings of the work machine captured by the image capturing unit and a mark representing the position of a monitoring target. The display device is configured to display the mark in two or more different display forms.

Claims (22)

1. A surroundings monitoring system for a work machine, the surroundings monitoring system comprising:

a plurality of sensors configured to capture respective images of surroundings of the work machine; and

processing circuitry configured to:

selectively display one of a captured image or an overhead view image at a time on a display, the captured image being an image among the captured respective images of the surroundings of the work machine captured by the plurality of sensors, the overhead view image being an image into which the captured respective images of the surroundings of the work machine captured by the plurality of sensors are combined, the overhead view image viewing the surroundings from above the work machine,

repeatedly detect one or more predetermined monitoring targets in the surroundings of the work machine at predetermined time intervals based on the captured respective images of the surroundings of the work machine captured by the plurality of sensors,

determine whether the captured image or the overhead view image is selectively displayed on the display, and

superimpose a first mark over a first image of the one or more predetermined monitoring targets displayed in the overhead view image in response to detecting the one or more predetermined monitoring targets in a case of determining that the overhead view image is selectively displayed on the display, and superimpose a second mark over a second image of the one or more predetermined monitoring targets displayed in the captured image in response to detecting the one or more predetermined monitoring targets in a case of determining that the captured mage is selectively displayed on the display,

wherein the first mark and the second mark are different in size, and a size of the first mark is smaller than a size of the second mark,

wherein the processing circuitry determines a number of the detected one or more predetermined monitoring targets based on the captured respective images of the surroundings of the work machine,

wherein the processing circuitry selects configuration points representing position information of the first mark or the second mark of the detected one or more predetermined monitoring targets and transmits the position information of the configuration points to the display, and

wherein when the number of the detected one or more predetermined monitoring targets increases, the processing circuitry decreases a number of configuration points of the first mark or the second mark to reduce an amount of data of the position information of the configuration points included in transmission data within a predetermined transmission period with respect to each of the detected one or more predetermined monitoring targets.

2. The surroundings monitoring system as claimed in claim 1 , wherein

the first mark and the second mark are further different in figure type, and

an amount of information of the first mark is smaller than an amount of information of the second mark.

3. The surroundings monitoring system as claimed in claim 2 , wherein the processing circuitry superimposes the first mark over the first image of the detected one or more predetermined monitoring targets such that the first image of the detected one or more predetermined monitoring targets is surrounded by the first mark to be visible inside the first mark, and to superimpose the second mark over the second image of the detected one or more predetermined monitoring targets such that the second image is surrounded by the second mark to be visible inside the second mark.

4. The surroundings monitoring system as claimed in claim 3 , wherein the first mark has a first frame shape having a first opening through which the first image is visible, and the second mark has a second frame shape having a second opening through which the second image is visible.

5. The surroundings monitoring system as claimed in claim 4 , wherein

the first mark and the second mark are different in size with an area of the first opening and an area of the second opening being different, and

the first mark and the second mark are different in figure type with the first frame shape and the second frame shape being different.

6. The surroundings monitoring system as claimed in claim 5 , wherein the first mark and the second mark are different in size and figure type so that the area of the first opening is smaller than the area of the second opening.

7. The surroundings monitoring system as claimed in claim 1 , wherein the figure type of each of the first mark and the second mark is selected from an oval, a line segment, a triangle, a quadrangle, and polygons other than the triangle and the quadrangle, the quadrangle including a diamond shape and a rectangle.

8. The surroundings monitoring system as claimed in claim 1 , wherein the processing circuitry is further configured to cause at least one of the size or a figure type of the first mark to differ according to a number of the images of the surroundings of the work machine captured by the plurality of sensors that are combined into the overhead view image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2019
From: KIYOTA, YOSHIHISA; OTSUKI, SHUNSUKE; AIZAWA, SUSUMU
To: SUMITOMO HEAVY INDUSTRIES, LTD.
Reel/Frame 050012/0917 →
Priority Claims (4)
JP 2017-027860 · Feb 17, 2017 · national
JP 2017-061958 · Mar 27, 2017 · national
JP 2017-069313 · Mar 30, 2017 · national
JP 2017-073017 · Mar 31, 2017 · national
Continuity (2)
Continuation PCTJP2018005591 · Feb 16, 2018
Related Publication 20190360177A1 · Nov 28, 2019
Cited By (2)
US 12,422,672 US 12,441,249