IP Library › Granted Patent US 12,325,980
Granted Patent B2
US 12,325,980 · App. 17/451,914 · Granted Jun 10, 2025

Display device, shovel, and information processing apparatus

Inventors: Takeya Izumikawa (Chiba, JP); Takaaki Morimoto (Chiba, JP); Atsushi Nakayama (Chiba, JP); Keiichi Tsuji (Chiba, JP); Yusuke Sato (Chiba, JP); Takashi Umeda (Chiba, JP)
Assignee: SUMITOMO CONSTRUCTION MACHINERY CO., LTD.
E02F9/261B60R1/27E02F9/24G06T11/00G06V20/56B60R2300/105B60R2300/304B60R2300/307B60R2300/8033B60R2300/8093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,325,980
App. No.
17/451,914
Granted
Jun 10, 2025
Kind
B2
Abstract

A display device is provided. The display device displays an image captured by a first camera of a plurality of cameras, the captured image representing a situation around a shovel, and when a predetermined object is detected within an imaging range of a second camera that is different from the first camera, the display device displays an image representing that the predetermined object is detected outside a range of the displayed captured image of the first camera.

Claims (22)

1. A display device,

wherein the display device is configured to display a through-the-lens image captured by a camera, the captured image representing a situation around a shovel, and when an object is detected based on an output of a distance sensor, display an indicator image within the displayed captured image of the camera, the indicator image pointing to a direction in which the detected object is present when an area in the captured image of the camera is viewed from the shovel, and

wherein the display device is configured to, when a predetermined object is detected within an imaging range of the camera based on the captured image of the camera and the output of the distance sensor, display, within the displayed captured image of the camera,

an image of the predetermined object,

a frame image over the image of the predetermined object, the frame image indicating a position of the predetermined object, and

the indicator image separately from the image of the predetermined object and the frame image, the indicator image pointing to a direction in which the predetermined object is present when the area in the captured image of the camera is viewed from the shovel, the indicator image being displayed at a lower end of the displayed captured image of the camera.

2. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera based on the output of the distance sensor, display the indicator image within the displayed captured image of the camera, the indicator image pointing to a direction in which the predetermined object is present when the area in the captured image of the camera is viewed from the shovel, the indicator image pointing outward of the displayed captured image.

3. The display device according to claim 2 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera, display the indicator image within the displayed captured image of the camera without displaying the image of the predetermined object or the frame image.

4. The display device according to claim 1 , wherein the display device is configured to superimpose the indicator image on the displayed captured image of the camera.

5. The display device according to claim 1 , wherein the indicator image includes a gap, the displayed captured image of the camera being exposed through the gap.

6. The display device according to claim 1 , wherein the display device is configured to change a manner of displaying the indicator image in accordance with a distance between the predetermined object and the shovel.

7. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera based on the output of the distance sensor, cause the captured image of the camera to remain displayed until an operation for changing a display content is performed.

8. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected within the imaging range of the camera, display the indicator image pointing inward of the displayed captured image of the camera.

9. The display device according to claim 1 , wherein the display device is configured to display the indicator image having an arrow shape or a triangular shape.

10. The display device according to claim 1 , wherein the distance sensor is one of a LIDAR sensor, a millimeter wave radar, and an ultrasonic sensor.

11. A shovel comprising:

the display device according to claim 1 ; and

a cabin,

wherein the display device is provided within the cabin.

12. An information processing apparatus comprising:

the display device according to claim 1 ; and

an operation device for remote operation of the shovel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: IZUMIKAWA, TAKEYA; MORIMOTO, TAKAAKI; NAKAYAMA, ATSUSHI; TSUJI, KEIICHI; SATO, YUSUKE; UMEDA, TAKASHI
To: SUMITOMO CONSTRUCTION MACHINERY CO., LTD.
Reel/Frame 057927/0952 →
Priority Claims (1)
JP 2019-086881 · Apr 26, 2019 · national
Continuity (2)
Continuation PCTJP2020017574 · Apr 23, 2020
Related Publication 20220074171A1 · Mar 10, 2022
References Cited (25)
US 6919917B1 · Janssen · 2005 [cited by examiner]
US 9332229B2 · Ishimoto · 2016 [cited by applicant]
US 20130182066A1 · Ishimoto · 2013 [cited by examiner]
US 20130222573A1 · Onuma · 2013 [cited by examiner]
US 20140118551A1 · Ikeda et al. · 2014 [cited by applicant]
US 20140354813A1 · Ishimoto · 2014 [cited by examiner]
US 20150307024A1 · Fukuda · 2015 [cited by examiner]
US 20170282794A1 · Kowatari · 2017 [cited by examiner]
US 20170286763A1 · Fukuda · 2017 [cited by examiner]
US 20170305018A1 · Machida · 2017 [cited by examiner]
US 20190352885A1 · Kurokami · 2019 [cited by examiner]
US 20190360177A1 · Kiyota et al. · 2019 [cited by applicant]
US 20200071912A1 · Kennedy · 2020 [cited by examiner]
US 20200284607A1 · Mangal · 2020 [cited by examiner]
JP 2010112100 · 2010 [cited by applicant]
JP 20135233 · 2013 [cited by applicant]
JP 2014181508 · 2014 [cited by applicant]
JP 2016119559 · 2016 [cited by applicant]
JP 2018157449 · 2018 [cited by applicant]
JP 2019015176 · 2019 [cited by applicant]
WO 2006106685 · 2006 [cited by applicant]
WO 2011158955 · 2011 [cited by applicant]
WO 2017038123 · 2017 [cited by applicant]
WO 2018151280 · 2018 [cited by applicant]
International Search Report for PCT/JP2020/017574 mailed on Jul. 28, 2020. [cited by applicant]