IP Library › Granted Patent US 11,732,440
Granted Patent B2
US 11,732,440 · App. 17/438,145 · Granted Aug 22, 2023

Remote operation system and remote operation server

Inventors: Masaki Otani (Hiroshima, JP); Hitoshi Sasaki (Hiroshima, JP); Seiji Saiki (Hiroshima, JP); Yoichiro Yamazaki (Hiroshima, JP)
Assignee: Kobelco Construction Machinery Co., Ltd.
E02F9/205E02F9/261G05D1/0038G06V40/18H04N7/183G05D2201/0202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,732,440
App. No.
17/438,145
Granted
Aug 22, 2023
Kind
B2
Abstract

Provided is a system which can supply appropriate information to one operator from a viewpoint that the one operator grasps a remotely operated action of a working machine by another operator. In a first remote operation apparatus 10 , a sight line detector 112 detects a sight line of a first operator, and transmits sight line detection data corresponding to the sight line of the first operator. In a second remote operation apparatus 20 , a second image output device 221 displays a designated image region spreading with reference to the sight line of the first operator corresponding to the sight line detection data in an environmental image corresponding to captured image data acquired by an imaging device 401 of a working machine 40 , in a form different from a form of an image region around the designated image region.

Claims (8)

1. A remote operation system comprising:

a working machine including an actuation mechanism and an imaging device which images environment including at least a part of the actuation mechanism; and

a first remote operation apparatus and a second remote operation apparatus each including wireless communication equipment, an image output device which displays an environmental image corresponding to captured image data acquired by the imaging device of the working machine and an operation mechanism configured to perform a remote operation of the working machine, wherein

the first remote operation apparatus comprises a sight line detector which detects a sight line of an operator, and a first client control device which transmits, to the wireless communication equipment, sight line detection data corresponding to the sight line of the operator which is detected by the sight line detector, and

the second remote operation apparatus comprises a second client control device which displays, in the image output device, a designated image region as an image region spreading with reference to the sight line of the operator corresponding to the sight line detection data received by the wireless communication equipment in the environmental image, in a form different from a form of an image region around the designated image region.

2. A remote operation server having an intercommunicating function with a working machine including an actuation mechanism and an imaging device which images environment including at least a part of the actuation mechanism, and with each of a first remote operation apparatus and a second remote operation apparatus each including an image output device which displays an environmental image corresponding to captured image data acquired by the imaging device of the working machine by use of a wireless communicating function and an operation mechanism configured to perform a remote operation of the working machine, the remote operation server comprising:

a first server arithmetic processing element which receives, from the first remote operation apparatus, sight line detection data corresponding to a sight line of an operator which is detected in the first remote operation apparatus; and

a second server arithmetic processing element which transmits the sight line detection data to the second remote operation apparatus, and displays, in the image output device of the second remote operation apparatus, a designated image region as an image region spreading with reference to the sight line of the operator corresponding to the sight line detection data in the environmental image, in a form different from a form of an image region around the designated image region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2021
From: OTANI, MASAKI; SASAKI, HITOSHI; SAIKI, SEIJI; YAMAZAKI, YOICHIRO
To: KOBELCO CONSTRUCTION MACHINERY CO., LTD.
Reel/Frame 057446/0598 →
Priority Claims (1)
JP 2019-058104 · Mar 26, 2019 · national
Continuity (1)
Related Publication 20220186465A1 · Jun 16, 2022