IP Library › Granted Patent US 12,583,120
Granted Patent B2
US 12,583,120 · App. 17/720,271 · Granted Mar 24, 2026

Management server, remote operation system, remote operation method, and storage medium

Inventors: Yuta Kimura (Saitama, JP); Tomohiro Kawakami (Saitama, JP); Takahide Yoshiike (Saitama, JP); Kenichiro Sugiyama (Saitama, JP); Masaaki Muromachi (Saitama, JP); Yoichi Taniguchi (Saitama, JP)
Assignee: Honda Motor Co., Ltd.
B25J9/1689
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,583,120
App. No.
17/720,271
Granted
Mar 24, 2026
Kind
B2
Abstract

A management server according to an embodiment includes a communication part, an acquisition part, an intention estimation part, and a motion control part. The communication part communicates with one or more robot devices and one or more operation terminals that remotely operate at least one of the one or more robot devices via a network. The acquisition part acquires an operation content inputted by the operation terminal. The intention estimation part estimates an intention of an operator of the operation terminal based on the operation content acquired by the acquisition part. The motion control part controls a motion of the robot device based on an intention result estimated by the intention estimation part.

Claims (34)

1 . A management server comprising:

a communication transceiver which communicates with one or more robot devices and one or more operation terminals that remotely operate at least one of the one or more robot devices via a network; and

a processor configured to:

acquire an operation content inputted by the operation terminal and robot control information related to a motion of the robot device and sensor information detected by a sensor provided in the robot device;

estimate an intention of an operator of the operation terminal based on the operation content, and update intention estimation information, wherein the intention includes an intention that the operator makes the one or more robot devices to perform actions and predictions of the actions;

generate motion control information for causing the target robot device among the one or more robot devices to move based on an intention result and the updated intention estimation information, so as to control the motion of the target robot device; and

set different access rights to a first storage part and a second storage part wherein the first storage part stores the robot control information and the intention estimation and the second storage part stores user-specific sensor information so as to be capable of acquiring any of the robot control information and the user-specific sensor information when the set access right is confirmed, wherein the robot control information is control information for moving the robot device.

2 . The management server according to claim 1 , wherein the processor is further configured to make a strength of the access right of the user-specific sensor information greater than a strength of the access right of the robot control information.

3 . The management server according to claim 1 , wherein when the processor is controlling a motion of one robot device based on operation contents acquired from a plurality of operation terminals, the processor is configured to generate motion control information of the robot device based on a priority of the operator who operates the operation terminal.

4 . The management server according to claim 3 , wherein

when a same or similar operation contents are acquired from the plurality of operation terminals by the processor, the processor is further configured to control a motion of the robot device by prioritizing an operation content from an operator having a high priority.

5 . The management server according to claim 3 , wherein the processor is further configured to

estimate an intention of each of the operators of a plurality of operation terminals operating the one robot device, and

output an intention estimation result of each of the operators to each of the plurality of operation terminals.

6 . A remote operation system comprising:

the management server according to claim 1 ;

the one or more robot devices; and

the one or more operation terminals.

7 . The management server of claim 1 , the processor is further configured to:

acquire another operation content inputted by a second operation terminal and robot control information related to a second motion of the robot device and sensor information detected by the sensor provided in the robot device,

estimate a second intention of the second operator of the second operation terminal based on the second operation content and update a second intention estimation information, wherein the second intention includes an intention that the second operator makes the target robot of the one or more robot devices to perform a second action,

in response to the first intention not being in conflict with the second intention, generate a second motion control information for causing a second component of the target robot device to move based on the second intention estimated from the second operator and the updated intention estimation information so as to control the motion of the second component of the target robot device, and

in response to the first intention being in conflict with the second intention, causing the second component of the target robot device to move and not the first component of the target robot device as the second operator has a higher priority in the different access rights than the first operator.

8 . A remote operation method, wherein a computer

communicates with one or more robot devices and one or more operation terminals which remotely operate at least one of the one or more robot devices via a network,

acquires an operation content inputted by the operation terminal and robot control information related to a motion of the robot device and sensor information detected by a sensor provided in the robot device,

estimates an intention of an operator of the operation terminal based on the acquired operation content, and updates intention estimation information, wherein the intention includes an intention that the operator makes the robot devices to perform actions and predictions of the actions,

generates motion control information for causing a target robot device among the robot devices to move based on an estimated intention result and the updated intention estimation information, so as to control a motion of the target robot device, sets different access rights to a first storage part and a second storage part wherein the first storage part stores the robot control information and the intention estimation and the second storage part stores user-specific sensor information so as to be capable of acquiring any of the robot control information and the user-specific sensor information when the set access right is confirmed, wherein the robot control information is control information for moving the robot device.

9 . A non-transitory computer readable storage medium, storing a program causing a computer to

communicate with one or more robot devices and one or more operation terminals which remotely operate at least one of the one or more robot devices via a network,

acquire an operation content inputted by the operation terminal and robot control information related to a motion of the robot device and sensor information detected by a sensor provided in the robot device,

estimate an intention of an operator of the operation terminal based on the acquired operation content, and updates intention estimation information, wherein the intention includes an intention that the operator makes the robot devices to perform actions and predictions of the actions,

generates motion control information for causing a target robot device among the robot devices to move based on an estimated intention result and the updated intention estimation information, so as to control a motion of the target robot device, and

sets different access rights to a first storage part and a second storage part wherein the first storage part stores the robot control information and the intention estimation, and the second storage part stores user-specific sensor information so as to be capable of acquiring any of the robot control information and the user-specific sensor information when the set access right is confirmed, wherein the robot control information is control information for moving the robot device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2022
From: KIMURA, YUTA; KAWAKAMI, TOMOHIRO; YOSHIIKE, TAKAHIDE; SUGIYAMA, KENICHIRO; MUROMACHI, MASAAKI; TANIGUCHI, YOICHI
To: HONDA MOTOR CO., LTD.
Reel/Frame 059617/0607 →
Priority Claims (3)
JP 2021-069233 · Apr 15, 2021 · national
JP 2021-069234 · Apr 15, 2021 · national
JP 2021-069235 · Apr 15, 2021 · national
Continuity (1)
Related Publication 20220331967A1 · Oct 20, 2022
References Cited (41)
US 11541546B2 · Fernando et al. · 2023 [cited by applicant]
US 11850758B2 · Hashimoto · 2023 [cited by examiner]
US 20130218336A1 · David et al. · 2013 [cited by applicant]
US 20150100461A1 · Baryakar · 2015 [cited by examiner]
US 20150224647A1 · Dumora et al. · 2015 [cited by applicant]
US 20180373852A1 · Tsubota · 2018 [cited by examiner]
US 20190359424A1 · Avraham · 2019 [cited by examiner]
US 20200016767A1 · Song · 2020 [cited by examiner]
US 20200078950A1 · Fernando et al. · 2020 [cited by applicant]
US 20200234160A1 · Naim et al. · 2020 [cited by applicant]
US 20210001487A1 · Ohtsuka · 2021 [cited by examiner]
US 20210002860A1 · Otani et al. · 2021 [cited by applicant]
US 20210046655A1 · Deyle · 2021 [cited by examiner]
US 20210072759A1 · Baek · 2021 [cited by examiner]
US 20210178581A1 · Yamamoto · 2021 [cited by examiner]
US 20210220990A1 · Hasunuma · 2021 [cited by examiner]
US 20210373576A1 · Sohn · 2021 [cited by examiner]
US 20220297300A1 · Hashiguchi · 2022 [cited by examiner]
US 20220297303A1 · Khansari Zadeh · 2022 [cited by examiner]
US 20230053995A1 · Yahata · 2023 [cited by examiner]
US 20230390937A1 · Fukabori · 2023 [cited by examiner]
CN 105959618 · 2016 [cited by applicant]
CN 107430738 · 2017 [cited by applicant]
CN 110442232 · 2019 [cited by applicant]
CN 110678300 · 2020 [cited by applicant]
CN 111837382 · 2020 [cited by applicant]
CN 112187845 · 2021 [cited by applicant]
JP H10171337 · 1998 [cited by applicant]
JP 2000244886 · 2000 [cited by applicant]
JP 2003092749 · 2003 [cited by applicant]
JP 2011152593 · 2011 [cited by applicant]
JP 2013521137 · 2013 [cited by applicant]
JP 6007377 · 2016 [cited by applicant]
JP 2019168971 · 2019 [cited by applicant]
JP 2020214232 · 2020 [cited by examiner]
JP 2021013159 · 2021 [cited by applicant]
WO 2020189143 · 2020 [cited by applicant]
“Office Action of China Counterpart Application”, issued on Apr. 29, 2023, with English translation thereof, pp. 1-51. [cited by applicant]
Thomas Feix et al., “The GRASP Taxonomy of Human Grasp Types”, IEEE Transactions On Human-Machine Systems, Feb. 2016, pp. 66-77. [cited by applicant]
“Office Action of Japan Counterpart Application”, issued on Jul. 16, 2024, with English translation thereof, pp. 1-8. [cited by applicant]
“Notice of Reasons for Refusal of Japan Counterpart Application”, issued on Aug. 6, 2024, with English translation thereof, p. 1-p. 15. [cited by applicant]