IP Library Granted Patent US 11,052,541
Granted Patent B1
US 11,052,541 · App. 16/210,403 · Granted Jul 6, 2021

Autonomous robot telerobotic interface

Inventors: Zachary Ian Howard (San Francisco, CA); Ryan Christopher Cargo (Redwood City, CA)
Assignee: Facebook, Inc.
B25J9/1689B25J9/162G05D1/0038G05D1/0061G05D1/0088G05D2201/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,052,541
App. No.
16/210,403
Granted
Jul 6, 2021
Kind
B1
Abstract

An indication of a task to be performed in a network data center is received. A robotic manipulator of an autonomous robot is controlled to autonomously perform at least a portion of the task. It is determined that an assistance is required in performing an identified limited portion of the task. A notification of a request for the assistance is provided. A remote assistance from an operator in performing the identified limited portion of the task is received. Autonomous performance of the task is resumed after completion of the remote assistance for the identified limited portion of the task.

Claims (40)

1. A system for assisting an autonomous robot, comprising:

a robotic manipulator; and

a processor configured to:

receive an indication of a task to perform in a network data center;

control the robotic manipulator to autonomously perform at least a portion of the task;

determine that an assistance is required in performing an identified limited portion of the task;

provide a notification of a request for the assistance, wherein the requested assistance is for the identified limited portion of the task among a series of steps required to perform the task and a limited type scope of the requested assistance is associated with a resumption of autonomous performance of a remaining portion of the series of steps of the task after the identified limited portion of the task to complete the task;

receive a remote assistance from an operator in performing the identified limited portion of the task; and

resume autonomous performance of the task after completion of the remote assistance for the identified limited portion of the task.

2. The system of claim 1 , wherein the task includes power cycling a network device of the network data center.

3. The system of claim 1 , wherein the task includes grabbing a network data center component with the robotic manipulator.

4. The system of claim 1 , wherein the robotic manipulator is equipped with one or more tactile sensors.

5. The system of claim 1 , wherein the indication of the task is received from a management server.

6. The system of claim 1 , wherein the notification of the request for the assistance includes a push notification.

7. The system of claim 1 , further comprising at least one video camera sensor.

8. The system of claim 1 , further comprising one or more LIDAR sensors.

9. The system of claim 1 , wherein the processor is further configured to navigate the autonomous robot around stationary and moving obstacles.

10. The system of claim 1 , wherein the processor is further configured to track a location of the autonomous robot within the network data center.

11. The system of claim 10 , wherein simultaneous localization and mapping (SLAM) is utilized to keep track of the autonomous robot's location within the network data center.

12. The system of claim 11 , wherein the processor is further configured to include a preloaded map of locations of network devices of the network data center.

13. The system of claim 1 , wherein the processor is further configured to send sensory data to a virtual reality or augmented reality display device.

14. The system of claim 1 , wherein the processor is further configured to receive remote assistance that tracks movements of wearable components.

15. The system of claim 1 , wherein the processor is further configured to utilize machine learning to autonomously perform the at least the portion of the task.

16. The system of claim 15 , wherein each remote assistance received from an operator is used to train the autonomous robot in performing subsequent instances of the at least the portion of the task.

17. The system of claim 16 , wherein training the autonomous robot includes training an artificial neural network.

18. The system of claim 1 , wherein a machine learning model is used to determine when the assistance is required in performing the identified limited portion of the task.

19. A method of assisting an autonomous robot, comprising:

receiving an indication of a task to perform in a network data center;

controlling a robotic manipulator to autonomously perform at least a portion of the task;

determining that an assistance is required in performing an identified limited portion of the task;

providing a notification of a request for the assistance, wherein the requested assistance is for the identified limited portion of the task among a series of steps required to perform the task and a limited type scope of the requested assistance is associated with a resumption of autonomous performance of a remaining portion of the series of steps of the task after the identified limited portion of the task to complete the task;

receiving a remote assistance from an operator in performing the identified limited portion of the task; and

resuming autonomous performance of the task after completion of the remote assistance for the identified limited portion of the task.

20. A non-transitory computer readable storage medium storing thereon a computer program product, wherein the computer program product comprising computer instructions for:

receiving an indication of a task to perform in a network data center;

controlling a robotic manipulator to autonomously perform at least a portion of the task;

determining that an assistance is required in performing an identified limited portion of the task;

providing a notification of a request for the assistance, wherein the requested assistance is for the identified limited portion of the task among a series of steps required to perform the task and a limited type scope of the requested assistance is associated with a resumption of autonomous performance of a remaining portion of the series of steps of the task after the identified limited portion of the task to complete the task;

receiving a remote assistance from an operator in performing the identified limited portion of the task; and

resuming autonomous performance of the task after completion of the remote assistance for the identified limited portion of the task.

Assignments (2)
CHANGE OF NAME Recorded Nov 19, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058214/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2019
From: HOWARD, ZACHARY IAN; CARGO, RYAN CHRISTOPHER
To: FACEBOOK, INC.
Reel/Frame 048123/0420 →
Cited By (2)
US 12,231,502 US 12,296,484