IP Library › Granted Patent US 11,192,253
Granted Patent B2
US 11,192,253 · App. 16/159,383 · Granted Dec 7, 2021

Systems and methods for conditional robotic teleoperation

Inventors: Allison Thackston (San Jose, CA); Sam Zapolsky (San Francisco, CA); Katarina Bouma (Palo Alto, CA); Laura Stelzner (Mountain View, CA); Ron Goldman (Los Altos, CA)
Assignee: TOYOTA RESEARCH INSTITUTE, INC.
B25J9/1689B25J9/1612B25J9/1653B25J9/1664B25J9/1697
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,192,253
App. No.
16/159,383
Filed
Oct 12, 2018
Granted
Dec 7, 2021
Kind
B2
Art Unit
3664
USPC
700/245
Abstract

A method includes providing a virtual representation of an environment of a robot. The virtual representation includes an object representation of an object in the environment. The method further includes determining an attribute of the object within the environment of the robot. The attribute includes at least one of occupancy data, force data, and deformation data pertaining to the object. The method further includes receiving a user command to control the robot to move with respect to the object, and modifying a received user command pertaining to the representation of the object based upon the attribute.

Claims (27)

1. A method comprising:

providing a virtual representation of an environment of a robot, wherein the virtual representation comprises an object representation of an object in the environment;

determining an attribute of the object within the environment of the robot, wherein the attribute comprises deformation data utilizing a deformation threshold corresponding to an amount that the object may be deformed by force exerted by the robot;

receiving user commands to control the robot; and

modifying a received user command pertaining to the virtual representation of the object based upon the attribute.

2. The method of claim 1 wherein the virtual representation is a point cloud representation.

3. The method of claim 1 wherein the object further comprises a plurality of deformation attributes, wherein each attribute applies to a different portion of the object.

4. The method of claim 1 wherein the object is a hazard and modifying the user command further comprises modifying the orientation or path of the robot.

5. The method of claim 1 further comprising modifying the user command to prevent the execution of the user command.

6. The method of claim 1 , further comprising modifying the user command before being sent to the robot to prevent the robot from executing the command.

7. The method of claim 1 , further comprising:

utilizing a second attribute comprising a force threshold to limit an amount of force exerted by the robot upon the object; and

utilizing a third attribute of the object comprising occupancy data prohibiting contact with the object.

8. The method of claim 1 further comprising receiving the attribute from an external database.

9. A system comprising:

an interface component configured to provide a virtual representation of an environment of a robot, wherein the virtual representation comprises an object representation of an object in the environment;

a sensor configured to determine an attribute of the object within the environment of the robot, wherein the attribute comprises deformation data utilizing a deformation threshold corresponding to an amount that the object may be deformed by force exerted by the robot;

a control device configured to receive user commands to control the robot; and

a processor configured to modify a received user command pertaining to the representation of the object based upon the attribute.

10. The system of claim 9 wherein the virtual representation is a point cloud representation.

11. The system of claim 9 wherein the object comprises a plurality of deformation attributes, wherein each attribute applies to a different portion of the object.

12. The system of claim 9 wherein the object is a hazard and modifying the user command further comprises modifying the orientation or path of the robot.

13. The system of claim 9 wherein the processor is further configured to modify the user command before being sent to the robot to prevent the robot from executing the command.

14. The system of claim 9 , further comprising:

a second attribute comprising a force threshold to limit an amount of force exerted by the robot upon the object; and

a third attribute of the object comprising occupancy data prohibiting contact with the object.

15. The system of claim 9 , wherein the processor is further configured to receive the attribute from an external database.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2022
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 060150/0003 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2018
From: THACKSTON, ALLISON; ZAPOLSKY, SAM; BOUMA, KATARINA; STELZNER, LAURA; GOLDMAN, RON
To: TOYOTA RESEARCH INSTITUTE, INC.
Reel/Frame 047153/0064 →
Continuity (1)
Related Publication 20200114515A1 · Apr 16, 2020