IP Library Granted Patent US 10,105,847
Granted Patent B1
US 10,105,847 · App. 15/177,323 · Granted Oct 23, 2018

Detecting and responding to geometric changes to robots

Inventors: Craig Latimer (Mountain View, CA); Umashankar Nagarajan (Santa Clara, CA)
Assignee: X DEVELOPMENT LLC
B25J9/1674B25J9/1697G05B2219/39412Y10S901/09Y10S901/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,105,847
App. No.
15/177,323
Granted
Oct 23, 2018
Kind
B1
Abstract

Methods, apparatus, systems, and computer-readable media are provided for detecting a geometric change in a robot's configuration and taking responsive action in instances where the geometric change is likely to impact operation of the robot. In various implementations, a geometric model of a robot in a selected pose may be obtained. Image data of the actual robot in the selected pose may also be obtained. The image data may be compared to the geometric model to detect a geometric difference between the geometric model and the actual robot. Output may be provided that is indicative of the geometric difference between the geometric model and the actual robot.

Claims (40)

1. A computer-implemented method, comprising:

obtaining, by one or more processors, a geometric model of an actual robot in a selected pose, wherein obtaining the geometric model comprises determining one or more bounded volumes containing one or more operational components of the robot, wherein each of the one or more bounded volumes encompasses multiple possible configurations of a given operational component of the one or more operational components;

obtaining, by one or more of the processors from an image sensor, image data of the actual robot in the selected pose;

comparing, by one or more of the processors, the image data to the geometric model to detect a geometric difference between the geometric model and the actual robot;

determining, by one or more of the processors, that the geometric difference causes one or more of the bounded volumes to be violated;

providing, by one or more of the processors, output indicative of the violation; and

based on the output:

altering a kinematic model of the actual robot and operating the actual robot based on the altered kinematic model; or

ceasing operation of the actual robot.

2. The computer-implemented method of claim 1 , further comprising updating, by the one or more processors, the geometric model in response to the detected geometric difference.

3. The computer-implemented method of claim 1 , wherein the output comprises a warning that the robot will potentially behave unpredictably due to the geometric difference.

4. The computer-implemented method of claim 1 , wherein the geometric model of the robot is based on a computer-aided design of the actual robot.

5. The computer-implemented method of claim 1 , wherein at least one of the one or more bounded volumes comprises a sphere.

6. The computer-implemented method of claim 1 , wherein at least one of the one or more bounded volumes comprises a circle.

7. The computer-implemented method of claim 1 , wherein the providing comprises providing the output in response to a determination, by one or more of the processors, that the geometric difference between the actual robot and the geometric model satisfies one or more thresholds.

8. The computer-implemented method of claim 1 , wherein the image data is obtained from a two-dimensional camera.

9. The computer-implemented method of claim 1 , wherein the image data is obtained from a three-dimensional vision sensor.

10. The computer-implemented method of claim 1 , wherein the image data is obtained from a stereographic camera.

11. The computer-implemented method of claim 1 , wherein the image data is obtained at least in part from a camera mounted on the robot.

12. The computer-implemented method of claim 1 , wherein obtaining the geometric model comprises setting the geometric model to conform to the selected pose.

13. A system comprising one or more processors, an image sensor, and memory, wherein the memory stores instructions that, in response to execution of the instructions by the one or more processors, cause the one or more processors to:

obtain a geometric model of a robot in a selected pose, wherein the geometric model includes one or more bounded volumes containing one or more operational components of the robot, wherein each of the one or more bounded volumes encompasses multiple possible configurations of a given operational component of the one or more operational components;

obtain, from the image sensor, image data of the actual robot in the selected pose;

compare the image data to the geometric model to detect a geometric difference between the geometric model and the actual robot;

determine that the geometric difference causes one or more of the bounded volumes to be violated;

provide output indicative of the violation; and

based on the output:

alter a kinematic model of the actual robot and operating the actual robot based on the altered kinematic model; or

cease operation of the actual robot.

14. The system of claim 13 , further comprising instructions to update the geometric model in response to the detected geometric difference.

15. At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to perform the following operations:

obtaining a geometric model of a robot in a selected pose, wherein obtaining the geometric model comprises determining one or more bounded volumes containing one or more operational components of the robot, wherein each of the one or more bounded volumes encompasses multiple possible configurations of a given operational component of the one or more operational components;

obtaining, from an image sensor, image data of the actual robot in the selected pose;

comparing the image data to the geometric model to detect a geometric difference between the geometric model and the actual robot;

determining, by one or more of the processors, that the geometric difference causes one or more of the bounded volumes to be violated;

providing output indicative of the geometric difference between the geometric model and the actual robot; and

based on the output:

altering a kinematic model of the actual robot and operating the actual robot based on the altered kinematic model; or

ceasing operation of the actual robot.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein the geometric model of the robot is based on a computer-aided design of the actual robot.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2016
From: GOOGLE INC.
To: X DEVELOPMENT LLC
Reel/Frame 039900/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: LATIMER, CRAIG; NAGARAJAN, UMASHANKAR
To: GOOGLE INC.
Reel/Frame 039346/0241 →
Cited By (1)
US 12,715,117