IP Library Granted Patent US 10,525,590
Granted Patent B2
US 10,525,590 · App. 15/872,168 · Granted Jan 7, 2020

Robot to human feedback

Inventor: James Joseph Kuffner (Sunnyvale, CA)
Assignee: X Development LLC
B25J9/163B25J9/1674H04W4/30H04W4/80B25J19/061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,525,590
App. No.
15/872,168
Granted
Jan 7, 2020
Kind
B2
Abstract

Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Claims (63)

1. A method comprising:

determining, by a robotic system, a first metric that is associated with a first level of performance of one or more of a state, intended operation, or environment of the robotic system;

based on the first metric, engaging, by the robotic system, in a first feedback mode corresponding to the first level of performance;

determining, by the robotic system, that the first metric changed to a second metric that is associated with a second level of performance; and

based on the second metric, engaging, by the robotic system, in a second feedback mode corresponding to the second level of performance.

2. The method of claim 1 ,

wherein the first level of performance comprises a first level of safety of one or more of the state, intended operation, or environment of the robotic system, and

wherein the second level of performance comprises a second level of safety of one or more of the state, intended operation, or environment of the robotic system.

3. The method of claim 2 ,

wherein the first feedback mode comprises one or more of first visual feedback to represent the first level of safety, first auditory feedback to represent the first level of safety, and one or more first movements to represent the first level of safety, and

wherein the second feedback mode comprises one or more of second visual feedback to represent the second level of safety, second auditory feedback to represent the second level of safety, and one or more second movements to represent the second level of safety.

4. The method of claim 1 ,

wherein engaging in the first feedback mode comprises sending a notification to a computing device.

5. The method of claim 1 ,

wherein engaging in the second feedback mode comprises sending a notification to a computing device.

6. The method of claim 1 , wherein the robotic system comprises one or more appendages, and wherein engaging in the first feedback mode comprises carrying out one or more gestures using the one or more appendages.

7. The method of claim 1 , wherein engaging in the second feedback mode comprises repositioning of the robotic system from a first location in the environment to a second location in the environment.

8. The method of claim 1 , wherein engaging in the second feedback mode comprises the robotic system repositioning an object in the environment from a first location in the environment to a second location in the environment.

9. The method of claim 8 ,

wherein the first location is in a path of a human in the environment, and

wherein the second location is away from the path of the human.

10. The method of claim 1 , further comprising:

determining, by the robotic system, a first distance between the robotic system and an object positioned in the environment,

wherein determining the first metric comprises determining that the first distance is greater than a threshold distance, and

wherein determining that the first metric changed to a second metric comprises determining that a distance between the robotic system and the object changed from the first distance to a second distance that is lesser than the threshold distance.

11. The method of claim 10 , wherein engaging in the second feedback mode comprises repositioning of the robotic system such that the second distance changes to a third distance that is greater than the threshold distance.

12. The method of claim 1 , further comprising:

determining, by the robotic system, a first distance between the robotic system and an object positioned in the environment,

wherein determining the first metric comprises determining that the first distance is lesser than a threshold distance, and

wherein determining that the first metric changed to a second metric comprises determining that a distance between the robotic system and the object changed from the first distance to a second distance that is greater than the threshold distance.

13. The method of claim 1 , further comprising:

predicting, by the robotic system, one or more actions by a human positioned within a threshold distance of the robotic system,

wherein determining that the first metric changed to the second metric is based at least in part on the predicted one or more actions.

14. The method of claim 1 , further comprising:

evaluating, by the robotic system, one or more actions by a human positioned within a threshold distance of the robotic system,

wherein determining that the first metric changed to the second metric is based at least in part on the evaluated one or more actions.

15. A robotic system comprising:

one or more processors;

a non-transitory computer readable medium; and

program instructions stored on the non-transitory computer readable medium and executable by the one or more processors to:

determine a first metric that is associated with a first level of performance of one or more of a state, intended operation, or environment of the robotic system;

based on the first metric, engage in a first feedback mode corresponding to the first level of performance;

determine that the first metric changed to a second metric that is associated with a second level of performance; and

based on the second metric, engage in a second feedback mode corresponding to the second level of performance.

16. The robotic system of claim 15 ,

wherein the first level of performance comprises a first level of safety of one or more of the state, intended operation, or environment of the robotic system, and

wherein the second level of performance comprises a second level of safety of one or more of the state, intended operation, or environment of the robotic system.

17. The robotic system of claim 15 , wherein the program instructions are further executable to:

determine a first distance between the robotic system and an object positioned in the environment,

wherein determining the first metric comprises determining that the first distance is greater than a threshold distance, and

wherein determining that the first metric changed to a second metric comprises determining that a distance between the robotic system and the object changed from the first distance to a second distance that is lesser than the threshold distance.

18. A non-transitory computer readable medium having stored therein instructions executable by one or more processors to cause a robotic system to perform functions comprising:

determining a first metric that is associated with a first level of performance of one or more of a state, intended operation, or environment of the robotic system;

based on the first metric, engaging in a first feedback mode corresponding to the first level of performance;

determining that the first metric changed to a second metric that is associated with a second level of performance; and

based on the second metric, engaging in a second feedback mode corresponding to the second level of performance.

19. The non-transitory computer readable medium of claim 18 ,

wherein the first level of performance comprises a first level of safety of one or more of the state, intended operation, or environment of the robotic system, and

wherein the second level of performance comprises a second level of safety of one or more of the state, intended operation, or environment of the robotic system.

20. The non-transitory computer readable medium of claim 18 , the functions further comprising:

determining a first distance between the robotic system and an object positioned in the environment,

wherein determining the first metric comprises determining that the first distance is greater than a threshold distance, and

wherein determining that the first metric changed to a second metric comprises determining that a distance between the robotic system and the object changed from the first distance to a second distance that is lesser than the threshold distance.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: GOOGLE LLC
To: GDM HOLDING LLC
Reel/Frame 071109/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2023
From: X DEVELOPMENT LLC
To: GOOGLE LLC
Reel/Frame 064658/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2018
From: KUFFNER, JAMES JOSEPH
To: GOOGLE INC.
Reel/Frame 044627/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2018
From: GOOGLE INC.
To: X DEVELOPMENT LLC
Reel/Frame 045075/0063 →