IP Library Granted Patent US 11,826,897
Granted Patent B2
US 11,826,897 · App. 17/457,831 · Granted Nov 28, 2023

Robot to human feedback

Inventor: James Joseph Kuffner (Sunnyvale, CA)
Assignee: Google LLC
B25J9/163B25J9/1674H04W4/30H04W4/80B25J19/061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,826,897
App. No.
17/457,831
Granted
Nov 28, 2023
Kind
B2
Abstract

Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Claims (43)

1. A method comprising:

determining, by a robotic system, a motion path of a user in an environment of the robotic system;

based on the motion path of the user in the environment, determining, by the robotic system, a performance metric corresponding to a position of the user along the motion path;

based on the determined performance metric, selecting, by the robotic system, a first feedback mode, wherein the first feedback mode comprises at least one indication to the user;

engaging, by the robotic system, in the first feedback mode;

determining a change in the performance metric based on a change in the position of the user;

based on the determined change in the performance metric, selecting, by the robotic system, a second feedback mode, wherein the second feedback mode comprises at least one additional indication to the user different than the at least one indication of the first feedback mode; and

engaging, by the robotic system, in the second feedback mode.

2. The method of claim 1 , further comprising:

based on the determined change in the performance metric, stopping the robot from engaging in the first feedback mode.

3. The method of claim 1 , wherein the first feedback mode includes operation of a visual indicator.

4. The method of claim 3 , wherein the visual indicator is a light generated by the robotic system.

5. The method of claim 3 , wherein the visual indicator is a gesture performed by the robotic system.

6. The method of claim 1 , wherein the first feedback mode includes operation of an auditory indicator.

7. The method of claim 6 , wherein the auditory indicator comprises a siren.

8. The method of claim 1 , wherein the first feedback mode further comprises a notification sent by the robotic system to a computing device.

9. The method of claim 1 , wherein the robotic system comprises one or more appendages, and wherein engaging in the first feedback mode comprises carrying out one or more gestures using the one or more appendages.

10. The method of claim 1 , wherein engaging in the first feedback mode comprises repositioning of the robotic system from a first location in the environment to a second location in the environment.

11. The method of claim 1 , wherein engaging in the first feedback mode comprises the robotic system repositioning an object in the environment from a first location in the environment to a second location in the environment.

12. The method of claim 11 , wherein the first location is in a path of the user, and wherein the second location is away from the path of the user.

13. The method of claim 1 , wherein engaging in the first feedback mode comprises projecting light from one or more light sources of the robotic system towards an area of interest.

14. A robotic system comprising:

one or more processors;

a non-transitory computer readable medium; and

program instructions stored on the non-transitory computer readable medium and executable by the one or more processors to:

determine an intended path of a user in an environment of the robotic system;

based on the intended path of the user in the environment, determine a performance metric corresponding to a position of the user along the intended path;

based on the determined performance metric, select a first feedback mode, wherein the first feedback mode comprises at least one indication to the user;

engage in the first feedback mode;

determine a change in the performance metric based on a change in the position of the user;

based on the determined change in the performance metric, select a second feedback mode, wherein the second feedback mode comprises at least one additional indication to the user different than the at least one indication of the first feedback mode; and

engage in the second feedback mode.

15. The robotic system of claim 14 , wherein the first and second feedback modes comprise different types of visual indicators.

16. The robotic system of claim 14 , wherein the first feedback modes comprises a visual indicator and the second feedback modes comprises an auditory indicator.

17. The robotic system of claim 14 , wherein the second feedback modes comprises a visual indicator and an auditory indicator.

18. A non-transitory computer readable medium having stored therein instructions executable by one or more processors to cause a robotic system to perform functions comprising:

determining, by the robotic system, a motion path of a user in an environment of the robotic system;

based on the motion path of the user in the environment, determining, by the robotic system, a performance metric corresponding to a position of the user along the motion path;

based on the determined performance metric, selecting, by the robotic system, a first feedback mode, wherein the first feedback mode comprises at least one indication to the user;

engaging, by the robotic system, in the first feedback mode;

determining a change in the performance metric based on a change in the position of the user;

based on the determined change in the performance metric, selecting, by the robotic system, a second feedback mode, wherein the second feedback mode comprises at least one additional indication to the user different than the at least one indication of the first feedback mode; and

engaging, by the robotic system, in the second feedback mode.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: GOOGLE LLC
To: GDM HOLDING LLC
Reel/Frame 071109/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2023
From: X DEVELOPMENT LLC
To: GOOGLE LLC
Reel/Frame 064658/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2021
From: KUFFNER, JAMES JOSEPH
To: GOOGLE INC.
Reel/Frame 058318/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2021
From: GOOGLE INC.
To: X DEVELOPMENT LLC
Reel/Frame 058347/0001 →
Continuity (5)
Continuation 16695532 · Nov 26, 2019
Continuation 15872168 · Jan 16, 2018
Continuation 14835411 · Aug 25, 2015
Provisional Application 62041299 · Aug 25, 2014
Related Publication 20220088776A1 · Mar 24, 2022