IP Library Granted Patent US 10,239,202
Granted Patent B1
US 10,239,202 · App. 16/132,162 · Granted Mar 26, 2019

Robot interaction system and method

Inventors: Leisen Huang (San Mateo, CA); Chris Rettstatt (San Mateo, CA); Vikas Gupta (San Mateo, CA); Kevin Liang (San Mateo, CA); Steven Levis (San Mateo, CA); Anthony Fudd (San Mateo, CA); Tim Reardon (San Mateo, CA)
Assignee: Play-i, Inc.
B25J9/0081B25J11/001B25J13/006B25J13/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,239,202
App. No.
16/132,162
Granted
Mar 26, 2019
Kind
B1
Abstract

A method for robot interaction, preferably including: receiving a user input, determining a robot-associated response based on the user input, and presenting the robot-associated response. A system, preferably including: a robot, a conversation client, and a response module.

Claims (65)

1. A method for simulating conversation with a robot, the method comprising:

a) at a user device separate from the robot, receiving, from a user, a conversation input associated with a conversation;

b) at the user device, in response to receiving the conversation input:

sending, to the robot, a control instruction associated with robot simulation of participation in the conversation; and

based on the conversation input and a response module of the user device, determining a response;

c) at the robot:

receiving the control instruction; and

based on the control instruction, controlling the robot to perform an action associated with robot simulation of participation in the conversation;

d) after controlling the robot to perform the action, at the user device, presenting the response; and

e) repeating a) through d) until a conversation input is not received from the user for more than a threshold time interval.

2. The method of claim 1 , further comprising, before a), at the robot:

retrieving a personality module, wherein the personality module is associated with the response module in a one-to-one correspondence; and

automatically controlling the robot based on the personality module.

3. The method of claim 1 , wherein performing b) is not based on robot state and is not based on measurements sampled by the robot.

4. The method of claim 1 , wherein the response module comprises a conversation graph.

5. The method of claim 1 , further comprising, at a remote server separate from the user device and from the robot:

generating an AIML tree index based on an AIML graph; and

sending the AIML tree index to the user device;

wherein the response module comprises the AIML tree index.

6. The method of claim 5 , further comprising, after e):

at the remote server:

determining a modification to the AIML graph;

after determining the modification, generating an updated AIML tree index subset; and

sending the updated AIML tree index subset to the user device;

at the user device:

receiving the updated AIML tree index subset; and

determining an updated AIML tree index based on the AIML tree index and the updated AIML tree index subset; and

after determining the updated AIML tree index, repeating a) through e), wherein the response is determined based on the updated AIML tree index.

7. The method of claim 1 , further comprising, at the user device, before presenting the response, presenting an output indicating of a waiting condition.

8. The method of claim 7 , wherein presenting the output indicating of the waiting condition is performed after determining the response.

9. The method of claim 7 , wherein presenting the output indicating of the waiting condition is performed substantially concurrent with controlling the robot to perform the action.

10. The method of claim 1 , wherein presenting the response comprises displaying a text representation of the response.

11. The method of claim 1 , wherein presenting the response comprises outputting a spoken language representation of the response.

12. The method of claim 1 , further comprising:

at the user device:

based on the conversation input and the response module, determining a second control instruction; and

after sending the control instruction to the robot, sending the second control instruction to the robot; and

at the robot:

receiving the second control instruction; and

after controlling the robot to perform the action, based on the second control instruction, controlling the robot to perform a second action associated with the response.

13. A method for simulating conversation with a robot, the method comprising:

at the robot:

retrieving a personality module; and

automatically controlling the robot based on the personality module;

at a user device separate from the robot;

selecting a response module associated with the personality module;

receiving a conversation input associated with a conversation with a user;

in response to receiving the conversation input, sending, to the robot, a control instruction associated with robot simulation of participation in the conversation; and

based on the conversation input and the response module, determining a response;

at the robot, after automatically controlling the robot based on the personality module:

receiving the control instruction; and

based on the control instruction, controlling the robot to perform an action associated with robot simulation of participation in the conversation; and

after controlling the robot to perform the action, presenting the response to the user.

14. The method of claim 13 , wherein automatically controlling the robot based on the personality module comprises:

controlling the robot to output a visual output; and

controlling the robot to move.

15. The method of claim 13 , wherein the personality module is associated with the response module in a one-to-one correspondence.

16. The method of claim 13 , wherein presenting the response to the user comprises, at the user device, displaying a text representation of the response.

17. The method of claim 13 , wherein presenting the response to the user comprises, at the robot, outputting a spoken language representation of the response.

18. The method of claim 13 , further comprising, at an audio sensor of the robot, sampling an audio input comprising the conversation input, wherein the user device receives the conversation input from the robot.

19. The method of claim 13 , further comprising, at a remote server separate from the user device and from the robot:

generating a parse tree index based on a conversation graph; and

sending the parse tree index to the user device;

wherein the response module comprises the parse tree index.

20. The method of claim 19 , wherein the conversation graph is an AIML graph.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Feb 9, 2026
From: VIKAS GUPTA AND POOJA MITTAL TRUST
To: WONDER WORKSHOP, INC.
Reel/Frame 073735/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2026
From: WONDER WORKSHOP, INC.
To: MORAVIA EDUCATION, INC.
Reel/Frame 073736/0070 →
SECURITY INTEREST Recorded Mar 10, 2020
From: WONDER WORKSHOP, INC.
To: VIKAS GUPTA AND POOJA MITTAL TRUST
Reel/Frame 052136/0533 →
CHANGE OF NAME Recorded Nov 5, 2019
From: PLAY-I, INC.
To: WONDER WORKSHOP, INC.
Reel/Frame 050936/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2019
From: HUANG, LEISEN; RETTSTATT, CHRIS; GUPTA, VIKAS; LIANG, KEVIN; LEVIS, STEVEN; FUDD, ANTHONY; REARDON, TIM
To: PLAY-I, INC.
Reel/Frame 047920/0251 →
Continuity (1)
Provisional Application 62558774 · Sep 14, 2017
Cited By (1)
US 12,186,888