IP Library Granted Patent US 11,331,807
Granted Patent B2
US 11,331,807 · App. 16/234,041 · Granted May 17, 2022

System and method for dynamic program configuration

Inventor: Jeremy Nelson (Los Angeles, CA)
Assignee: DMAI, INC.
B25J9/1694B25J13/08G06N3/008G10L15/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,331,807
App. No.
16/234,041
Granted
May 17, 2022
Kind
B2
Abstract

The present teaching relates to method, system, medium, and implementations for configuring an animatronic device. Information about a user is obtained for whom an animatronic device is to be configured to carry out a dialogue with the user and is used to select, from a plurality of selectable programs, a program related to a topic to be covered in the dialogue, where the program is to be used by the animatronic device to drive the dialogue with the user. The animatronic device is then configured based on the program for carrying out the dialogue with the user.

Claims (67)

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for configuring a dialogue program, comprising:

obtaining information about a user for whom an animatronic device is to be used to carry out a dialogue with the user;

selecting, from a plurality of selectable programs, a program on a subject having an intended goal based on the information about the user, wherein the program is used to drive the animatronic device to conduct the dialogue with the user on the subject to achieve a performance consistent with the intended goal; and

configuring the program on the subject for the animatronic device to carry out the dialogue with the user.

2. The method of claim 1 , wherein each of the plurality of selectable programs includes one or more sub-portions each of which is related to a topic on the subject.

3. The method of claim 2 , wherein the step of selecting comprises:

determining the program based on at least one registered program previously signed up by the user; and

selecting an initiation program as the program if the user has not previously signed up.

4. The method of claim 3 , wherein the step of selecting an initiation program comprises:

receiving sensor data acquired at a scene where the user is present;

estimating a state of the user based on the sensor data; and

determining the initiation program based on the state of the user.

5. The method of claim 4 , wherein the state of the user includes at least one of:

an emotion of the user estimated based on an expression of the user detected based on the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

6. The method of claim 1 , further comprising:

receiving information related to observed performance of the user exhibited during the dialogue;

assessing the observed performance of the user on the subject against the intended goal; and

adjusting the program in accordance with the assessed performance of the user.

7. The method of claim 6 , wherein the step of adjusting includes:

switching the dialogue based on the program to a non-task oriented dialogue determined based on a state of the user estimated based on sensor data related to the user and surroundings of the user.

8. Machine readable and non-transitory medium having information recorded thereon for configuring a dialogue program, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining information about a user for whom an animatronic device is to be used to carry out a dialogue with the user;

selecting, from a plurality of selectable programs, a program on a subject having an intended goal based on the information about the user, wherein the program is used to drive the animatronic device to conduct the dialogue with the user on the subject to achieve a performance consistent with the intended goal; and

configuring the program on the subject for the animatronic device to carry out the dialogue with the user.

9. The medium of claim 8 , wherein each of the plurality of selectable programs includes one or more sub-portions each of which is related to a topic on the subject.

10. The medium of claim 9 , wherein the step of selecting comprises:

determining the program based on at least one registered program previously signed up by the user; and

selecting an initiation program as the program if the user has not previously signed up.

11. The medium of claim 10 , wherein the step of selecting an initiation program comprises:

receiving sensor data acquired at a scene where the user is present;

estimating a state of the user based on the sensor data; and

determining the initiation program based on the state of the user.

12. The medium of claim 11 , wherein the state of the user includes at least one of:

an emotion of the user estimated based on an expression of the user detected based on the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

13. The medium of claim 8 , wherein the information, when read by the machine, further causes the machine to perform:

receiving information related to observed performance of the user exhibited during the dialogue;

assessing the observed performance of the user on the subject against the intended goal; and

adjusting the program in accordance with the assessed performance of the user.

14. The medium of claim 13 , wherein the step of adjusting includes:

switching the dialogue based on the program to a non-task oriented dialogue determined based on a state of the user estimated based on sensor data related to the user and surroundings of the user.

15. A system for configuring a dialogue program, comprising:

a user registration based program configured for

obtaining information about a user for whom an animatronic device is to be used to carry out a dialogue with the user, and

selecting, from a plurality of selectable programs, a program on a subject having an intended goal based on the information about the user, wherein the program is used to drive the animatronic device to conduct the dialogue with the user on the subject to achieve a performance consistent with the intended goal; and

a program adjuster configured for configuring the program on the subject for the animatronic device to carry out the dialogue with the user.

16. The system of claim 15 , wherein each of the plurality of selectable programs includes one or more sub-portions each of which is related to a topic on the subject.

17. The system of claim 16 , wherein the user registration based program selects the program by:

determining the program based on at least one registered program previously signed up by the user; and

selecting an initiation program as the program if the user has not previously signed up.

18. The system of claim 17 , further comprising a sensor information based program selector configured for selecting an initiation program by:

receiving sensor data acquired at a scene where the user is present;

estimating a state of the user based on the sensor data; and

determining the initiation program based on the state of the user.

19. The system of claim 18 , wherein the state of the user includes at least one of:

an emotion of the user estimated based on an expression of the user detected based on the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

20. The system of claim 15 , wherein the program adjuster is further configured for:

receiving information related to observed performance of the user exhibited during the dialogue;

assessing the observed performance of the user on the subject against the intended goal; and

adjusting the program in accordance with the assessed performance of the user.

21. The system of claim 20 , wherein the program adjuster performs the adjusting by:

switching the dialogue based on the program to a non-task oriented dialogue determined based on a state of the user estimated based on sensor data related to the user and surroundings of the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: DMAL, INC.
To: DMAI (GUANGZHOU) CO.,LTD.
Reel/Frame 065489/0038 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2018
From: NELSON, JEREMY
To: DMAI, INC.
Reel/Frame 047862/0328 →
Continuity (2)
Provisional Application 62630968 · Feb 15, 2018
Related Publication 20190248012A1 · Aug 15, 2019