IP Library Granted Patent US 10,994,421
Granted Patent B2
US 10,994,421 · App. 16/233,986 · Granted May 4, 2021

System and method for dynamic robot profile configurations based on user interactions

Inventor: Jeremy Nelson (Los Angeles, CA)
Assignee: DMAI, INC.
B25J11/0015B25J9/1697B25J13/08G06N3/008G10L15/22G10L15/222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,994,421
App. No.
16/233,986
Granted
May 4, 2021
Kind
B2
Abstract

The present teaching relates to method, system, medium, and implementations for configuring an animatronic device. Information about a user is obtained for whom an animatronic device is to be configured to carry out a dialogue with the user. One or more preferences of the user are identified from the obtained information and are used to select, from the plurality of selectable profiles, a first selected profile, which specifies parameters to be used to control a manner by which the animatronic device is to communicate with the user. The animatronic device is then configured based on the first selected profile for carrying out the dialogue in the manner specified.

Claims (58)

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for configuring an animatronic device, comprising:

obtaining information about a user for whom an animatronic device is to be configured to carry out a human machine dialogue on a topic with an intended goal with the user; and

identifying one or more preferences of the user from the obtained information;

selecting, from a plurality of selectable profiles, a first selected profile based on the one or more preferences, wherein the first selected profile specifies parameters to be used to control a manner by which the animatronic device carries out the dialogue on the topic with the user;

configuring, dynamically, the animatronic device with an integrated profile determined based on the first selected profile and performance of the user on the topic for carrying out the dialogue in a manner dictated by the integrated profile.

2. The method of claim 1 , wherein each of the plurality of selectable profiles is associated with at least one of a character and a certain persona, wherein a character includes a human and a non-human.

3. The method of claim 2 , wherein the persona associated with each of the plurality of selectable profiles is to be projected by the animatronic device to the user via at least one of voice, facial expression, and speech style.

4. The method of claim 3 , wherein

a voice specified corresponds to one of a boy, a girl, a woman, and a man;

a speech style is determined based on at least some of a language, a speed, a tone, and a pitch of the speech during the dialogue.

5. The method of claim 1 , further comprising selecting, from the plurality of selectable profiles, a second selected profile based on a state of the user detected based on sensor data.

6. The method of claim 5 , wherein the state of the user includes at least one of:

an expression of the user;

an emotion of the user estimated based on the expression of the user and the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

7. The method of claim 5 , wherein the step of configuring the animatronic device comprises:

receiving profile/emotion rankings associated with the first and second selected profiles, wherein the profile/emotion rankings are learned based on the performance; and

determining the integrated profile based on combining the first and second selected profiles in accordance with the performance assessed with respect to the intended goal.

8. Machine readable and non-transitory medium having information recorded thereon for configuring an animatronic device, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining information about a user for whom an animatronic device is to be configured to carry out a human machine dialogue on a topic with an intended goal with the user; and

identifying one or more preferences of the user from the obtained information;

selecting, from a plurality of selectable profiles, a first selected profile based on the one or more preferences, wherein the first selected profile specifies parameters to be used to control a manner by which the animatronic device carries out the dialogue on the topic with the user;

configuring, dynamically, the animatronic device with an integrated profile determined based on the first selected profile and performance of the user on the topic for carrying out the dialogue in a manner dictated by the integrated profile.

9. The medium of claim 8 , wherein each of the plurality of selectable profiles is associated with at least one of a character and a certain persona, wherein a character includes a human and a non-human.

10. The medium of claim 9 , wherein the persona associated with each of the plurality of selectable profiles is to be projected by the animatronic device to the user via at least one of voice, facial expression, and speech style.

11. The medium of claim 10 , wherein

a voice specified corresponds to one of a boy, a girl, a woman, and a man;

a speech style is determined based on at least some of a language, a speed, a tone, and a pitch of the speech during the dialogue.

12. The medium of claim 8 , wherein the information, when read by the machine, further causes the machine to perform selecting, from the plurality of selectable profiles, a second selected profile based on a state of the user detected based on sensor data.

13. The medium of claim 12 , wherein the state of the user includes at least one of:

an expression of the user;

an emotion of the user estimated based on the expression of the user and the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

14. The medium of claim 12 , wherein the step of configuring the animatronic device comprises:

receiving profile/emotion rankings associated with the first and second selected profiles, wherein the profile/emotion rankings are learned based on the performance; and

determining the integrated profile based on the first and second selected profiles in accordance with the performance assessed with respect to the intended goal.

15. A system for configuring an animatronic device, comprising:

a user information based profile selector configured for

obtaining information about a user for whom an animatronic device is to be configured to carry out a human machine dialogue on a topic with an intended goal with the user,

identifying one or more preferences of the user from the obtained information, and

selecting, from a plurality of selectable profiles, a first selected profile based on the one or more preferences, wherein the first selected profile specifies parameters to be used to control a manner by which the animatronic device carries out the dialogue on the topic with the user; and

a profile configuration integrator configured for configuring, dynamically, the animatronic device with an integrated profile determined based on the first selected profile and performance of the user on the topic for carrying out the dialogue in a manner dictated by the integrated profile.

16. The system of claim 15 , wherein each of the plurality of selectable profiles is associated with at least one of a character and a certain persona, wherein a character includes a human and a non-human.

17. The system of claim 16 , wherein the persona associated with each of the plurality of selectable profiles is to be projected by the animatronic device to the user via at least one of voice, facial expression, and speech style.

18. The system of claim 17 , wherein

a voice specified corresponds to one of a boy, a girl, a woman, and a man;

a speech style is determined based on at least some of a language, a speed, a tone, and a pitch of the speech during the dialogue.

19. The system of claim 15 , further comprising a sensor information based profile selector configured for selecting, from the plurality of selectable profiles, a second selected profile based on a state of the user detected based on sensor data.

20. The system of claim 19 , wherein the state of the user includes at least one of:

an expression of the user;

an emotion of the user estimated based on the expression of the user and the sensor data;

an utterance from the user; and

an intent of the user estimated based on the emotion and the utterance of the user.

21. The system of claim 19 , wherein the profile configuration integrator configures the animatronic device by:

receiving profile/emotion rankings associated with the first and second selected profiles, wherein the profile/emotion rankings are learned based on the performance; and

determining the integrated profile based on the first and second selected profiles in accordance with the performance assessed with respect to the intended goal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: DMAL, INC.
To: DMAI (GUANGZHOU) CO.,LTD.
Reel/Frame 065489/0038 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2018
From: NELSON, JEREMY
To: DMAI, INC.
Reel/Frame 047862/0081 →
Continuity (2)
Provisional Application 62630912 · Feb 15, 2018
Related Publication 20190248019A1 · Aug 15, 2019