System and method for dynamic robot configuration for enhanced digital experiences

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for configuring an animatronic device, comprising:

selecting a first topic of a task oriented conversation determined with respect to a user engaged in a dialogue in a dialogue scene with the animatronic device;

generating a configuration to be used by the animatronic device to engage the user in the task oriented conversation on the first topic;

obtaining information indicative of performance of the user exhibited in the dialogue, wherein the information includes content of the task oriented conversation on the first topic and observation of the user during the dialogue;

assessing effectiveness of the configuration in engaging the user on the first topic of the task oriented conversation based on the information;

selecting, in accordance with the assessed effectiveness, a second topic of a non-task oriented conversation based on at least one of the observation and performance of the user and what is present in the dialogue scene; and

adjusting the configuration to generate an updated configuration for the animatronic device to use to initiate the non-task oriented conversation on the second topic in order to continue to engage the user in the dialogue.

2. The method of claim 1 , wherein the configuration includes at least one of:

a program used by the animatronic device to drive the dialogue with the user; and

a profile used by the animatronic device to control a manner by which the animatronic device communicates with the user during the dialogue.

3. The method of claim 2 , further comprising:

receiving sensor data acquired from a scene of the dialogue;

estimating an emotion of the user based on the sensor data; and

updating a ranking of the profile with respect to the emotion of the user, wherein the ranking of the profile with respect to an emotion is used to select a profile for the animatronic device when a user is in a certain emotional state.

4. The method of claim 2 , further comprising, prior to initiate the non-task oriented conversation,

switching out the task oriented conversation on the first topic.

5. The method of claim 2 , wherein the step of adjusting the configuration includes changing the profile if the user is not perceptive to content of the task oriented conversation communicated by the animatronic device to the user in a manner dictated by the profile.

6. The method of claim 1 , wherein the step of assessing comprises:

determining whether the performance of the user meets the requirement of the task oriented conversation on the first topic;

determining, based on the performance of the user, whether the user is perceptive to content of the task oriented conversation communicated by the animatronic device to the user.

7. Machine readable and non-transitory medium having information recorded thereon for configuring an animatronic device, wherein the information, when read by the machine, causes the machine to perform the following:

selecting a first topic of a task oriented conversation determined with respect to a user engaged in a dialogue in a dialogue scene with the animatronic device;

generating a configuration to be used by the animatronic device to engage the user in the task oriented conversation on the first topic;

obtaining information indicative of performance of the user exhibited in the dialogue, wherein the information includes content of the task oriented conversation on the first topic and observation of the user during the dialogue;

assessing effectiveness of the configuration in engaging the user on the first topic of the task oriented conversation based on the information;

selecting, in accordance with the assessed effectiveness, a second topic of a non-task oriented conversation based on at least one of the observation and performance of the user and what is present in the dialogue scene; and

adjusting the configuration to generate an updated configuration for the animatronic device to use to initiate the non-task oriented conversation on the second topic in order to continue to engage the user in the dialogue.

8. The medium of claim 7 , wherein the configuration includes at least one of:

a program used by the animatronic device to drive the dialogue with the user; and

a profile used by the animatronic device to control a manner by which the animatronic device communicates with the user during the dialogue.

9. The medium of claim 8 , wherein the information, when read by the machine, further causes the machine to perform:

receiving sensor data acquired from a scene of the dialogue;

estimating an emotion of the user based on the sensor data; and

updating a ranking of the profile with respect to the emotion of the user, wherein the ranking of the profile with respect to an emotion is used to select a profile for the animatronic device when a user is in a certain emotional state.

10. The medium of claim 8 , wherein the information, when read by the machine, further causes the machine to perform, prior to initiate the non-task oriented conversation, switching out the task oriented conversation on the first topic.

11. The medium of claim 8 , wherein the step of adjusting the configuration includes changing the profile if the user is not perceptive to content of the task oriented conversation communicated by the animatronic device to the user in a manner dictated by the profile.

12. The medium of claim 7 , wherein the step of assessing comprises:

determining whether the performance of the user meets the requirement of the task oriented conversation on the first topic;

determining, based on the performance of the user, whether the user is perceptive to content of the task oriented conversation communicated by the animatronic device to the user.

13. A system for configuring an animatronic device, comprising:

a program configuration unit configured for

selecting a first topic of a task oriented conversation determined with respect to a user engaged in a dialogue in a dialogue scene with the animatronic device, and

generating a configuration to be used by the animatronic device to engage the user in the task oriented conversation on the first topic;

a performance information analyzer configured for

obtaining information indicative of performance of the user exhibited in the dialogue, wherein the information includes content of the task oriented conversation on the first topic and observation of the user during the dialogue, and

assessing effectiveness of the configuration in engaging the user on the first topic of the task oriented conversation based on the information;

a program adjuster configured for

selecting, in accordance with the assessed effectiveness, a second topic of a non-task oriented conversation based on at least one of the observation and performance of the user and what is present in the dialogue scene, and

to generate an updated configuration for the animatronic device to use to initiate the non-task oriented conversation on the second topic in order to continue to engage the user in the dialogue.

14. The system of claim 13 , wherein the configuration includes at least one of:

a program used by the animatronic device to drive the dialogue with the user; and

a profile used by the animatronic device to control a manner by which the animatronic device communicates with the user during the dialogue.

15. The system of claim 14 , further comprising:

a user emotion estimator configured for

receiving sensor data acquired from a scene of the dialogue, and

estimating an emotion of the user based on the sensor data; and

an emotion/profile ranking unit configured for updating a ranking of the profile with respect to the emotion of the user, wherein the ranking of the profile with respect to an emotion is used to select a profile for the animatronic device when a user is in a certain emotional state.

16. The system of claim 14 , further comprising an interaction controller configured for, prior to initiate the non-task oriented conversation, switching out the task oriented conversation on the first topic.

17. The system of claim 14 , wherein the step of adjusting the configuration includes changing the profile if the user is not perceptive to content of the task oriented conversation communicated by the animatronic device to the user in a manner dictated by the profile.

18. The system of claim 13 , wherein the step of assessing comprises:

determining whether the performance of the user meets the requirement of the task oriented conversation on the first topic;

determining, based on the performance of the user, whether the user is perceptive to content of the task oriented conversation communicated by the animatronic device to the user.