Personalizing robotic interactions
View Patent ↗Systems, methods and non-transitory computer readable media for personalizing robotic interactions are provided. For example, a digital data record associated with a relation between a specific digital character and a particular character may be accessed. Further, an input in a natural language may be received from the particular character. Further, a conversational artificial intelligence model may be used to analyze the digital data record and the input to determine a desired movement for a specific portion of a specific body. The specific body may be associated with the specific digital character. Further, digital signals may be generated. The digital signals may be configured to cause the specific portion of the specific body to undergo the desired movement during an interaction of the specific digital character with the particular character.
1 . A non-transitory computer readable medium storing computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for personalizing interactions, the operations comprising:
accessing a first digital data record associated with a relation between a specific digital character and a first character;
receiving from the first character a first input in a natural language;
using a conversational artificial intelligence model to analyze the first digital data record and the first input to determine a first desired movement for a first portion of a specific body, the specific body is associated with the specific digital character, the first desired movement serves a first goal of the specific digital character;
generating first digital signals, the first digital signals are configured to cause the first portion of the specific body to undergo the first desired movement during an interaction of the specific digital character with the first character;
accessing a second digital data record associated with a relation between the specific digital character and a second character, the second character differs from the first character;
receiving from the second character a second input in the natural language, the second input conveys a substantially same meaning as the first input;
using the conversational artificial intelligence model to analyze the second digital data record and the second input to determine a second desired movement for a second portion of the specific body, the second desired movement differs from the first desired movement, the second desired movement serves a second goal of the specific digital character, the second goal differs from the first goal based on a difference between the second digital data record and the first digital data record; and
generating second digital signals, the second digital signals are configured to cause the second portion of the specific body to undergo the second desired movement during an interaction of the specific digital character with the second character.
2 . The non-transitory computer readable medium of claim 1 , wherein the first desired movement is configured to cause the specific body to perform a hand gesture, and wherein the second desired movement is configured to cause the specific body to perform a head gesture.
3 . The non-transitory computer readable medium of claim 1 , wherein the first desired movement is configured to cause the specific body to produce a first facial expression including a smile, and wherein the second desired movement is configured to cause the specific body to produce a second facial expression not including a smile.
4 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
using the conversational artificial intelligence model to analyze the first digital data record and the first input to determine the first portion of the specific body; and
using the conversational artificial intelligence model to analyze the second digital data record and the second input to determine the second portion of the specific body, wherein the second portion differs from the first portion.
5 . The non-transitory computer readable medium of claim 1 , wherein the specific digital character is at least one of a digital clone or a digital agent of a specific human individual, the first digital data record is associated with a relation between the specific human individual and the first character, and the second digital data record is associated with a relation between the specific human individual and the second character.
6 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise generating audible speech output during the interaction of the specific digital character with the first character, wherein the generated audible speech output includes an articulation of a first part including a particular word and an articulation of a second part including a non-verbal sound, wherein the first desired movement includes a first sub-movement and a second sub-movement, and wherein the first digital signals are configured to cause the first portion of the specific body to undergo the first sub-movement simultaneously with the articulation of the first part, and to cause the first portion of the specific body to undergo the second sub-movement simultaneously with the articulation of the second part.
7 . The non-transitory computer readable medium of claim 1 , wherein the first digital data record is based on an analysis of at least one historic conversation between the specific digital character and the first character, and the second digital data record is based on an analysis of at least one historic conversation between the specific digital character and the second character.
8 . The non-transitory computer readable medium of claim 1 , wherein the first digital data record is indicative of a first type of social relation, the first type of social relation is associated with the relation between the specific digital character and the first character, the second digital data record is indicative of a second type of social relation, the second type of social relation is associated with the relation between the specific digital character and the second character, the second type of social relation differs from the first type of social relation, the determination of the first desired movement is based on the first type of social relation, the determination of the second desired movement is based on the second type of social relation, and the second desired movement differs from the first desired movement based on the second type of social relation being different from the first type of social relation.
9 . The non-transitory computer readable medium of claim 1 , wherein the first digital data record is indicative of a first degree of friendship, the first degree of friendship is associated with the relation between the specific digital character and the first character, the second digital data record is indicative of a second degree of friendship, the second degree of friendship is associated with the relation between the specific digital character and the second character, the second degree of friendship differs from the first degree of friendship, the determination of the first desired movement is based on the first degree of friendship, the determination of the second desired movement is based on the second degree of friendship, and the second desired movement differs from the first desired movement based on the second degree of friendship being different from the first degree of friendship.
10 . The non-transitory computer readable medium of claim 1 , wherein the second desired movement is associated with a different level of formality than the first desired movement based on a type of relation associated with the relation between the specific digital character and the first character being different from a type of relation between the specific digital character and the second character.
11 . The non-transitory computer readable medium of claim 1 , wherein the second desired movement is associated with a different level of empathy than the first desired movement based on a degree of relation associated with the relation between the specific digital character and the first character being different from a degree of relation between the specific digital character and the second character.
12 . The non-transitory computer readable medium of claim 1 , wherein, based on a type of relation associated with the relation between the specific digital character and the first character, the first desired movement is configured to cause a physical contact between the specific body and the first character, and wherein, based on a type of relation associated with the relation between the specific digital character and the second character, the second desired movement is configured not to cause a physical contact between the specific body and the second character.
13 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
analyzing the first digital data record to identify a first mathematical object in a mathematical space;
analyzing the second digital data record to identify a second mathematical object in the mathematical space;
calculating a convolution of a fragment of the first input to obtain a first numerical result value;
calculating a convolution of a fragment of the second input to obtain a second numerical result value;
calculating a function of the first numerical result value and the first mathematical object to obtain a third mathematical object in the mathematical space;
basing the determination of the first desired movement on the third mathematical object;
calculating a function of the second numerical result value and the second mathematical object to obtain a fourth mathematical object in the mathematical space; and
basing the determination of the second desired movement on the fourth mathematical object.
14 . The non-transitory computer readable medium of claim 1 , wherein the second input includes same words as the first input.
15 . The non-transitory computer readable medium of claim 1 , wherein the specific body is a visual depiction of a virtual body of the specific digital character.
16 . The non-transitory computer readable medium of claim 1 , wherein the specific body is a robot associated with the specific digital character.
17 . The non-transitory computer readable medium of claim 1 , wherein the specific body includes one or more actuators, the generated first digital signals are configured to control a first at least part of the one or more actuators to cause the first portion of the specific body to undergo the first desired movement during the interaction of the specific digital character with the first character, and the generated second digital signals are configured to control a second at least part of the one or more actuators to cause the second portion of the specific body to undergo the second desired movement during the interaction of the specific digital character with the second character.
18 . The non-transitory computer readable medium of claim 1 , wherein the first desired movement is configured to cause the specific body to perform a gesture, and wherein the second desired movement is configured to cause the specific body to produce a facial expression.
19 . A non-transitory computer readable medium storing computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for personalizing interactions, the operations comprising:
accessing a first digital data record associated with a relation between a specific digital character and a first character;
receiving from the first character a first input in a natural language, the first input is indicative of a desire of the first character for the specific digital character to perform a first manipulation of a particular object;
based on the first digital data record and the first input, determining to perform the first manipulation of the particular object;
analyzing the first digital data record and the first input to determine a first desired movement for a first portion of a specific body, the specific body is associated with the specific digital character, the first desired movement is configured to cause the first manipulation of the particular object;
generating first digital signals, the first digital signals are configured to cause the first portion of the specific body to undergo the first desired movement;
accessing a second digital data record associated with a relation between the specific digital character and a second character, the second character differs from the first character;
receiving from the second character a second input in the natural language, the second input is indicative of a desire of the second character for the specific digital character to perform a second manipulation of the particular object;
and
based on the second digital data record and the second input, determining not to perform the second manipulation of the particular object.
20 . The non-transitory computer readable medium of claim 19 , wherein the operations further comprise:
receiving from the first character a third input in the natural language;
based on the third input from the first character, determining to perform the second manipulation of the particular object; and
generating second digital signals, the second digital signals are configured to cause a second portion of the specific body to undergo a movement configured to cause the second manipulation of the particular object.
21 . The non-transitory computer readable medium of claim 19 , wherein the operations further comprise:
receiving from the second character a third input in the natural language;
based on the second digital data record and the third input, determining to perform the second manipulation of the particular object; and
generating second digital signals, the second digital signals are configured to cause a second portion of the specific body to undergo a movement configured to cause the second manipulation of the particular object.
22 . The non-transitory computer readable medium of claim 19 , wherein the desire of the first character for the specific digital character to perform the first manipulation of the particular object is a desire of the first character for the specific digital character to bring the particular object to the first character, the desire of the second character for the specific digital character to perform the second manipulation of the particular object is a desire of the second character for the specific digital character to bring the particular object to the second character, and the first desired movement is configured to bring the particular object to the first character.
23 . The non-transitory computer readable medium of claim 19 , wherein the desire of the first character for the specific digital character to perform the first manipulation of the particular object is a desire of the first character for the specific digital character to change a state of the particular object to a particular state, the desire of the second character for the specific digital character to perform the second manipulation of the particular object is a desire of the second character for the specific digital character to change the state of the particular object to the particular state, and the first desired movement is configured to change the state of the particular object to the particular state.
24 . The non-transitory computer readable medium of claim 19 , wherein the first desired movement includes a physical contact with a specific object to cause the first manipulation of the particular object, and no physical contact with the particular object.
25 . A system for personalizing interactions, the system comprising:
at least one processing unit configured to perform operations, the operations comprise:
accessing a first digital data record associated with a relation between a specific digital character and a first character;
receiving from the first character a first input in a natural language;
using a conversational artificial intelligence model to analyze the first digital data record and the first input to determine a first desired movement for a first portion of a specific body, the specific body is associated with the specific digital character, the first desired movement serves a first goal of the specific digital character;
generating first digital signals, the first digital signals are configured to cause the first portion of the specific body to undergo the first desired movement during an interaction of the specific digital character with the first character;
accessing a second digital data record associated with a relation between the specific digital character and a second character, the second character differs from the first character;
receiving from the second character a second input in the natural language, the second input conveys a substantially same meaning as the first input;
using the conversational artificial intelligence model to analyze the second digital data record and the second input to determine a second desired movement for a second portion of the specific body, the second desired movement differs from the first desired movement, the second desired movement serves a second goal of the specific digital character, the second goal differs from the first goal based on a difference between the second digital data record and the first digital data record; and
generating second digital signals, the second digital signals are configured to cause the second portion of the specific body to undergo the second desired movement during an interaction of the specific digital character with the second character.
26 . A method for personalizing interactions, the method comprising:
accessing a first digital data record associated with a relation between a specific digital character and a first character;
receiving from the first character a first input in a natural language;
using a conversational artificial intelligence model to analyze the first digital data record and the first input to determine a first desired movement for a first portion of a specific body, the specific body is associated with the specific digital character, the first desired movement serves a first goal of the specific digital character;
generating first digital signals, the first digital signals are configured to cause the first portion of the specific body to undergo the first desired movement during an interaction of the specific digital character with the first character;
accessing a second digital data record associated with a relation between the specific digital character and a second character, the second character differs from the first character;
receiving from the second character a second input in the natural language, the second input conveys a substantially same meaning as the first input;
using the conversational artificial intelligence model to analyze the second digital data record and the second input to determine a second desired movement for a second portion of the specific body, the second desired movement differs from the first desired movement, the second desired movement serves a second goal of the specific digital character, the second goal differs from the first goal based on a difference between the second digital data record and the first digital data record; and
generating second digital signals, the second digital signals are configured to cause the second portion of the specific body to undergo the second desired movement during an interaction of the specific digital character with the second character.
27 . A non-transitory computer readable medium storing computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for personalizing interactions, the operations comprising:
accessing a first digital data record associated with a relation between a specific digital character and a first character;
analyzing the first digital data record to identify a first mathematical object in a mathematical space;
receiving from the first character a first input in a natural language;
calculating a convolution of a fragment of the first input to obtain a first numerical result value;
calculating a function of the first numerical result value and the first mathematical object to obtain a third mathematical object in the mathematical space;
based on the third mathematical object, determining a first desired movement for a first portion of a specific body, the specific body is associated with the specific digital character;
generating first digital signals, the first digital signals are configured to cause the first portion of the specific body to undergo the first desired movement during an interaction of the specific digital character with the first character;
accessing a second digital data record associated with a relation between the specific digital character and a second character, the second character differs from the first character;
analyzing the second digital data record to identify a second mathematical object in the mathematical space;
receiving from the second character a second input in the natural language, the second input conveys a substantially same meaning as the first input;
calculating a convolution of a fragment of the second input to obtain a second numerical result value;
calculating a function of the second numerical result value and the second mathematical object to obtain a fourth mathematical object in the mathematical space;
based on the fourth mathematical object, determining a second desired movement for a second portion of the specific body, the second desired movement differs from the first desired movement; and
generating second digital signals, the second digital signals are configured to cause the second portion of the specific body to undergo the second desired movement during an interaction of the specific digital character with the second character.