Systems and methods for artificial intelligence (AI)-assisted communication within video game
Input data is received that includes a message for communication to a target player of a video game. A portion of the input data defining the message is automatically identified using a first artificial intelligence model component. A meaning of the message defined by the portion of the input data is automatically determined using a second artificial intelligence model component. A third artificial intelligence model component is used to automatically determine, based on the meaning of the message, whether or not the message is relevant to a current game state and game context of the target player. A communication to the target player that conveys the meaning of the message is automatically composed through use of a fourth artificial intelligence model component, when the message is determined to be relevant to the current game state and game context of the target player. The communication is delivered to the target player.
1 . A system for artificial intelligence-assisted communication within a video game, comprising:
an input processor configured to receive input data that includes a message for communication to a target player of the video game;
a message identification engine having a first artificial intelligence model component configured and trained to automatically process the input data to identify a portion of the input data defining the message;
a message interpretation engine having a second artificial intelligence model component configured and trained to automatically determine a meaning of the message defined by the portion of the input data as identified by the message identification engine;
a message relevancy assessment engine having a third artificial intelligence model component configured and trained to automatically determine whether or not the message is relevant to a current game state of the target player and a current game context of the target player based on the meaning of the message as determined by the message interpretation engine;
a communication conveyance engine having a fourth artificial intelligence model component configured and trained to automatically compose a communication to the target player that conveys the meaning of the message as determined by the message interpretation engine when the message is determined to be relevant by the message relevancy assessment engine; and
an output processor configured to deliver the communication as composed by the communication conveyance engine to the target player.
2 . The system as recited in claim 1 , wherein the input data includes one or more of a video of a person making a gesture and tracking metadata associated with the person making the gesture, and wherein the message for communication to the target player is provided at least in part by the gesture.
3 . The system as recited in claim 2 , wherein the tracking metadata defines one or more of a pose of the person, a movement of the person, a position of a controller device, an orientation of the controller device, a movement of the controller device, a position of a wearable device worn by the person, an orientation of the wearable device worn by the person, and a movement of the wearable device worn by the person.
4 . The system as recited in claim 2 , wherein the input data includes one or more of an audio clip and a video game controller input, and wherein the message for communication to the target player is provided at least in part by one or more of the audio clip and the video game controller input.
5 . The system as recited in claim 2 , wherein the portion of the input data defining the message is identified as a pixel region within each of a number of video frames of the video of the person making the gesture.
6 . The system as recited in claim 2 , wherein the second artificial intelligence model component is configured and trained to determine the meaning of the message through identification of a body part used to make the gesture and through identification of one or more of a positioning of the body part and a manner of movement of the body part.
7 . The system as recited in claim 2 , wherein the second artificial intelligence model component is configured and trained to determine the meaning of the message before the person finishes making the gesture.
8 . The system as recited in claim 1 , wherein the third artificial intelligence model component is configured and trained to evaluate the meaning of the message to identify a subject of the message and an action associated with the subject of the message, and wherein the third artificial intelligence model component is configured and trained to deem the message relevant when it is determined that the subject of the message is still present within the current game context of the target player and the action associated with the subject of the message is still pertinent to the current game state of the target player.
9 . The system as recited in claim 8 , wherein the third artificial intelligence model component is configured and trained to cancel further processing of the message by the system when it is determined that the subject of the message is no longer present within the current game context of the target player or the action associated with the subject of the message is no longer pertinent to the current game state of the target player.
10 . The system as recited in claim 8 , wherein the third artificial intelligence model component is configured and trained to cancel further processing of the message by the system when it is determined that the action associated with the subject of the message is not beneficial for improving the current game state of the target player.
11 . The system as recited in claim 8 , wherein the third artificial intelligence model component is configured and trained to cancel further processing of the message by the system when it is determined that the subject of the message and the action associated with the subject of the message are redundant with another communication already conveyed to the target player.
12 . The system as recited in claim 1 , wherein the fourth artificial intelligence model component is configured and trained to automatically compose a consolidated communication to the target player that conveys a similar meaning of multiple messages as determined by the message interpretation engine in lieu of automatically composing multiple communications to the target player for the multiple messages.
13 . The system as recited in claim 1 , wherein the fourth artificial intelligence model component is configured and trained to automatically recognize a higher urgency level for conveying the communication to the target player, and wherein the fourth artificial intelligence model component is configured and trained to automatically compose an abbreviated communication to the target player that conveys a shorter version of the message in response to recognizing the higher urgency level for conveying the communication to the target player.
14 . The system as recited in claim 1 , wherein the fourth artificial intelligence model component is configured and trained to automatically determine a format for the communication to the target player, wherein the format is one or more of a textual format, an audible format, a graphical format, and a haptic format.
15 . A method for artificial intelligence-assisted communication within a video game, comprising:
receiving input data that includes a message for communication to a target player of the video game;
automatically identifying a portion of the input data defining the message through execution of a first artificial intelligence model component;
automatically determining a meaning of the message defined by the portion of the input data through execution of a second artificial intelligence model component;
automatically determining based on the meaning of the message whether or not the message is relevant to a current game state and game context of the target player through execution of a third artificial intelligence model component;
automatically composing a communication to the target player that conveys the meaning of the message through execution of a fourth artificial intelligence model component when the message is determined to be relevant to the current game state and game context of the target player; and
delivering the communication to the target player.
16 . The method as recited in claim 15 , wherein the input data includes one or more of a video of a person making a gesture and tracking metadata associated with the person making the gesture, and wherein the message for communication to the target player is provided at least in part by the gesture.
17 . The method as recited in claim 16 , wherein the tracking metadata defines one or more of a pose of the person, a movement of the person, a position of a controller device, an orientation of the controller device, a movement of the controller device, a position of a wearable device worn by the person, an orientation of the wearable device worn by the person, and a movement of the wearable device worn by the person.
18 . The method as recited in claim 16 , wherein the input data includes one or more of an audio clip and a video game controller input, and wherein the message for communication to the target player is provided at least in part by one or more of the audio clip and the video game controller input.
19 . The method as recited in claim 16 , wherein the portion of the input data defining the message is identified as a pixel region within each of a number of video frames of the video of the person making the gesture.
20 . The method as recited in claim 16 , further comprising:
executing the second artificial intelligence component to automatically identify a body part used to make the gesture and to automatically identify one or more of a positioning of the body part and a manner of movement of the body part; and
executing the second artificial intelligence component to analyze the body part, the positioning of the body part, and the manner of movement of the body part to determine the meaning of the message.
21 . The method as recited in claim 16 , further comprising:
executing the second artificial intelligence model component to determine the meaning of the message before the person finishes making the gesture.
22 . The method as recited in claim 15 , further comprising:
executing the third artificial intelligence model component to evaluate the meaning of the message to identify a subject of the message and an action associated with the subject of the message; and
executing the third artificial intelligence model component to deem the message relevant when it is determined that the subject of the message is still present within the current game context of the target player and the action associated with the subject of the message is still pertinent to the current game state of the target player.
23 . The method as recited in claim 22 , further comprising:
executing the third artificial intelligence model component to cancel further processing of the message when it is determined that the subject of the message is no longer present within the current game context of the target player or the action associated with the subject of the message is no longer pertinent to the current game state of the target player.
24 . The method as recited in claim 22 , further comprising:
executing the third artificial intelligence model component to cancel further processing of the message when it is determined that the action associated with the subject of the message is not beneficial for improving the current game state of the target player.
25 . The method as recited in claim 22 , further comprising:
executing the third artificial intelligence model component to cancel further processing of the message when it is determined that the subject of the message and the action associated with the subject of the message are redundant with another communication already conveyed to the target player.
26 . The method as recited in claim 15 , further comprising:
executing the fourth artificial intelligence model component to automatically compose a consolidated communication to the target player that conveys a similar meaning of multiple messages as determined by the second artificial intelligence model component in lieu of automatically composing multiple communications to the target player for the multiple messages.
27 . The method as recited in claim 15 , further comprising:
executing the fourth artificial intelligence model component to automatically recognize a higher urgency level for conveying the communication to the target player; and
executing the fourth artificial intelligence model to automatically compose an abbreviated communication to the target player that conveys a shorter version of the message in response to recognizing the higher urgency level for conveying the communication to the target player.
28 . The method as recited in claim 15 , further comprising:
executing the fourth artificial intelligence model component to automatically determine a format for the communication to the target player, wherein the format is one or more of a textual format, an audible format, a graphical format, and a haptic format.