Custom character creation based on body movement and user input data
A method for generating a character for use in a video game is provided, including: receiving captured video of a user; analyzing the captured video to identify movements of the user; using the identified movements of the user to define one or more animations of a character; receiving descriptive input generated by the user; determining game-specific constraints for the character in the video game; using the descriptive input and the game-specific constraints to prompt a generative artificial intelligence (AI) to generate visual elements of the character; using the character for gameplay of a video game, wherein using the character includes rendering the character having the generated visual elements and triggering the animations during the gameplay.
1 . A computer-implemented method for generating a character for use in a video game, comprising:
receiving captured video of a user;
analyzing the captured video to identify movements of the user;
using the identified movements of the user to define one or more animations of a character;
receiving descriptive input generated by the user, wherein the descriptive input comprises a plurality of words that describe a desired appearance of the character;
determining game-specific constraints for the character in the video game;
generating a text prompt based on the descriptive input and the game-specific constraints, wherein the text prompt includes at least a subset of the plurality of words of the descriptive input;
using the text prompt as an input to prompt a generative artificial intelligence (AI) to generate visual elements of the character; and
using the character for gameplay of a video game, wherein using the character includes rendering the character having the generated visual elements and triggering the animations during the gameplay.
2 . The computer-implemented method of claim 1 , wherein receiving the descriptive input includes recording voice input of the user.
3 . The computer-implemented method of claim 2 , wherein using the descriptive input includes translating the recorded voice input into the plurality of words.
4 . The computer-implemented method of claim 1 , wherein the animations are configured to mimic the identified movements of the user.
5 . The computer-implemented method of claim 1 , wherein using the identified movements includes mapping the movements to a skeletal rig of the character.
6 . The computer-implemented method of claim 1 , wherein using the identified movements includes adjusting settings of one or more predefined animations for the character based on the identified movements.
7 . The computer-implemented method of claim 1 , further comprising, presenting an interface on a display, said interface configured to instruct the user to perform the movements.
8 . The computer-implemented method of claim 1 , wherein triggering the animations is responsive to receiving gameplay input generated from an input device.
9 . The computer-implemented method of claim 1 , wherein the visual elements include one or more of a texture, facial appearance, body structure, or clothing.
10 . The computer-implemented method of claim 1 , wherein the game-specific constraints include one or more of an art style, a character type, or a character function.
11 . The computer-implemented method of claim 1 , wherein the character defines an avatar of the user for the gameplay of the video game.
12 . A non-transitory computer-readable medium having program instructions embodied thereon that, when executed by at least one computing device, cause said at least one computing device to implement a method for generating a character for use in a video game, said method including:
receiving captured video of a user;
analyzing the captured video to identify movements of the user;
using the identified movements of the user to define one or more animations of a character;
receiving descriptive input generated by the user, wherein the descriptive input comprises a plurality of words that describe a desired appearance of the character;
determining game-specific constraints for the character in the video game;
generating a text prompt based on the descriptive input and the game-specific constraints, wherein the text prompt includes at least a subset of the plurality of words of the descriptive input;
using text prompt as an input to prompt a generative artificial intelligence (AI) to generate visual elements of the character; and
using the character for gameplay of a video game, wherein using the character includes rendering the character having the generated visual elements and triggering the animations during the gameplay.
13 . The non-transitory computer-readable medium of claim 12 , wherein receiving the descriptive input includes recording voice input of the user.
14 . The non-transitory computer-readable medium of claim 13 , wherein using the descriptive input includes translating the recorded voice input into the plurality of words.
15 . The non-transitory computer-readable medium of claim 12 , wherein the animations are configured to mimic the identified movements of the user.
16 . The non-transitory computer-readable medium of claim 12 , wherein using the identified movements includes mapping the movements to a skeletal rig of the character.
17 . The non-transitory computer-readable medium of claim 12 , wherein using the identified movements includes adjusting settings of one or more predefined animations for the character based on the identified movements.
18 . The non-transitory computer-readable medium of claim 12 , further comprising, presenting an interface on a display, said interface configured to instruct the user to perform the movements.