Avatar control system
Systems and methods herein are directed to avatar control systems. In one embodiment, interactive holographic avatar control is described. In another embodiment, remote kinetic avatar control is described. In still another embodiment, depth-based user tracking for avatar control is described. In still another embodiment, enhanced avatar kinetic movement interpolation is described. In still another embodiment, dynamic joint mapping for avatar control is described. In still another embodiment, dynamic animation population for avatar control is described.
1. A method, comprising:
generating an avatar for display as a holographic projection, wherein the avatar is a computer animated graphical representation;
receiving user control input of the avatar, the user control input based on detected movements of the user via a natural user interface executing skeletal tracking to detect the movements of the user at a remote location;
converting the user control input into avatar movement;
displaying the avatar with the avatar movement as a holographic projection; and
projecting the holographic projection of the avatar with the avatar movement based on the skeletal tracking using a Pepper's Ghost Illusion technique.
2. The method as in claim 1 , wherein the holographic projection is of a character.
3. The method as in claim 1 , further comprising:
using a projector or video display panel as a light source for the Pepper's Ghost Illusion technique.
4. The method as in claim 1 , further comprising:
interfacing a camera, microphone, or speaker to allow a viewer of the avatar to interact with the avatar.
5. The method as in claim 4 , wherein receiving user control input of the avatar based on detected movements of the user comprises:
receiving control signals from a controller located to a side of the projection or located at a remote location.
6. The method as in claim 1 , further comprising:
controlling the avatar using an artificial intelligence engine that is configured to interact with a viewer of the avatar.
7. The method as in claim 6 , wherein controlling the avatar using an artificial intelligence engine comprises:
playing a prerecorded voice dialogue and prerecorded animations.
8. The method as in claim 1 , wherein the holographic projection is configured to enable a participant to stand behind the holographic projection to appear to a viewer of the avatar that the participant is physically interacting with the avatar, wherein the method further comprises:
providing an image to the participant of the avatar from the perspective of the viewer.
9. A tangible, non-transitory, computer-readable media having software encoded thereon that causes a holographic projection system to execute a process comprising:
generating an avatar for display as a holographic projection, wherein the avatar is a computer animated graphical representation;
receiving user control input of the avatar, the user control input based on detected movements of the user via a natural user interface executing skeletal tracking to detect the movements of the user at a remote location;
converting the user control input into avatar movement;
displaying the avatar with the avatar movement as a holographic projection; and
projecting the holographic projection of the avatar with the avatar movement based on the skeletal tracking using a Pepper's Ghost Illusion technique.
10. The computer readable medium as in claim 9 , wherein the holographic projection is of a character.
11. The computer readable medium as in claim 9 , wherein the holographic projection system further comprises a projector or video display panel as a light source for the Pepper's Ghost Illusion technique.
12. The computer readable medium as in claim 9 , wherein the process further comprises:
interfacing a camera, microphone, or speaker to allow a viewer of the avatar to interact with the avatar.
13. The computer readable medium as in claim 9 , wherein receiving user control input of the avatar based on detected movements of the user comprises:
receiving control signals from a controller located to a side of the projection or located at a remote location.
14. The computer readable medium as in claim 9 , wherein the process further comprises:
controlling the avatar using an artificial intelligence engine that is configured to interact with a viewer of the avatar.
15. The computer readable medium as in claim 14 , wherein controlling the avatar using an artificial intelligence engine comprises:
playing a prerecorded voice dialogue and prerecorded animations.
16. The computer readable medium as in claim 9 , wherein the holographic projection is configured to enable a participant to stand behind the holographic projection to create the illusion to a viewer of the avatar that the participant is physically interacting with the avatar, wherein the process further comprises:
providing an image to the participant of the avatar from the perspective of the viewer.
17. An apparatus comprising:
a holographic projection system including a processor coupled configured to execute one or more processes; and
a memory configured to store a process executable by the processor, the process when executed configured to:
generate an avatar for display as a holographic projection, wherein the avatar is a computer animated graphical representation;
receive user control input of the avatar, the user control input based on detected movements of the user via a natural user interface executing skeletal tracking to detect the movements of the user at a remote location;
convert the user control input into avatar movement;
display the avatar with the avatar movement as a holographic projection; and
project the holographic projection of the avatar with the avatar movement based on the skeletal tracking using a Pepper's Ghost Illusion technique.
18. The apparatus as in claim 17 , wherein the process when executed is further configured to:
control the avatar using an artificial intelligence engine that is configured to interact with a viewer of the avatar.