SYSTEM, METHOD, AND COMPUTER PROGRAM FOR TRANSMITTING FACE MODELS BASED ON FACE DATA POINTS

1 . A device, comprising:

a non-transitory memory storing instructions; and

one or more processors in communication with the non-transitory memory, wherein the one or more processors execute the instructions to:

receive a real-time face model, wherein the real-time face model includes one or more face nodal points and a plurality of face parameters;

receive real-time face nodal points, including additional one or more face nodal points; and

manipulate the real-time face model based on the real-time face nodal points;

wherein the device is operable such that the plurality of face parameters is correlated and wherein the correlation occurs synchronously;

wherein the real-time face model includes an image depth map, an audio map, and a correlation map.

2 . The device of claim 1 , wherein face model includes a structure of a face, the structure including a geometric mesh or collection of geometric objects.

3 . The device of claim 1 , wherein the one or more processors further execute the instructions to provide a real-time stream of at least one face associated with the real-time face model, the real-time stream being a video chat.

4 . The device of claim 1 , wherein the one or more processors further execute the instructions to map the real-time face model to control levers on an animation rigging.

5 . The device of claim 1 , wherein the manipulation includes modifying visual parameters associated with a face.

6 . The device of claim 1 , wherein the real-time face model includes at least two of facial contours, minute data points, or main data points.

7 . The device of claim 1 , wherein the plurality of face parameters are animation parameters associated with a particular movement and feature of at least one face.

8 . The device of claim 7 , wherein the animation parameters include at least two of a movement of eyes, a movement of a nose, a movement of a jaw, a movement of a face bone structure, a movement of eyebrows, or a movement of lips.

9 . The device of claim 1 , wherein the real-time face model includes audio data.

10 . The device of claim 9 , wherein the device is operable such that the audio data is used to create an inference of how the manipulation is performed.

11 . The device of claim 1 , wherein the correlation map matches up audio associated with one or more of phonetics, intonations, or emotions, with the one or more face nodal points.

12 . The device of claim 1 , wherein the device is operable such that receiving the real-time face model requires less data usage than receiving real time video frames.

13 . The device of claim 1 , wherein the device is operable such that the real-time face model is further refined using historical data or additional data associated with at least one face.

14 . The device of claim 1 , wherein the device is operable such that the real-time face model is automatically received based on a network latency threshold or a dropped packet threshold condition in place of additional video frames.

15 . The device of claim 1 , wherein the device is further operable to receive a second real-time face model associated with a third party individual or character, receive second real-time face nodal points, and manipulate the second real-time face model based on the second real-time face nodal points.

16 . A method, comprising:

receiving, using a processor, a real-time face model, wherein the real-time face model includes one or more face nodal points and a plurality of face parameters;

receiving, using the processor, real-time face nodal points, including additional one or more face nodal points; and

manipulating, using the processor, the real-time face model based on the real-time face nodal points;

wherein the plurality of face parameters is correlated and wherein the correlation occurs synchronously;

wherein the real-time face model includes an image depth map, an audio map, and a correlation map.

17 . A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:

receive a real-time face model, wherein the real-time face model includes one or more face nodal points and a plurality of face parameters;

receive real-time face nodal points, including additional one or more face nodal points; and

manipulate the real-time face model based on the real-time face nodal points;

wherein the plurality of face parameters is correlated and wherein the correlation occurs synchronously;

wherein the real-time face model includes an image depth map, an audio map, and a correlation map.

18 . A device, comprising:

a non-transitory memory storing instructions; and

one or more processors in communication with the non-transitory memory, wherein the one or more processors execute the instructions to:

receive a real-time face model, wherein the real-time face model includes one or more face nodal points;

receive real-time face nodal points, including additional one or more face nodal points; and

manipulate the real-time face model based on the real-time face nodal points;

wherein the device is operable such that the real-time face model is automatically received based on a network latency threshold or a dropped packet threshold condition in place of additional video frames.

19 . A device, comprising:

a non-transitory memory storing instructions; and

one or more processors in communication with the non-transitory memory, wherein the one or more processors execute the instructions to:

receive a real-time face model, wherein the real-time face model includes one or more face nodal points and audio data;

receive real-time face nodal points, including additional one or more face nodal points; and

manipulate the real-time face model based on the real-time face nodal points;

wherein the device is operable such that the audio data is used to create an inference of how the manipulation is performed.