Advanced electronic messaging utilizing animatable 3D models
Dynamically customized animatable 3D models of virtual characters (“avatars”) in electronic messaging are provided. Users of instant messaging are represented dynamically by customized animatable 3D models of a corresponding virtual character. An example method comprises receiving input from a mobile device user, the input being an audio stream and/or an image/video stream; and based on an animatable 3D model and the streams, automatically generating a dynamically customized animatable 3D model corresponding to the user, including performing dynamic conversion of the input into an expression stream and corresponding time information. The example method includes generating a link to the expression stream and corresponding time information, for transmission in an instant message, and causing display of the customized animatable 3D model. Link generation and causing display is performed automatically or in response to user action. The animatable 3D model can be customized in the cloud or downloaded for customization.
1. A method for efficient data transfer, the method comprising:
receiving by an expression decomposer a base mesh from a user to produce a deformed mesh;
converting by a Level Of Detail (LOD) converter the deformed mesh to a four-dimensional wave, the four-dimensional wave comprising a wave function representing changes through time of points in three-dimensional space representing an animation;
performing wave function data compression by an encoder on the four-dimensional wave resulting in a data stream;
selecting a level of detail for the data stream;
compressing the data stream; and
transmitting the compressed data stream to a device.
2. The method of claim 1 , wherein the selecting of a level of detail for the data stream is based on information received from the device.
3. The method of claim 1 , wherein a server performs the selecting of a level of detail.
4. The method of claim 1 , wherein the base mesh is used to determine output of the LOD converter.
5. The method of claim 1 , wherein the data stream includes a mesh.
6. The method of claim 1 , wherein decompressing is performed on a client side.
7. The method of claim 1 , wherein the four-dimensional wave is a surface wave.
8. The method of claim 1 , wherein the data stream is an encoded function of a surface stream.
9. The method of claim 1 , further comprising:
receiving input in a form of a data stream.
10. The method of claim 9 , wherein the data stream includes an audio stream.
11. The method of claim 10 , wherein the data stream includes a visual stream.
12. The method of claim 11 , wherein the visual stream includes a video stream.
13. The method of claim 12 , wherein the visual stream includes an image.
14. The method of claim 13 , wherein the image is a 2D photograph.
15. The method of claim 13 , wherein the image is a 3D photograph.
16. The method of claim 13 , wherein the image is a sketch of a person.
17. The method of claim 13 , wherein the image is a sketch of a character.
18. The method of claim 13 , wherein the image is from a police sketch artist.
19. A system for efficient data transfer, the system comprising:
an expression decomposer;
a Level Of Detail (LOD) converter communicatively coupled to the expression decomposer, the LOD converter converting a deformed mesh to a four-dimensional wave, the four-dimensional wave comprising a wave function representing changes through time of points in three-dimensional space representing an animation;
an encoder communicatively coupled to the LOD converter;
a decoder communicatively coupled to the encoder; and
a player communicatively coupled to the decoder and the LOD converter.
20. The system of claim 19 , further comprising:
the player or a server configured for level of detail selection.