Method and system of rendering a 3D image for automated facial morphing with a learned generic head model

1. A computerized method for rendering a three-dimensional (3D) digital image for automated facial morphing comprising:

scanning of a user's face with a digital camera to obtain a set of digital images of the user's face;

determining that the user's face is in a compliant state;

implementing an analysis of the set of digital images and implementing a set of pre-rendering steps by:

wherein each digital image comprises a depth data, a red/green/blue (RGB) data, and a facemask data,

implementing an iterative closest path (ICP) algorithm that correlates the set of digital images together by stitching together a cloud of points of the facemask data of each digital image and outputs a set of transformation matrices,

implementing a truncated signed distance function (TSDF) algorithm on the set of the transformation matrices, wherein the TSDF algorithm represents each point of the transformation matrices in a regularized voxel grid and outputs a set of voxel representations as a one-dimension (1-D) array of voxels,

implementing a marching cubes algorithm that obtains each voxel representation of the 1-D array of voxels and creates a three-dimensional (3D) mesh out of the per-voxel values provided by the TSDF and outputs a mesh representation, wherein the mesh representation comprises a set of triangles and vertices,

implementing a cleaning algorithm that obtains the mesh representations and cleans a floating vertices and triangles and outputs a mesh, wherein the mesh comprises a set of scattered points with a normal per point,

implementing a Poisson algorithm on the mesh output and fills in any holes of the mesh, wherein the Poisson algorithm outputs a reconstructed mesh,

fitting the reconstructed mesh on a trained three-dimensional (3D) face model, wherein a specified machine learning algorithm is used to fit the trained 3D face model to a 3D landmarks in the reconstructed mesh;

implementing a texture mapping algorithm that outputs a mask representation, wherein the mask representation illustrates each piece of the digital image with texture values and label values, and

implementing an image stitching algorithm that stitches the digital images with different lighting values to remove any seams; and outputs a single digital image with consistent lighting; and

rendering the 3D digital image of the user's face from the single digital image with consistent lighting,

wherein the fitting of the reconstructed mesh to a FLAME (Faces Learned with an Articulated Model and Expressions) model is performed only for a face portion of the user's face, and wherein the FLAME model comprises a linear shape space trained from a specified number of scans of human heads.

2. The computerized method of claim 1 , wherein the trained three-dimensional (3D) face model comprises the FLAME model.

3. The computerized method of claim 2 , wherein the machine learning comprises a Deep Neural Network algorithm.

4. The computerized method of claim 3 , wherein the machine learning comprises a TENSORFLOW algorithm.

5. The computerized method of claim 4 , wherein the TENSORFLOW algorithm is used to load and sample the FLAME model, and to fit the FLAME model to the 3D landmarks of the reconstructed mesh.

6. The computerized method of claim 1 , wherein the fitting of the reconstructed mesh to the FLAME model is performed on a cloud-computing based server.

7. The computerized method of claim 1 , wherein the fitting of the reconstructed mesh to the FLAME model is performed on a cloud-computing based server.

8. The computerized method of claim 7 , wherein the output of the cloud-computing based server is communicated to a mobile device for implementing the texture mapping algorithm.

9. The computerized method of claim 1 , wherein the fitting of the reconstructed mesh to the FLAME model is performed on a mobile device.

10. The computerized method of claim 1 , wherein the digital camera comprises a mobile-device digital camera array.

11. The computerized method of claim 1 , wherein the 3D digital image of the user's face is displayed on a mobile device.