METHOD AND DEVICE FOR EDITING A FACIAL IMAGE
The invention concerns a method for editing facial expressions in images comprising editing a 3D mesh model of the face to modify a facial expression and generating a new image corresponding to the modified model to provide an image with a modified facial expression.
1 . A method of editing a facial an image depicting at least part of a face of a person with a facial expression, the method comprising:
editing a generic 3D mesh model registered with the facial image to modify the facial expression;
selecting at least one facial image patch according to the person and the edited generic 3D mesh model; and
generating a new facial image as a composition of said selected facial image patches.
2 . The method according to claim 1 wherein the facial image patches are selected from a database of facial image patches collected from a sequence of captured images of the face, each facial image patch corresponding to a part of the face at a given time in the sequence.
3 . The method according to claim 2 wherein the sequence of captured images is registered to a common mesh template model.
4 . The method according to claim 1 , comprising applying localized warps to the 3D mesh model to correct for projective transformations in the new facial image.
5 . The method according to claim 1 , wherein the 3D mesh model is a blendshape model parameterized to blend between different facial expressions.
6 . The method according to claim 1 , comprising performing RGB face image editing, by manipulating a 3D face model as a proxy.
7 . The method according to claim 1 , comprising simultaneously bringing multiple face images into the same facial pose by editing a 3D face model as a proxy.
8 . An image editing device for editing a facial expression in an image of at least part of a face of a person, the device comprising a memory associated with at least one processor configured to:
modify a generic 3D mesh model registered with the facial image to change the facial expression;
select a plurality of facial image patches according to the person and the modified generic 3D mesh model; and
generate a new facial image as a composition of said selected facial image patches.
9 . The image editing device according to claim 8 , wherein the facial image patches are selected from a database of facial image patches collected from a video sequence of captured images of the face, each facial image patch corresponding to a part of the face.
10 . The image editing device according to claim 9 , wherein the video sequence of images is registered to a common mesh template model.
11 . Aft The image editing device according to claim 8 , wherein the at least one processor is configured to apply localized warps to correct for projective transformations in the new facial image.
12 . The image editing device according to claim 8 , wherein the at least one processor is configured to perform RGB face image editing, by manipulating a 3D face model as a proxy.
13 . The image editing device according to claim 8 , wherein the at least one processor is configured to simultaneously bring multiple face images into the same facial pose by editing a 3D face model as a proxy.
14 . Aft The image editing device according to claim 8 , wherein the 3D mesh model is a blendshape model.
15 . A computer program product for a programmable apparatus, the computer program product comprising a sequence of instructions for implementing a method according to claim 1 when loaded into and executed by the programmable apparatus.