Method and system for reconstructing obstructed face portions for virtual reality environment
A method and a system for reconstructing obstructed face portions are provided herein. The method may include the following steps: obtaining off-line 3D data, being 3D data of a head of a person not wearing a face-obstructing object, being an object which obstructs a portion of the face of the person; obtaining in real time, real-time 3D data, being 3D data of said head, wherein said person wears said face-obstructing object; applying a 3D transformation to at least a portion of the off-line 3D data, based on the real-time 3D data, to yield reconstructed real time 3D data, being real-time 3D data related to the obstructed face portions; and merging the reconstructed real time 3D data into the real-time 3D data. The system may implement the aforementioned steps over a computer processor.
1. A method comprising:
sensing, by a sensor on an inner side of a face-obstructing object, facial gestures of face portions of a person obstructed by the face-obstructing object; and
reconstructing a 3D face image of the obstructed face portions by modeling the sensed facial gestures to change the obstructed face portions relative to a previously captured base image of the obstructed face portions of the person.
2. The method according to claim 1 , further comprising presenting the reconstructed 3D face image to a viewing user via a display.
3. The method of claim 1 , further comprising capturing an image of a scene containing the person wearing the face-obstructing object.
4. The method according to claim 1 , wherein the base image of the obstructed face portions further comprises unobstructed face portions of the person.
5. The method according to claim 1 , further comprising retrieving the base image from a social network.
6. The method according to claim 5 , further comprising modifying the base image based on an environmental condition affecting the person.
7. The method according to claim 1 , wherein the reconstructing the 3D face image comprises monitoring at least one of: position, orientation, or profile; and applying the obtained data onto a three dimensional model of the face of the person to yield a modified face image.
8. The method according to claim 1 , wherein the reconstructing the 3D face image comprises monitoring vital signs of the at least one person wearing the face-obstructing object, and applying the obtained data onto a three dimensional model of the face of the at least one person, to yield a modified face image.
9. A system comprising:
a computer processor configured to:
obtain, from a sensor on an inner side of a face-obstructing object, sensed facial gestures of face portions of a person obstructed by the face-obstructing object; and
reconstruct a 3D face image of the obstructed face portions by modeling the sensed facial gestures to change the obstructed face portions relative to a previously captured base image of the obstructed face portions of the person.
10. The system according to claim 9 , further comprising a display configured to present the reconstructed 3D face image.
11. The system according to claim 9 , further comprising an image capturing device configured to capture an image of a scene containing the person wearing the face-obstructing object.
12. The system according to claim 9 , wherein the base image of the obstructed face portions further comprises unobstructed face portions of the person.
13. The system according to claim 9 , wherein the computer processor is further configured to retrieve the base image from a social network.
14. The system according to claim 13 , wherein the computer processor is further configured to modify the base image based on an environmental condition affecting the person.
15. A computer program product comprising a non-transitory computer-readable storage medium containing computer program code for:
sensing, by a sensor on an inner side of a face-obstructing object, facial gestures of face portions of a person obstructed by the face-obstructing object; and
reconstructing a 3D face image of the obstructed face portions by modeling the sensed facial gestures to change the obstructed face portions relative to a previously captured base image of the obstructed face portions of the person.