System and method for creating a virtual backdrop
Some implementations may provide a method for generating a portrait of a subject for an identification document, the method including: receiving a photo image of the subject, the photo image including the subject's face in a foreground against an arbitrary background; determining the arbitrary background of the photo image based on the photo image alone and without user intervention; masking the determined background from the photo image; and subsequently generating the portrait of the subject for the identification document of the subject, the portrait based on the photo image with the determined background masked.
1. A method for generating a portrait of a subject for an identification document, the method comprising:
receiving, at a mobile device, data encoding a photo image of the subject, the photo image including the subject's face in a foreground against an arbitrary background;
determining the arbitrary background of the photo image by automatically prescribing a boundary between the arbitrary background and the foreground
wherein pixels of the boundary are determined by:
generating a first estimate of sparse foreground pixels and a second estimate of sparse background pixels; and
combining the first estimate of sparse foreground pixels and the second estimate of sparse background pixels such that the combined estimates are propagated to unknown pixels without user intervention or calibrating a portion from the photo image against a portion of a different photo image;
masking the determined arbitrary background from the photo image; and
subsequently generating the portrait of the subject for the identification document of the subject, the portrait being based on the photo image with the determined background thus masked.
2. The method of claim 1 , wherein masking the determined arbitrary background is accomplished without storing data encoding the determined arbitrary background.
3. The method of claim 1 , wherein generating the portrait of the subject further comprises: resizing portions of the foreground containing the subject's face.
4. The method of claim 1 , wherein generating the portrait of the subject further comprises: synthesizing a virtual backdrop by replacing the masked arbitrary background with a synthetic background, the synthetic background comprising a pattern pre-determined for the identification document.
5. The method of claim 4 , wherein the synthetic background comprises a pattern specific to the entity issuing the identification document.
6. The method of claim 4 , further comprising: integrating the generated portrait with the synthesized virtual background on the identification document to identify the subject.
7. The method of claim 1 , wherein generating the portrait of the subject further comprises: adjusting a region of interest of the subject's hair volume in the foreground.
8. The method of claim 1 , further comprising: providing a user interface to allow a user to adjust a region of interest of the subject's hair volume in the foreground.
9. The method of claim 1 , further comprising: providing a user interface to allow a user to choose a pixel in the photo image with the background masked and adjust pixel color and value for the chosen pixel.
10. The method of claim 1 , wherein the boundary between the arbitrary background and the foreground is automatically prescribed by tracing pixels of the boundary determined without user intervention or calibrating a portion from the photo image against a portion of a different photo image.
11. A mobile device, comprising at least one processor configured to:
receive, at a mobile device, data encoding a photo image of the subject, the photo image including the subject's face in a foreground against an arbitrary background;
determine the arbitrary background of the photo image by automatically prescribing a boundary between the arbitrary background and the foreground
wherein pixels of the boundary are determined by:
generating a first estimate of sparse foreground pixels and a second estimate of sparse background pixels; and
combining the first estimate of sparse foreground pixels and the second estimate of sparse background pixels such that the combined estimates are propagated to unknown pixels without user intervention or calibrating a portion from the photo image against a portion of a different photo image;
mask the determined arbitrary background from the photo image; and
subsequently generate the portrait of the subject for the identification document of the subject, the portrait being based on the photo image with the determined background thus masked.
12. The mobile device of claim 11 , wherein the at least one processor is further configured to determine the arbitrary background by transmitting the photo image of the subject to a server for making the determination.
13. The mobile device of claim 11 , wherein the at least one processor is further configured to generate the portrait of the subject by resizing portions of the foreground that correspond to the subject's face.
14. The mobile device of claim 12 , wherein the at least one processor is further configured to generate the portrait of the subject by replacing the masked background with a synthetic background, the synthetic background comprising a pattern pre-determined for the identification document.
15. The mobile device of claim 14 , wherein the at least one processor is further configured to integrate the generated portrait on the identification document to identify the subject.
16. The mobile device of claim 14 , wherein the at least one processor is further configured to replace the masked background without storing information encoding the determined background.
17. The mobile device of claim 11 , further comprising: a photo device to adapted capture the photo image of the subject.
18. The mobile device of claim 11 , wherein the at least one processor is further configured to: adjust a region of interest of the subject's hair volume in the foreground.
19. The mobile device of claim 11 , wherein the at least one processor is further configured to: provide a user interface to allow a user to adjust a region of interest of the subject's hair volume in the foreground.
20. The mobile device of claim 11 , wherein the at least one processor is further configured to: provide a user interface to allow a user to choose a pixel in the photo image with the background masked and adjust pixel color and value for the chosen pixel.
21. The mobile device of claim 11 , wherein the at least one processor is further configured to: trace a boundary that separates the foreground from the background.
22. The mobile device of claim 11 , wherein the at least one processor is further configured to: providing a user interface to allow a user to trace a boundary that separates the foreground from the background.