Three dimensional composite images of digital identifications
In general, one innovative aspect of the subject matter described in this specification may be embodied in methods that include generating a three-dimensional composite image of a user from a set of two dimensional facial images. For instance, a depth map may initially be generated for each of the two dimensional facial images based on depth information. The depth maps may be used to identify matching elements that are used to combine multiple two-dimensional images. The generated three-dimensional composite image may then be displayed on a digital identification of a user device. In some instances, the rendering of the three-dimensional composite image on the user device may be adjusted based on tilting motions.
1. A computer-implemented method comprising:
obtaining, from an image capture device, a plurality of two-dimensional images that represent respective views of a face of a user, each two-dimensional image representing a different profile of the face of the user
determining depth information for the plurality of two-dimensional images;
generating a depth map for each two-dimensional image included in the plurality of two-dimensional images based at least on the depth information for the plurality of two-dimensional images;
generating a plurality of projection rays for the depth maps for the plurality of two-dimensional images;
determining intersection points between the plurality of projection rays for the depth maps for the plurality of two-dimensional images;
identifying one or more corresponding points between two or more depth maps based on the intersection points, the one or more corresponding points indicating respective positions of a matching element within the two or more depth maps;
generating a three-dimensional composite for the face of a user based on the one or more corresponding points between two or more depth maps;
generating a digital identification for user, the digital identification comprising (i) information associated with an identity of the user, and (ii) a representation of the three-dimensional composite for the face of the user; and
providing the digital identification to a device associated with the user.
2. The method of claim 1 , wherein the three-dimensional composite for the face of the user comprises at least one of a three-dimensional model of the face of the user, or multiple views of the three-dimensional model of the face of the user.
3. The method of claim 1 , comprising:
transmitting, to the device associated with the user, instructions to rotate the three-dimensional composite for the face of the user included in the digital identification.
4. The method of claim 3 , wherein the instructions to rotate the three-dimensional composite for the face of the user in the digital identification comprises adjusting a display of the three-dimensional composite for the face of the user in the digital identification on the device associated with the user based on tilting the device.
5. The method of claim 4 , wherein the two-dimensional images that include a face of the user comprises a subset of two-dimensional images of a side view of the face of the user, and a subset of two-dimensional images of a frontal view of the face of the user.
6. The method of claim 4 , comprising:
prior to generating the digital identification for the user that includes the three-dimensional composite for the face of the user, post-processing the generated three-dimensional composite for the face of the user.
7. The method of claim 6 , wherein the depth information for each of the two-dimensional images that include the face of the user is determined based at least on a set of parameters of a camera used to capture the two-dimensional images that include the face of the user.
8. The method of claim 1 , wherein the information associated with an identity of the user comprises at least one of the following personal identifiers of the user: name, address, social security number, passport number, national identification number, driver license number, date of birth, telephone number, login or screen name, credit card information, birthplace, a portrait image, or biometric identifiers.
9. The method of claim 8 wherein the biometric identifiers is a feature of one or more of the following: a fingerprint, palm print, iris, vein, voice, genetic information, or face.
10. The method of claim 1 , wherein:
the digital identification corresponds to a physical identification document of the user; and
the information associated with the identity of the user comprises personally identifiable information of the user that is included in the physical identification document.
11. A system comprising:
one or more computers; and
a non-transitory computer-readable medium coupled to the one or more computers having instructions stored thereon, which, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
obtaining, from an image capture device, a plurality of two-dimensional images that represent respective views of a face of a user, each two-dimensional image representing a different profile of the face of the user
determining depth information for the plurality of two-dimensional images;
generating a depth map for each two-dimensional image included in the plurality of two-dimensional images based at least on the depth information for the plurality of two-dimensional images;
generating a plurality of projection rays for the depth maps for the plurality of two-dimensional images;
determining intersection points between the plurality of projection rays for the depth maps for the plurality of two-dimensional images;
identifying one or more corresponding points between two or more depth maps based on the intersection points, the one or more corresponding points indicating respective positions of a matching element within the two or more depth maps;
generating a three-dimensional composite for the face of a user based on the one or more corresponding points between two or more depth maps;
generating a digital identification for user, the digital identification comprising (i) information associated with an identity of the user, and (ii) a representation of the three-dimensional composite for the face of the user; and
providing the digital identification to a device associated with the user.
12. The system of claim 11 , wherein the three-dimensional composite for the face of the user comprises at least one of a three-dimensional model of the face of the user, or multiple views of the three-dimensional model of the face of the user.
13. The system of claim 11 , wherein the operations comprise:
transmitting, to the device associated with the user, instructions to rotate the three-dimensional composite for the face of the user included in the digital identification.
14. The system of claim 13 , wherein the instructions to rotate the three-dimensional composite for the face of the user in the digital identification comprises adjusting a display of the three-dimensional composite for the face of the user in the digital identification on the device associated with the user based on tilting the device.
15. The system of claim 14 , wherein the two-dimensional images that include a face of the user comprises a subset of two-dimensional images of a side view of the face of the user, and a subset of two-dimensional images of a frontal view of the face of the user.
16. The system of claim 14 , wherein the operations comprise:
prior to generating the digital identification for the user that includes the three-dimensional composite for the face of the user, post-processing the generated three-dimensional composite for the face of the user.
17. The system of claim 16 , wherein the depth information for each of the two-dimensional images that include the face of the user is determined based at least on a set of parameters of a camera used to capture the two-dimensional images that include the face of the user.
18. A non-transitory computer storage device encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
obtaining, from an image capture device, a plurality of two-dimensional images that represent respective views of a face of a user, each two-dimensional image representing a different profile of the face of the user
determining depth information for the plurality of two-dimensional images;
generating a depth map for each two-dimensional image included in the plurality of two-dimensional images based at least on the depth information for the plurality of two-dimensional images;
generating a plurality of projection rays for the depth maps for the plurality of two-dimensional images;
determining intersection points between the plurality of projection rays for the depth maps for the plurality of two-dimensional images;
identifying one or more corresponding points between two or more depth maps based on the intersection points, the one or more corresponding points indicating respective positions of a matching element within the two or more depth maps;
generating a three-dimensional composite for the face of a user based on the one or more corresponding points between two or more depth maps;
generating a digital identification for user, the digital identification comprising (i) information associated with an identity of the user, and (ii) a representation of the three-dimensional composite for the face of the user; and
providing the digital identification to a device associated with the user.
19. The device of claim 18 , wherein the three-dimensional composite for the face of the user comprises at least one of a three-dimensional model of the face of the user, or multiple views of the three-dimensional model of the face of the user.
20. The device of claim 18 , wherein the operations further comprise:
transmitting, to the device associated with the user, instructions to rotate the three-dimensional composite for the face of the user included in the digital identification.
21. The device of claim 18 , wherein the instructions to rotate the three-dimensional composite for the face of the user in the digital identification comprises adjusting a display of the three-dimensional composite for the face of the user in the digital identification on the device associated with the user based on tilting the device.
22. The device of claim 21 , wherein the two-dimensional images that include a face of the user comprises a subset of two-dimensional images of a side view of the face of the user, and a subset of two-dimensional images of a frontal view of the face of the user.
23. The device of claim 21 , wherein the operations further comprise:
prior to generating the digital identification for the user that includes the three-dimensional composite for the face of the user, post-processing the generated three-dimensional composite for the face of the user.