Augmented reality identity verification

1. An augmented reality (AR) system for detecting a linkage in an AR environment, the augmented reality system comprising:

an outward-facing imaging system configured to image an environment of the AR system;

an AR display configured to present virtual content in a three-dimensional (3D) view to a user of the AR system; and

a hardware processor programmed to:

obtain, with the outward-facing imaging system, an image of the environment;

detect a first face and a second face in the image;

identify the first face in the image as representing a face of a person in the environment and the second face in the image as representing a photograph of a face on an identification document in the environment;

recognize the first face based on first facial features associated with the first face;

recognize the second face based on second facial features associated with the second face;

analyze the first facial features and the second facial features to detect a linkage between the person and the identification document; and

instruct the AR display to present a virtual annotation indicating a result of the analysis of the first facial features and the second facial features.

2. The AR system of claim 1 , wherein to detect the first face and the second face, the hardware processor is programmed to apply at least one of the following algorithms on the image: a wavelet-based boosted cascade algorithm or a deep neural network algorithm.

3. The AR system of claim 1 , wherein the hardware processor is further programmed to:

detect that the second face is the face on the identification document by analyzing a movement of the second face; and

determine whether the movement is described by a single planar homography.

4. The AR system of claim 1 , wherein to recognize the first face or the second face, the hardware processor is programmed to:

calculate a first feature vector associated with the first face based at least partly on the first facial features or calculate a second feature vector associated with the second face based at least partly on the second facial features, respectively, by applying at least one of: a facial landmark detection algorithm, a deep neural network algorithm, or a template matching algorithm.

5. The AR system of claim 4 , wherein to detect the linkage between the person and the identification document, the hardware processor is programmed to:

calculate a distance between the first feature vector and the second feature vector;

compare the distance to a threshold value; and

detect the linkage in response to a determination that the distance passes the threshold value.

6. The AR system of claim 5 , wherein the distance is a Euclidean distance.

7. The AR system of claim 1 , wherein the identification document has a label comprising one or more of the following: a quick response code, a bar code, or an iris code.

8. The AR system of claim 7 , wherein the hardware processor is further programmed to:

identify the label from the image of the environment; and

access an external data source using the label to retrieve biometric information of the person.

9. The AR system of claim 1 , wherein AR system further comprises an optical sensor configured to illuminate light outside of a human visible spectrum (HVS), and the hardware processor is further programmed to:

instruct the optical sensor to illuminate the light toward the identification document to reveal hidden information in the identification document;

analyze an image of the identification document wherein the image is acquired when the identification document is illuminated with the light; and

extract biometric information from the image, wherein the extracted biometric information is used to detect the linkage between the person and the identification document.

10. The AR system of claim 1 , wherein the hardware processor is programmed to calculate a likelihood of a match between the first facial features and the second facial features.

11. The AR system of claim 1 , wherein the annotation comprises a visual focus indicator linking the person and the identification document.

12. The AR system of claim 11 , wherein the annotation comprises a box around the first face and a box around the second face.

13. The AR system of claim 12 , wherein the box around the first face and the box around the second face have the same color.

14. The AR system of claim 11 , wherein the annotation comprises a line connecting the first face and the second face.