IP Library Granted Patent US 11,216,680
Granted Patent B2
US 11,216,680 · App. 17/208,842 · Granted Jan 4, 2022

Spoof detection via 3D reconstruction

Inventors: Gregory Lee Storm (Parkville, MO); Reza R. Derakhshani (Shawnee, KS)
Assignee: Advanced New Technologies Co., Ltd.
G06K9/00899G06F21/32G06K9/00288G06T7/55G06T17/00G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,216,680
App. No.
17/208,842
Granted
Jan 4, 2022
Kind
B2
Abstract

In one aspect, a method includes receiving a sequence of images of a subject, the sequence captured by an image acquisition device over a time period in which relative locations of the image acquisition device varies with respect to the subject. A first image and a second image are selected from the first sequence of images. The first and second images represent a first relative location and a second relative location, respectively, of the image acquisition device with respect to the subject. A three-dimensional representation of the first subject is generated using the first image and the second image as a stereo pair. It is determined, based on the first three dimensional representation, that the first subject is an alternative representation of a live person, and in response, access to a secure system is prevented.

Claims (52)

1. A method comprising:

receiving, at one or more processing devices, a first sequence of images of a first subject captured by an image acquisition device over a time period in which relative locations of the image acquisition device with respect to the first subject varies;

selecting, by the one or more processing devices, a first image and a second image from the first sequence of images, wherein the first image represents a first relative location of the image acquisition device with respect to the first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject;

generating, by the one or more processing devices and using the first image and the second image as a stereo pair, a first three-dimensional representation of the first subject using a photometric stereo process for estimating a three dimensional shape from two dimensional images;

determining, based on the first three dimensional representation, that the first subject is an alternative representation of a live person; and

responsive to determining that the first subject is an alternative representation of a live person, preventing access to a secure system.

2. The method of claim 1 , wherein the image acquisition device is a camera disposed on a mobile device, and the sequence of images are captured as the mobile device is moved towards the first subject.

3. The method of claim 1 , wherein the image acquisition device is a camera disposed on a kiosk device, and the sequence of images are captured as the first subject moves towards the kiosk device.

4. The method of claim 1 , wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device.

5. The method of claim 1 , wherein the photometric stereo process comprises a structure-from-motion process.

6. The method of claim 1 , wherein the photometric stereo process comprises a shape-from-shading process.

7. The method of claim 1 , further comprising:

receiving, at the one or more processing devices, a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies;

selecting, by the one or more processing devices, a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject;

generating, by the one or more processing devices and using the third image and the fourth image as a stereo pair, a second three-dimensional representation of the second subject;

determining, based on the second three dimensional representation, that the second subject is a live person; and

responsive to determining that the second subject is a live person, initiating an authentication process for the live person to access the secure system.

8. An system comprising:

an image acquisition device configured to capture a first sequence of images of a first subject over a time period in which relative locations of the image acquisition device with respect to the first subject varies; and

an image analysis engine comprising one or more processing devices, wherein the image analysis engine is configured to:

receive the first sequence of images,

select a first image and a second image from the first sequence of images, wherein the first image represents a first relative location of the image acquisition device with respect to the first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject,

generate, using the first image and the second image as a stereo pair, a first three-dimensional representation of the first subject using a photometric stereo process for estimating a three dimensional shape from two dimensional images,

determine, based on the first three dimensional representation, that the first subject is an alternative representation of a live person, and

responsive to determining that the first subject is an alternative representation of a live person, prevent access to a secure system.

9. The system of claim 8 , wherein the image acquisition device comprises a camera disposed on a mobile device, and the sequence of images are captured as the mobile device is moved towards the first subject.

10. The system of claim 8 , wherein the image acquisition device is a camera disposed on a kiosk device, and the sequence of images are captured as the first subject moves towards the kiosk device.

11. The system of claim 8 , wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device.

12. The system of claim 8 , wherein the photometric stereo process comprises a structure-from-motion process.

13. The system of claim 8 , wherein the photometric stereo process comprises a shape-from-shading process.

14. The system of claim 8 , wherein the image analysis engine is configured to:

receive a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies;

select a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject;

generate, using the third image and the fourth image as a stereo pair, a second three-dimensional representation of the second subject;

determine, based on the second three dimensional representation, that the second subject is a live person; and

responsive to determining that the second subject is a live person, initiate an authentication process for the live person to access the secure system.

15. One or more non-transitory machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform operations comprising:

obtaining a first sequence of images of a first subject captured by an image acquisition device over a time period in which relative locations of the image acquisition device with respect to the first subject varies;

selecting a first image and a second image from the first sequence of images, wherein the first image represents a first relative location of the image acquisition device with respect to the first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject;

generating, using the first image and the second image as a stereo pair, a first three-dimensional representation of the first subject using a photometric stereo process for estimating a three dimensional shape from two dimensional images;

determining, based on the first three dimensional representation, that the first subject is an alternative representation of a live person; and

responsive to determining that the first subject is an alternative representation of a live person, preventing access to a secure system.

16. The one or more non-transitory machine-readable storage devices of claim 15 , wherein the image acquisition device is a camera disposed on a mobile device, and the sequence of images are captured as the mobile device is moved towards the first subject.

17. The one or more non-transitory machine-readable storage devices of claim 15 , wherein the image acquisition device is a camera disposed on a kiosk device, and the sequence of images are captured as the first subject moves towards the kiosk device.

18. The one or more non-transitory machine-readable storage devices of claim 15 , wherein the operations further comprise:

obtaining a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies;

selecting a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject;

generating using the third image and the fourth image as a stereo pair, a second three-dimensional representation of the second subject;

determining, based on the second three dimensional representation, that the second subject is a live person; and

responsive to determining that the second subject is a live person, initiating an authentication process for the live person to access the secure system.

19. The one or more non-transitory machine-readable storage devices of claim 15 , wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device.

20. The one or more non-transitory machine-readable storage devices of claim 15 , wherein the photometric stereo process comprises a structure-from-motion process or a shape-from-shading process.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: ADVANCED NEW TECHNOLOGIES CO., LTD.
To: JUMIO CORPORATION
Reel/Frame 061004/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2022
From: EYEVERIFY INC.
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 061295/0117 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2022
From: EYEVERIFY INC.
To: JUMIO CORPORATION
Reel/Frame 060991/0737 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2021
From: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
To: ADVANCED NEW TECHNOLOGIES CO., LTD.
Reel/Frame 057155/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2021
From: STORM, GREGORY LEE; DERAKHSHANI, REZA R.
To: EYEVERIFY INC.
Reel/Frame 057136/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2021
From: EYEVERIFY INC.
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 057137/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2021
From: ALIBABA GROUP HOLDING LIMITED
To: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Reel/Frame 057155/0508 →
Continuity (2)
Continuation 16370691 · Mar 29, 2019
Related Publication 20210232838A1 · Jul 29, 2021