IP Library Granted Patent US 9,934,504
Granted Patent B2
US 9,934,504 · App. 14/887,274 · Granted Apr 3, 2018

Image analysis for user authentication

Inventors: Yicong Wang (Seattle, WA); Haizhi Xu (Seattle, WA)
Assignee: Amazon Technologies, Inc.
G06Q20/40145A61K48/00G06F21/32G06K9/00221G06K9/00335G06K9/00899G06K9/00906G06Q20/12G06Q20/3674G06Q20/40G06Q20/4014G06Q30/0643H04L63/0861H04N21/44008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,934,504
App. No.
14/887,274
Granted
Apr 3, 2018
Kind
B2
Abstract

A transaction is authorized using an authentication process that prompts the user to perform an action in view of a camera or sensor. The process identifies the user and verifies that the user requesting the transaction is a living human being. The user is identified using image information which is processed utilizing facial recognition. The device verifies that the image information corresponds to a living human using one or more human-verification processes. The device prompts the user to perform an action to confirm the transaction, and causes the transaction to be performed after verifying performance of the action by the identified user.

Claims (52)

1. A computing device, comprising:

a processor; and

memory storing instructions that, when executed by the processor, cause the computing device to:

receive identifying information for a user in association with accessing information for products offered through an electronic marketplace;

receive a request to complete a transaction with the electronic marketplace on behalf of the user;

capture a first image using a camera of the computing device, the camera configured to capture at least a portion of a person interacting with a display screen of the computing device;

cause the first image to be analyzed to attempt to recognize an identity of the person contained in the first image;

cause additional captured image information to be analyzed to verify whether the person contained in the first image corresponds to a physical being in proximity of the computing device;

authenticate the user as a result of the identity of the person being recognized as the user associated with the identifying information and as a result of the person being verified to correspond to a physical being; and

cause the transaction to be completed once the user is authenticated.

2. The computing device of claim 1 , wherein the additional captured image information includes still image or video information captured using the camera or another sensor on the computing device.

3. The computing device of claim 1 , further comprising:

obtaining model information for the user, the model information being associated with a user profile for the electronic marketplace.

4. The computing device of claim 1 , wherein receiving identifying information includes receiving information used to log the user into the electronic marketplace.

5. The computing device of claim 1 , further comprising:

denying the transaction as a result of determining that the person is not recognized as the user or the person in the first image is not verified to correspond to a physical being.

6. A computer-implemented method comprising:

under control of one or more computing systems configured with executable instructions,

receiving a request to perform a transaction;

obtaining image information captured by a camera in communication with the one or more computing systems;

identifying a source of the request by at least analyzing at least a first portion of the image information;

verifying that the source of the request corresponds to a physical being within proximity of the camera by at least analyzing at least a second portion of the image information;

presenting a prompt to perform an action to authorize the transaction;

verifying that the action has been performed by at least analyzing a third portion of the image information; and

as a result of verifying that the action has been performed, causing the transaction to be completed.

7. The computer-implemented method of claim 6 , wherein the second portion of the image information is captured while the source of the request is illuminated by an illumination source that is under the control of the one or more computing systems.

8. The computer-implemented method of claim 6 , wherein the second portion of the image information is captured using a different camera or sensor than for the first portion of the image information.

9. The computer-implemented method of claim 6 , wherein the second portion of the image information includes image information or video information.

10. The computer-implemented method of claim 6 , wherein the action is selected at random from a collection of verifiable actions.

11. The computer-implemented method of claim 6 , wherein the second portion of the image information is analyzed using at least two human verification processes.

12. The computer-implemented method of claim 11 , further comprising:

performing a weighted combination of results from the at least two human verification processes.

13. The computer-implemented method of claim 11 , wherein at least a second verification process is utilized when a first verification process is unable to verify that the source of the request contained in the image information corresponds to a physical being with at least a minimum level of confidence.

14. The computer-implemented method of claim 6 , wherein the action is selected from a collection of actions that cannot be replicated with a two-dimensional image.

15. The computer-implemented method of claim 6 , wherein analyzing at least a second portion of the image information includes detecting an eye blink in an amount of time.

16. The computer-implemented method of claim 6 , further comprising:

receiving a request to utilize an authentication process;

obtaining image information including a requester;

generating a model corresponding to a face of the requester; and

providing the model to the computing device for use in authenticating the requester.

17. A non-transitory computer-readable storage medium storing instructions that, as a result of being executed by a processor of a computing system causing the computing system to:

capture, with a camera, image information that describes at least a first portion of a requester;

capture sensor data describing at least a second portion of the requester;

determine an identity of the requester using the image information;

verify that the requester included in the image information corresponds to a physical being in a particular location with respect to the camera;

display a prompt to perform an action to confirm performance of a request;

determine that the requester has performed the action; and

provide the identity of the requester and the request to a computing device as a result of having determined that the requester has performed the action.

18. The non-transitory computer-readable storage medium of claim 17 , wherein verifying that the requester included in the image information corresponds to a physical being is accomplished at least in part by detecting an eye blink.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the sensor data is analyzed using at least two human verification processes, and further comprising:

performing a weighted combination of results from the at least two human verification processes.

20. The non-transitory computer-readable storage medium of claim 17 , wherein analyzing at least a second portion of the image information includes at least one of analyzing infrared reflection data, thermographic information, motion information, or gesture information in the image information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2017
From: WANG, YICONG; XU, HAIZHI
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 042131/0288 →
Continuity (2)
Division 13350633 · Jan 13, 2012
Related Publication 20160071111A1 · Mar 10, 2016