IP Library Granted Patent US 11,330,012
Granted Patent B2
US 11,330,012 · App. 17/089,846 · Granted May 10, 2022

System, method, and device of authenticating a user based on selfie image or selfie video

Inventor: Avi Turgeman (Cambridge, MA)
Assignee: BIOCATCH LTD.
H04L63/1458G06F3/041G06F3/0488G06F21/31G06F21/316G06F21/32G06F21/552G06F21/554G06Q30/0248G06Q30/0277H04L63/08H04L63/10H04L63/1408H04L67/22H04L67/306G06F2221/2133H04L2463/102H04L2463/144H04W12/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,012
App. No.
17/089,846
Granted
May 10, 2022
Kind
B2
Abstract

System, method, and device of detecting identity of a user and authenticating a user; as well as detecting a possible attacker or impostor, and differentiating among users of an electronic device or of a computerized service. A mobile or portable electronic device is utilized to capture a self-taken image or video of a user, which is utilized as a user-authentication factor. The accelerometer and gyroscope or device-orientation sensor of the mobile device, sense and measure spatial and physical device properties during, before or after the submission of the self-taken image or video. Based on such spatial and physical device properties, in combination with computer-vision analysis of the content shown in the self-taken image or video, the system determines liveness of the user and freshness of the submitted self-taken image or video, and differentiates between a legitimate user and an attacker.

Claims (115)

1. A method comprising:

(a) generating a user-authentication process for authenticating a user of an electronic device, wherein the user-authentication process utilizes a self-taken visual-acquisition input of said user, wherein the self-taken visual-acquisition input comprises one of: a self-taken image, a self-taken video;

(b) performing image recognition on content shown in said self-taken visual-acquisition input, and extracting a particular feature based on image recognition of said content;

(c) determining a characteristic of said electronic device, based on data sensed by one or more non-camera sensors of said electronic device during acquisition of said self-taken visual-acquisition input;

(d) detecting a mismatch between (I) said particular feature that was extracted in step (b) based on image recognition of the content of the self-taken visual-acquisition input, and (II) said characteristic of the electronic device that was determined in step (c) based on data sensed by said one or more non-camera sensors of said electronic device;

(e) based on said mismatch detected in step (d), denying an authentication request received from said electronic device

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held vertically during acquisition;

detecting that a spatial-orientation sensor of the electronic device, indicates that the electronic device was held non-vertically during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

2. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held horizontally during acquisition;

detecting that a spatial-orientation sensor of the electronic device, indicates that the electronic device was held non-horizontally during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

3. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held facing towards a first direction during acquisition;

detecting that a spatial-orientation sensor of the electronic device, indicates that the electronic device was held facing towards a second direction during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

4. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held steadily during acquisition;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was held non-steadily during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

5. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held non-steadily during acquisition;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was held steadily during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

6. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held during acquisition while being moved along a particular axis of movement;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was held steadily during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

7. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held during acquisition while being moved along a first particular axis of movement;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was held during acquisition while being moved along a second particular axis of movement that is different from said first particular axis of movement;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

8. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was moved during acquisition in accordance with a first spatial movement pattern;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was moved during acquisition in accordance with a second, different, spatial movement pattern;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

9. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was located indoors during acquisition;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was located outdoors during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

10. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was located outdoors during acquisition;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was located indoors during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

11. The method of claim 1 ,

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was located at a first particular geographic location during acquisition;

detecting that one or more non-camera sensors of the electronic device, indicate that the electronic device was located at a second particular geographic location during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

12. The method of claim 1 ,

wherein step (d) comprises:

determining a contradiction between

(A) time-of-day that is determined from image recognition analysis applied to said self-taken visual-acquisition input, and

(B) time-of-day that is reported by a GPS sensor or other location-determining sensor of said electronic device;

based on said contradiction, denying said authentication request.

13. The method of claim 1 ,

wherein step (d) comprises:

determining that there exists a contradiction between (I) spatial orientation of the electronic device as sensed by one or more non-camera spatial orientation sensors of the electronic device during acquisition, and (II) spatial orientation of the electronic device as determined from computer vision analysis of content shown in said self-taken visual-acquisition input;

based on said determining, denying said authentication request.

14. The method of claim 1 ,

wherein step (d) comprises:

determining that there exists a contradiction between (I) spatial orientation of the electronic device as sensed by one or more gyroscope sensors of the electronic device during acquisition, and (II) spatial orientation of the electronic device as determined from computer vision analysis of content shown in said self-taken visual-acquisition input;

based on said determining, denying said authentication request.

15. The method of claim 1 ,

wherein step (d) comprises:

determining that there exists a contradiction between (I) acceleration of the electronic device as sensed by one or more accelerometers of the electronic device during acquisition, and (II) acceleration of the electronic device as determined from computer vision analysis of content shown in said self-taken visual-acquisition input;

based on said determining, denying said authentication request.

16. The method of claim 1 ,

wherein step (d) comprises:

determining that there exists a contradiction between (I) spatial spinning characteristic of the electronic device as sensed by one or more spatial characteristic sensors of the electronic device during acquisition, and (II) spatial spinning characteristic of the electronic device as determined from computer vision analysis of content shown in said self-taken visual-acquisition input;

based on said determining, denying said authentication request.

17. The method of claim 1 , wherein step (d) comprises:

determining that there exists a contradiction between (I) geographic location of the electronic device as sensed by a Global Positioning System (GPS) sensor of the electronic device during acquisition, and (II) geographic location of the electronic device as determined from computer vision analysis of content shown in said self-taken visual-acquisition input;

based on said determining, denying said authentication request.

18. The method of claim 1 ,

wherein step (d) comprises:

determining a contradiction between

(A) output of an image recognition analysis applied to said self-taken visual-acquisition input, and

(B) data sensed by one or more of (B1) accelerometer of the electronic device, (B2) gyroscope of the electronic device, (B3) spatial-orientation sensor of said electronic device, (B4) Global Positioning System (GPS) sensor of the electronic device, (B5) location-determining sensor of the electronic device;

based on said contradiction, denying said authentication request.

19. The method of claim 1 ,

wherein the user authentication process, that is based on said self-taken visual-acquisition input, is configured to authorize or deny user access to at least one of: said electronic device, an electronic mail account, a social network account, an online retailer account, an online banking account, a vehicle, a physical venue.

20. A non-transitory storage medium having stored thereon instructions that, when executed by one or more hardware processors, cause said one or more hardware processors to perform a method comprising:

(a) generating a user-authentication process for authenticating a user of an electronic device, wherein the user-authentication process utilizes a self-taken visual-acquisition input of said user, wherein the self-taken visual-acquisition input comprises one of: a self-taken image, a self-taken video;

(b) performing image recognition on content shown in said self-taken visual-acquisition input, and extracting a particular feature based on image recognition of said content;

(c) determining a characteristic of said electronic device, based on data sensed by one or more non-camera sensors of said electronic device during acquisition of said self-taken visual-acquisition input;

(d) detecting a mismatch between (I) said particular feature that was extracted in step (b) based on image recognition of the content of the self-taken visual-acquisition input, and (II) said characteristic of the electronic device that was determined in step (c) based on data sensed by said one or more non-camera sensors of said electronic device;

(e) based on said mismatch detected in step (d), denying an authentication request received from said electronic device

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held vertically during acquisition;

detecting that a spatial-orientation sensor of the electronic device, indicates that the electronic device was held non-vertically during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

21. A system comprising:

one or more processors, operably associated with one or more memory units,

wherein the one or more processors are configured:

(a) to generate a user-authentication process for authenticating a user of an electronic device, wherein the user-authentication process utilizes a self-taken visual-acquisition input of said user, wherein the self-taken visual-acquisition input comprises one of: a self-taken image, a self-taken video;

(b) to perform image recognition on content shown in said self-taken visual-acquisition input, and to extract a particular feature based on image recognition of said content;

(c) to determine a characteristic of said electronic device, based on data sensed by one or more non-camera sensors of said electronic device during acquisition of said self-taken visual-acquisition input;

(d) to detect a mismatch between (I) said particular feature that was extracted in (b) based on image recognition of the content of the self-taken visual-acquisition input, and (II) said characteristic of the electronic device that was determined in (c) based on data sensed by said one or more non-camera sensors of said electronic device;

(e) based on said mismatch detected in (d), to deny an authentication request from said electronic device

wherein step (d) comprises:

detecting that the content of the self-taken visual-acquisition input, indicates that the electronic device was held vertically during acquisition;

detecting that a spatial-orientation sensor of the electronic device, indicates that the electronic device was held non-vertically during acquisition;

based on the above detecting operations, determining said mismatch, and denying said authentication request.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2021
From: TURGEMAN, AVI
To: BIOCATCH LTD.
Reel/Frame 055571/0339 →
Continuity (39)
Continuation 16512399 · Jul 16, 2019
Continuation In Part 15294951 · Oct 17, 2016
Continuation In Part 14272873 · Jun 2, 2015
Continuation In Part 14566723 · Dec 11, 2014
Continuation 13922271 · Jun 20, 2013
Continuation In Part 13877676
Continuation In Part 16416222 · May 19, 2019
Continuation In Part 15708155 · Sep 19, 2017
Continuation In Part 15422479 · Feb 2, 2017
Continuation In Part 15276803 · Sep 27, 2016
Continuation In Part 14325398 · Jul 8, 2014
Continuation In Part 13922271 · Jun 20, 2013
Continuation In Part 13877676
Continuation In Part 14320653 · Jul 1, 2014
Continuation In Part 14320656 · Jul 1, 2014
Continuation In Part 15210221 · Jul 14, 2016
Continuation 14675768 · Apr 1, 2015
Continuation In Part 14566723 · Dec 11, 2014
Continuation 13922271 · Jun 20, 2013
Continuation In Part 13877676
Continuation In Part 15368608 · Dec 4, 2016
Continuation In Part 15001259 · Jan 20, 2016
Continuation 14320653 · Jul 1, 2014
Continuation In Part 13922271 · Jun 20, 2013
Continuation In Part 13877676
Continuation In Part 14727873 · Jun 2, 2015
Continuation In Part 15360291 · Nov 23, 2016
Continuation In Part 14718096 · May 21, 2015
Continuation In Part 16242015 · Jan 8, 2019
Continuation In Part 16057825 · Aug 8, 2018
Continuation In Part 15885819 · Feb 1, 2018
Continuation In Part 15368608 · Dec 4, 2016
Provisional Application 61417479 · Nov 29, 2010
Provisional Application 62308878 · Mar 16, 2016
Provisional Application 62312140 · Mar 23, 2016
Provisional Application 61843915 · Jul 9, 2013
Provisional Application 61973855 · Apr 2, 2014
Provisional Application 62621600 · Jan 25, 2018
Related Publication 20210051172A1 · Feb 18, 2021
Cited By (1)
US 12,417,582