IP Library Granted Patent US 11,455,786
Granted Patent B2
US 11,455,786 · App. 17/104,570 · Granted Sep 27, 2022

Systems and methods of image processing for remote validation

Inventor: Daniel Mattes (Wels, AT)
Assignee: Jumio Corporation
G06V10/40G06Q20/409G06V10/10G06T1/0007G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,455,786
App. No.
17/104,570
Granted
Sep 27, 2022
Kind
B2
Abstract

The various embodiments described herein include methods, devices, and systems for remote document validation. In one aspect, a method is performed at a server system and includes: (1) receiving video stream data representing a document, where: (a) the data includes timing information that indicates when the video images were captured, and (b) the data captures characteristics of the document; (2) determining, based on the data, that the document comprises a first type of document; (3) assessing the characteristics, including for each characteristic: (a) determining whether verification criteria for the characteristic has been satisfied; and (b) updating an aggregate assessment score for the document based on the determination; (4) after assessing the characteristics, determining whether the aggregate assessment score satisfies a validity threshold; (5) determining whether the video stream was captured within a predefined threshold; and (6) providing an authorization indicator based on the aggregate assessment score and the timing information.

Claims (70)

1. A computer-implemented method for enhancing the security of online transactions by assessing an authenticity of a document that is remote using video processing analysis, the computer-implemented method comprising:

receiving, by one or more processors at a server system and from a camera of a client device, video stream data representing a document that is indicative of either a physical payment card or physical identification card which is used to authenticate a current online transaction, the video stream data including a timestamp that indicates when the video stream data was captured;

determining, by the one or more processors and based on the video stream data, that the document comprises a first type of document of a plurality of document types;

assessing, by the one or more processors, the document for verification criteria against at least a previously-captured and verified characteristic of the first type of document, including:

determining, by the one or more processors, whether a change in a relative motion of a shadow gradient across a surface of the document as the document is rotated is consistent with a measured comparison to the first type of document under matching ambient lighting conditions, and

determining, by the one or more processors and based on the timestamp, whether the video stream data was captured within a predefined threshold to a current time;

initiating, by the one or more processors, a remedial process in accordance with a determination that the video stream data was not captured within the predefined threshold to the current time, the remedial process including requesting additional video stream data that is used to assess the document for verification criteria;

updating, by the one or more processors, an aggregate assessment score for the document based on the assessment of the document;

determining, by the one or more processors, whether the aggregate assessment score satisfies a validity threshold;

causing, by the one or more processors, a display communicatively coupled to the server system to present an authentication message based on the aggregate assessment score satisfying the validity threshold, wherein:

the authentication message indicates that the current online transaction cannot be authorized in response to determining that the aggregate assessment score does not satisfy the validity threshold; and

the authentication message indicates that the current online transaction is authorized in response to determining that the aggregate assessment score does satisfy the validity threshold.

2. The method of claim 1 , further comprising:

prior to receiving the video stream data, receiving a transaction request; and

transmitting a request for the video stream data in response to receiving the transaction request.

3. The method of claim 2 , wherein the transaction request is received from a second server system distinct from the server system and the client device.

4. The method of claim 1 , further comprising: initiating the remedial process to request additional video stream data in response to determining that the aggregate assessment score does not satisfy the validity threshold.

5. The method of claim 1 , further comprising: prior to providing the authentication message, obtaining location information for the client device.

6. The method of claim 5 , further comprising:

determining, based on the location information, that the client device does not match acceptable location data of the client device; and

initiating a fraud report including the location information as an indication of where suspected fraud is taking place.

7. The method of claim 1 , further comprising:

acquiring an image from the video stream data; and

obtaining document data from the image by applying an optical character recognition technique.

8. The method of claim 1 , including assessing a second characteristic, wherein assessing the second characteristic includes:

comparing, by the one or more processors, the second characteristic to a corresponding previously-captured and verified characteristic of the first type of document to determine whether verification criteria for the second characteristic have been satisfied; and

updating, by the one or more processors, the aggregate assessment score for the document based on the determination as to whether the verification criteria for the second characteristic have been satisfied.

9. The method of claim 8 , wherein the second characteristic includes one or more of a surface reflectivity of the document, a hologram of the document, a color gradient of the document, an aspect ratio of the document, an edge thickness of the document, and a length of the document.

10. A server system, comprising:

one or more processors; and

memory storing one or more programs comprising instructions which, when executed by the one or more processors, cause the one or more processors to perform a set of operations, comprising:

receiving, by the one or more processors at a server system and from a camera of a client device, video stream data representing a document that is indicative of either a physical payment card or physical identification card which is used to authenticate a current online transaction, the video stream data including a timestamp that indicates when the video stream data was captured;

determining, by the one or more processors and based on the video stream data, that the document comprises a first type of document of a plurality of document types;

assessing, by the one or more processors, the document for verification criteria against at least a previously-captured and verified characteristic of the first type of document, including:

determining, by the one or more processors, whether a change in a relative motion of a shadow gradient across a surface of the document as the document is rotated is consistent with a measured comparison to the first type of document under matching ambient lighting conditions, and

determining, by the one or more processors and based on the timestamp, whether the video stream data was captured within a predefined threshold to a current time;

initiating, by the one or more processors, a remedial process in accordance with a determination that the video stream data was not captured within a predefined threshold to the current time, the remedial process including requesting additional video stream data that is used to assess the document for verification criteria;

updating, by the one or more processors, an aggregate assessment score for the document based on the assessment of the document;

determining, by the one or more processors, whether the aggregate assessment score satisfies a validity threshold;

causing, by the one or more processors, a display communicatively coupled to the server system to present an authentication message based on the aggregate assessment score satisfying the validity threshold, wherein:

the authentication message indicates that the current online transaction cannot be authorized in response to determining that the aggregate assessment score does not satisfy the validity threshold; and

the authentication message indicates that the current online transaction is authorized in response to determining that the aggregate assessment score does satisfy the validity threshold.

11. The server system of claim 10 , wherein the one or more programs further comprise instructions for, prior to providing the authentication message, checking location information associated with the video stream data; and

wherein the authentication message is based at least in part on an assessment of the location information.

12. The server system of claim 10 , wherein the one or more programs further comprise instructions for:

initiating the remedial process to request additional video stream data in response to determining that the aggregate assessment score does not satisfy the validity threshold.

13. The server system of claim 10 , wherein the one or more programs further comprise instructions for assessing a second characteristic, wherein assessing the second characteristic includes:

comparing, by the one or more processors, the second characteristic to a corresponding previously-captured and verified characteristic of the first type of document to determine whether verification criteria for the second characteristic have been satisfied; and

updating, by the one or more processors, the aggregate assessment score for the document based on the determination as to whether the verification criteria for the second characteristic have been satisfied.

14. The server system of claim 13 , wherein the second characteristic includes one or more of a surface reflectivity of the document, a hologram of the document, a color gradient of the document, an aspect ratio of the document, an edge thickness of the document, and a length of the document.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs including instructions that when executed by one or more processors cause the one or more processors to perform the operations comprising:

receiving, by the one or more processors at a server system and from a camera of a client device, video stream data representing a document that is indicative of either a physical payment card or physical identification card which is used to authenticate a current online transaction, the video stream data including a timestamp that indicates when the video stream data was captured;

determining, by the one or more processors and based on the video stream data, that the document comprises a first type of document of a plurality of document types;

assessing, by the one or more processors, the document for verification criteria against at least a previously-captured and verified characteristic of the first type of document, including:

determining, by the one or more processors, whether a change in a relative motion of a shadow gradient across a surface of the document as the document is rotated is consistent with a measured comparison to the first type of document under matching ambient lighting conditions, and

determining, by the one or more processors and based on the timestamp, whether the video stream data was captured within a predefined threshold to a current time;

initiating, by the one or more processors, a remedial process in accordance with a determination that the video stream data was not captured within a predefined threshold to the current time, the remedial process including requesting additional video stream data that is used to assess the document for verification criteria;

updating, by the one or more processors, an aggregate assessment score for the document based on the assessment of the document;

determining, by the one or more processors, whether the aggregate assessment score satisfies a validity threshold;

causing, by the one or more processors, a display communicatively coupled to the server system to present an authentication message based on the aggregate assessment score satisfying the validity threshold, wherein:

the authentication message indicates that the current online transaction cannot be authorized in response to determining that the aggregate assessment score does not satisfy the validity threshold; and

the authentication message indicates that the current online transaction is authorized in response to determining that the aggregate assessment score does satisfy the validity threshold.

16. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs further comprise instructions for, prior to providing the authentication message, checking location information associated with the video stream data; and

wherein the authentication message is based at least in part on an assessment of the location information.

17. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs further comprise instructions for:

initiating the remedial process to request additional video stream data in response to determining that the aggregate assessment score does not satisfy the validity threshold.

18. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs further comprise instructions for assessing a second characteristic, wherein assessing the second characteristic includes:

comparing, by the one or more processors, the second characteristic to a corresponding previously-captured and verified characteristic of the first type of document to determine whether verification criteria for the second characteristic have been satisfied; and

updating, by the one or more processors, the aggregate assessment score for the document based on the determination as to whether the verification criteria for the second characteristic have been satisfied.

19. The non-transitory computer readable storage medium of claim 18 , wherein the second characteristic includes one or more of a surface reflectivity of the document, a hologram of the document, a color gradient of the document, an aspect ratio of the document, an edge thickness of the document, and a length of the document.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2021
From: MATTES, DANIEL
To: JUMIO INC.
Reel/Frame 055204/0127 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2021
From: JUMIO INC.
To: JUMIO BUYER, INC.
Reel/Frame 055204/0134 →
CHANGE OF NAME Recorded Feb 9, 2021
From: JUMIO BUYER, INC.
To: JUMIO CORPORATION
Reel/Frame 055204/0154 →
Continuity (4)
Continuation 15689389 · Aug 29, 2017
Continuation 13968164 · Aug 15, 2013
Provisional Application 61683623 · Aug 15, 2012
Related Publication 20210166050A1 · Jun 3, 2021
Cited By (1)
US 12,547,867