IP Library Granted Patent US 12,354,395
Granted Patent B2
US 12,354,395 · App. 17/104,340 · Granted Jul 8, 2025

Databases, data structures, and data processing systems for counterfeit physical document detection

Inventor: Richard Austin Huber, Jr. (Weehawken, NJ)
Assignee: ID Metrics Group Incorporated
G06V30/413G06V10/82G06V30/194G06V40/168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,354,395
App. No.
17/104,340
Granted
Jul 8, 2025
Kind
B2
Abstract

Methods, systems, and apparatuses, including computer programs, for counterfeit document detection. In one aspect, a method includes obtaining first data representing a first image, providing the obtained first data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document printed in accordance with a particular anticounterfeiting architecture, obtaining second data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained first data as an input, determining, based on the obtained second data, whether the first image deviates from data representing one or more images of a physical document printed in accordance with a particular anticounterfeiting architecture, and storing third data indicating that a document, from which the first image was obtained, is a counterfeit document.

Claims (98)

1. A data processing system for counterfeit document detection, the data processing system comprising:

one or more processors; and

one or more storage devices, wherein the one or more storage devices includes instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

obtaining, by the data processing system, first data representing a first image;

providing, by the data processing system, the obtained first data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, wherein the anticounterfeiting architecture includes two or more security features, wherein the two or more security features includes two or more of (i) presence of a predetermined facial aspect ratio, (ii) presence of a predetermined head orientation, (iii) presence of a drop shadow, (iv) presence of guilloche lines over a facial image, or (v) presence of a predetermined graphic;

obtaining, by the data processing system, second data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained first data as an input;

determining, by the data processing system and based on the obtained second data, whether the first image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising:

evaluating the obtained second data against a predetermined threshold; and

based on a determination that the obtained second data satisfies a predetermined threshold, storing third data indicating that a document, from which the first image was obtained, is a counterfeit document.

2. The data processing system of claim 1 , wherein obtaining, by the data processing system, first data representing a first image comprises:

capturing, using a camera, second data representing an image of a document;

extracting, from the second data representing an image of the document, the first data representing a first image, wherein the first image is an image of at least a portion of a person.

3. The data processing system of claim 1 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device that used a camera to capture second data representing an image of a document, the second data representing an image of the document; and

extracting, from the second data representing an image of the document, the first data representing the first image.

4. The data processing system of claim 1 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device, the first data representing the first image.

5. The data processing system of claim 1 , wherein the machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture comprises:

one or more security feature discriminator layers that have been trained to detect the (i) presence of a security feature or (ii) absence of a security feature.

6. The data processing system of claim 1 , the operations further comprising:

obtaining, by the data processing system, fourth data representing a second image;

providing, by the data processing system, the obtained fourth data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture;

obtaining, by the data processing system, fifth data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained fourth data as an input;

determining, by the data processing system and based on the obtained fifth data, whether the second image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising: evaluating the obtained fifth data against a predetermined threshold; and

based on a determination that the obtained fifth data does not satisfy a predetermined threshold, storing sixth data indicating that a document, from which the second image was obtained, is a legitimate document.

7. The data processing system of claim 1 , wherein training the machine learning model comprise:

accessing, by the machine learning model, a plurality of training images of respective physical documents, wherein each training image of the plurality of training images have been labeled as (i) an image of a legitimate physical document or (ii) an image of a counterfeit physical document; and

for each particular image of the plurality of training images:

extracting a particular portion of the particular image of a physical document;

generating an input vector for the extracted particular portion of the particular image of a physical document;

processing, by the machine learning model, the generated input vector through one or more hidden layers of the machine learning model;

obtaining output data, generated by the machine learning model based on the machine learning model's processing of the generated input vector representing the extracted particular portion of the particular image of the physical document;

determining an amount of error that exists between the obtained output data and a label for the particular image; and

adjusting one or more parameters of the machine learning model based on the determined amount of error.

8. A method for counterfeit document detection, the method comprising:

obtaining, by the data processing system, first data representing a first image;

providing, by the data processing system, the obtained first data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, wherein the anticounterfeiting architecture includes two or more security features, wherein the two or more security features includes two or more of (i) presence of a predetermined facial aspect ratio, (ii) presence of a predetermined head orientation, (iii) presence of a drop shadow, (iv) presence of guilloche lines over a facial image, or (v) presence of a predetermined graphic;

obtaining, by the data processing system, second data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained first data as an input;

determining, by the data processing system and based on the obtained second data, whether the first image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising:

evaluating the obtained second data against a predetermined threshold; and

based on a determination that the obtained second data satisfies a predetermined threshold, storing third data indicating that a document, from which the first image was obtained, is a counterfeit document.

9. The method of claim 8 , wherein obtaining, by the data processing system, first data representing a first image comprises:

capturing, using a camera, second data representing an image of a document;

extracting, from the second data representing an image of the document, the first data representing a first image, wherein the first image is an image of at least a portion of a person.

10. The method of claim 8 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device that used a camera to capture second data representing an image of a document, the second data representing an image of the document; and

extracting, from the second data representing an image of the document, the first data representing the first image.

11. The method of claim 8 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device, the first data representing the first image.

12. The method of claim 8 , wherein the machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture comprises:

one or more security feature discriminator layers that have been trained to detect the (i) presence of a security feature or (ii) absence of a security feature.

13. The method of claim 8 , the method further comprising:

obtaining, by the data processing system, fourth data representing a second image;

providing, by the data processing system, the obtained fourth data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture;

obtaining, by the data processing system, fifth data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained fourth data as an input;

determining, by the data processing system and based on the obtained fifth data, whether the second image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising: evaluating the obtained fifth data against a predetermined threshold; and

based on a determination that the obtained fifth data does not satisfy a predetermined threshold, storing sixth data indicating that a document, from which the second image was obtained, is a legitimate document.

14. The method of claim 8 , wherein training the machine learning model comprise:

accessing, by the machine learning model, a plurality of training images of respective physical documents, wherein each training image of the plurality of training images have been labeled as (i) an image of a legitimate physical document or (ii) an image of a counterfeit physical document; and

for each particular image of the plurality of training images:

extracting a particular portion of the particular image of a physical document;

generating an input vector for the extracted particular portion of the particular image of a physical document;

processing, by the machine learning model, the generated input vector through one or more hidden layers of the machine learning model;

obtaining output data, generated by the machine learning model based on the machine learning model's processing of the generated input vector representing the extracted particular portion of the particular image of the physical document;

determining an amount of error that exists between the obtained output data and a label for the particular image; and

adjusting one or more parameters of the machine learning model based on the determined amount of error.

15. A computer-readable storage device having stored thereon instructions, which, when executed by data processing apparatus, cause the data processing apparatus to perform operations comprising:

obtaining, by the data processing system, first data representing a first image;

providing, by the data processing system, the obtained first data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, wherein the anticounterfeiting architecture includes two or more security features, wherein the two or more security features includes two or more of (i) presence of a predetermined facial aspect ratio, (ii) presence of a predetermined head orientation, (iii) presence of a drop shadow, (iv) presence of guilloche lines over a facial image, or (v) presence of a predetermined graphic;

obtaining, by the data processing system, second data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained first data as an input;

determining, by the data processing system and based on the obtained second data, whether the first image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising:

evaluating the obtained second data against a predetermined threshold; and

based on a determination that the obtained second data satisfies a predetermined threshold, storing third data indicating that a document, from which the first image was obtained, is a counterfeit document.

16. The computer-readable storage device of claim 15 , wherein obtaining, by the data processing system, first data representing a first image comprises:

capturing, using a camera, second data representing an image of a document;

extracting, from the second data representing an image of the document, the first data representing a first image, wherein the first image is an image of at least a portion of a person.

17. The computer-readable storage device of claim 15 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device that used a camera to capture second data representing an image of a document, the second data representing an image of the document; and

extracting, from the second data representing an image of the document, the first data representing the first image.

18. The computer-readable storage device of claim 15 , wherein obtaining, by the data processing system, first data representing a first image comprises:

receiving, from a device, the first data representing the first image.

19. The computer-readable storage device of claim 15 , wherein the machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture comprises:

one or more security feature discriminator layers that have been trained to detect the (i) presence of a security feature or (ii) absence of a security feature.

20. The computer-readable storage device of claim 15 , the operations further comprising:

obtaining, by the data processing system, fourth data representing a second image;

providing, by the data processing system, the obtained fourth data as an input to a machine learning model that has been trained to determine whether data representing an input image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture;

obtaining, by the data processing system, fifth data that represents output data generated, by the machine learning model, based on the machine learning model processing the obtained fourth data as an input;

determining, by the data processing system and based on the obtained fifth data, whether the second image deviates from data representing one or more images of a physical document that have been printed in accordance with a particular anticounterfeiting architecture, comprising: evaluating the obtained fifth data against a predetermined threshold; and

based on a determination that the obtained fifth data does not satisfy a predetermined threshold, storing sixth data indicating that a document, from which the second image was obtained, is a legitimate document.

21. The computer-readable storage device of claim 15 , wherein training the machine learning model comprise:

accessing, by the machine learning model, a plurality of training images of respective physical documents, wherein each training image of the plurality of training images have been labeled as (i) an image of a legitimate physical document or (ii) an image of a counterfeit physical document; and

for each particular image of the plurality of training images:

extracting a particular portion of the particular image of a physical document;

generating an input vector for the extracted particular portion of the particular image of a physical document;

processing, by the machine learning model, the generated input vector through one or more hidden layers of the machine learning model;

obtaining output data, generated by the machine learning model based on the machine learning model's processing of the generated input vector representing the extracted particular portion of the particular image of the physical document;

determining an amount of error that exists between the obtained output data and a label for the particular image; and

adjusting one or more parameters of the machine learning model based on the determined amount of error.

Assignments (4)
SECURITY INTEREST Recorded Jul 27, 2026
From: AUTHENTICID INC.; ID METRICS GROUP INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 075403/0595 →
RELEASE OF SECURITY INTEREST Recorded Aug 6, 2025
From: WESTERN ALLIANCE BANK
To: ID METRICS GROUP INC.
Reel/Frame 071954/0771 →
SECURITY INTEREST Recorded Aug 15, 2023
From: ID METRICS GROUP INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 064588/0567 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2020
From: HUBER, RICHARD AUSTIN, JR.
To: ID METRICS GROUP INCORPORATED
Reel/Frame 054469/0995 →
Continuity (2)
Provisional Application 62940880 · Nov 26, 2019
Related Publication 20210158036A1 · May 27, 2021
References Cited (22)
US 10043071B1 · Wu · 2018 [cited by examiner]
US 10515266B1 · Jarvis · 2019 [cited by examiner]
US 20170286765A1 · Rodriguez · 2017 [cited by examiner]
US 20180107887A1 · Huber, Jr. · 2018 [cited by examiner]
US 20180108101A1 · Rodriguez · 2018 [cited by examiner]
US 20190197642A1 · Rodriguez et al. · 2019 [cited by applicant]
US 20200134371A1 · Charraud · 2020 [cited by examiner]
US 20200184212A1 · Anthony Samy · 2020 [cited by examiner]
US 20210019519A1 · Martin · 2021 [cited by examiner]
CN 109429519A · 2019 [cited by examiner]
CN 106599772 · 2020 [cited by applicant]
CN 106599772B · 2020 [cited by examiner]
DE 102008041944 · 2010 [cited by applicant]
WO WO2015196084A1 · 2015 [cited by examiner]
Usilin, S. & Nikolaev, Dmitry & Sholomov, Dmitry, Guilloche elements recognition applied to passport page processing, (2011), In Proceedings of the 8th Open German-Russian Workshop Pattern Recognition and Image Understa… [cited by examiner]
A. Berenguel Centeno, O. Ramos Terrades, J. Llados Canet and C. Cañero Morales, “Recurrent Comparator with Attention Models to Detect Counterfeit Documents,” 2019 International Conference on Document Analysis and Recogn… [cited by examiner]
D. Saez-Trigueros, H. Hertlein, L. Meng and M. Hartnett, “Shape and texture combined face recognition for detection of forged ID documents,” 2016 39th International Convention on Information and Communication Technology… [cited by examiner]
Extended European Search Report in European Appln. No. 20891514.0, dated Sep. 12, 2022, 9 pages. [cited by applicant]
Usilin et al., “Guilloche elements recognition applied to passport page processing,” In Proceedings of the 8th Open German-Russian Workshop Pattern Recognition and Image Understanding, Aug. 2011, 303-306. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2020/062274, dated Jun. 9, 2022, 16 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2020/062274, dated Jan. 15, 2021, 17 pages. [cited by applicant]
Usilin et al., “Guilloche Elements Recognition Applied to Passport p. Processing,” Proceedings of the 8th Open German-Russian Workshop Pattern Recognition and Image Understanding, 2011, pp. 303-306. [cited by applicant]