IP Library Granted Patent US 12,561,519
Granted Patent B2
US 12,561,519 · App. 16/685,724 · Granted Feb 24, 2026

Scalable form matching

Inventor: Michail Iliadis (Oakland, CA)
Assignee: DST Technologies, Inc.
G06F40/186G06F16/2365G06F16/313G06F16/3347G06F16/93G06N3/08G06T3/60G06V10/751G06V10/82G06V30/19173G06V30/412G06V30/418G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,561,519
App. No.
16/685,724
Granted
Feb 24, 2026
Kind
B2
Abstract

Disclosed are a method and apparatus for determining a given template of a form used by a filled in instance of that type of form from amongst a great number of form templates (a hundred or more). The given instance is evaluated by a neural network that has been trained by a single example of each template in order to reduce the total number of templates down to a manageable amount. Given a list of closest matching templates, the instance is aligned to each of the closest matching templates. The comparison generates a match score. The form template having the greatest match score is the correct form template. Filtering the instance through a one-shot learning neural network before performing a precise comparison enables the process to scale to any number of template forms.

Claims (22)

1 . A method of identifying a form template from a set of templates that a filled-in instance of a form corresponds to comprising:

executing a first operation via a recognition neural network trained on one copy of each of the set of templates that identifies a subset of the set of templates that most closely corresponds to the filled-in instance of the form;

executing a second operation via a registration process that identifies a best match of the subset of the set of templates and the filled-in instance of the form, wherein the second operation is more computationally complex than the first operation; and

sorting the filled-in instance of the form with forms corresponding to the best match of the subset of the set of templates, wherein said executing the first operation further comprises: generating a set of template vectors describing graphical dimensions of each of the set of templates; generating a query vector describing graphical dimensions of the filled-in instance of the form; and scoring the query vector against each of the set of template vectors via the recognition neural network.

2 . The method of claim 1 , wherein the filled-in instance of the form is a member of a set of filled-in forms, the method further comprising:

filtering out blank images within the set of filled-in forms.

3 . The method of claim 2 , further comprising:

orienting the set of filled-in forms right-side up via rotating each of the set of filled-in forms by 0, 90, 180, or 270 degrees, and no other amounts.

4 . The method of claim 1 , wherein the subset of the set of templates comprises a predetermined number of closest matches.

5 . The method of claim 1 , wherein the subset of the set of templates comprises each of the set of templates that exceed a threshold matching score with the filled-in instance of the form.

6 . The method of claim 1 , wherein the recognition neural network is architecturally configured as a facial recognition neural network.

7 . A system comprising:

a memory that stores a set of template forms;

a processor configured to associate a filled-in instance of a form with a specific form template of the set of template forms based on instructions stored in the memory, the instructions when executed cause the processor to:

execute a first operation via a recognition neural network trained on one copy of each of the set of template forms that identifies a subset of the set of template forms that most closely corresponds to the filled-in instance of the form; and

execute a second operation via a registration process that identifies a best match of the subset of the set of template forms and the filled-in instance of the form, wherein the second operation is more computationally complex than the first operation, wherein the memory further includes instructions that cause said execution of the first operation to further comprise: generate a set of template vectors describing graphical dimensions of each of the set of template forms; generate a query vector describing graphical dimensions of the filled-in instance of the form; and score the query vector against each of the set of template vectors via the recognition neural network.

8 . The system of claim 7 , wherein the filled-in instance of the form is a member of a set of filled-in forms, the processor further configured to:

filter out blank images within the set of filled-in forms.

9 . The system of claim 8 , the processor further configured to orient the set of filled-in forms right-side up via rotating each of the set of filled-in forms by 0, 90, 180, or 270 degrees, and no other amounts.

10 . The system of claim 7 , wherein the subset of the set of template forms comprises a predetermined number of closest matches.

11 . The system of claim 7 , wherein the subset of the set of template forms comprises each of the set of template forms that exceed a threshold matching score with the filled-in instance of the form.

12 . The system of claim 7 , wherein the recognition neural network is architecturally configured as a facial recognition neural network.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Jan 15, 2021
From: CAPTRICITY, INC.; DST TECHNOLOGIES, INC.
To: DST TECHNOLOGIES, INC.
Reel/Frame 054933/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2019
From: ILIADIS, MICHAIL
To: CAPTRICITY, INC.
Reel/Frame 051053/0927 →
Continuity (1)
Related Publication 20210149931A1 · May 20, 2021
References Cited (16)
US 5274714A · Hutcheson · 1993 [cited by examiner]
US 8724907B1 · Sampson · 2014 [cited by examiner]
US 10803309B2 · Sridharan · 2020 [cited by examiner]
US 20160012317A1 · Mayle · 2016 [cited by examiner]
US 20160148074A1 · Jean · 2016 [cited by examiner]
US 20200074169A1 · Mukhopadhyay · 2020 [cited by examiner]
US 20200159820A1 · Rodriguez · 2020 [cited by examiner]
Ye, Xiangyun, et al., “A generic method of cleaning and enhancing handwritten data from business forms”, IJDAR (International Journal on Document Analysis and Recognition), vol. 4, Springer-Verlag, © 2001, pp. 84-96. [cited by examiner]
“Machine Learning”, Wikipedia, downloaded from: https://en.wikipedia.org/wiki/Machine_learning on Dec. 30, 2021, pp. 1-19. [cited by examiner]
Taylor, Suzanne Liebowitz, et al., “Extraction of Data from Preprinted Forms”, Machine Vision and Applications, vol. 5, Jun. 1992, pp. 211-222. [cited by examiner]
Garris, Michael D., et al., “Neural Network-Based Systems for Handprint OCR Application”, IEEE Transactions on Image Processing, vol. 7, No. 8, Aug. 1998, pp. 1097-1112. [cited by examiner]
Tseng, Lin Yu, et al., “Recognition and Data Extraction of Form Documents Based on Three Types of Line Segments”, Pattern Recognition, vol. 31, No. 10, Oct. 1998, pp. 1525-1540. [cited by examiner]
Wang, Monan, et al., “A Review of Deformation Models in Medical Image Registration”, Journal of Medical and Biological Engineering, vol. 39, published Apr. 16, 2018, pp. 1-17. [cited by examiner]
Doetsch, Fiona, et al., “Young and excitable: the function of new neurons in the adult mammalian brain”, Current Opinion in Neurobiology, vol. 15, Issue 1, Feb. 2005, pp. 121-128. [cited by examiner]
Microsoft Computer Dictionary, 5th Edition, Microsoft Press, Redmond, WA, © 2002, pp. 309 and 344. [cited by examiner]
“Subset”, Wikipedia, downloaded from: https://en.wikipedia.org/wiki/Subset on Jul. 25, 2024, pp. 1-4. [cited by examiner]