IP Library Granted Patent US 12,333,839
Granted Patent B2
US 12,333,839 · App. 17/816,940 · Granted Jun 17, 2025

Neural network architecture for classifying documents

Inventors: Dasaprakash Krishnamurthy (Chennai, IN); José Pablo Romero Valle (Salamanca, ES); Álvaro Hernández Hernández (Salamanca, ES)
Assignee: UST Global (Singapore) Pte. Limited
G06V30/19173G06V10/82G06V30/1448G06V30/148G06V30/1918G06V30/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,839
App. No.
17/816,940
Granted
Jun 17, 2025
Kind
B2
Abstract

A system to classify image of a document using neural network architecture is provided. The system includes a storage device storing the image derived from the document having text information. The system includes a document importer operable to perform optical character recognition to convert image data in the image to machine readable data. The system includes a neural network that perform semantic enrichment and positional context for the terms of interest present in the image. The neural network is configured to take as input the machine-readable data and the image and combine both the machine-readable data and the image to classify the image of the document based on the positional context of the terms of interest.

Claims (44)

1. A method of classifying a document, comprising:

receiving, from a storage device, an image of the document;

obtaining a predefined user configuration indicative of a term of interest for the document;

converting, by a document importer, the image to machine-readable data using Optical Character Recognition (OCR);

performing, by a first convolutional neural network, semantic enrichment by highlighting the term of interest in the image based on the machine-readable data;

splitting, by a second convolutional neural network, the image into four quadrants for identifying a positional context of the term of interest in the quadrants, wherein the first convolutional neural network and the second convolutional neural network are a ResNet-152 model;

generating a model representation for each of the quadrants;

concatenating the model representations of the quadrants; and

classifying the image based on the concatenated model representations.

2. The method of claim 1 , further comprising:

identifying coordinates of the term of interest from the machine-readable data;

generating a grayscale version of the image based on the identification; and

performing, by the first convolutional neural network, the semantic enrichment of the grayscale version of the image by highlighting the term of interest in the image.

3. The method of claim 1 , further comprising:

converting quadrant images into a shape of 224×224×3; and

generating the model representation for each of the quadrant images for the concatenation and classification.

4. The method of claim 1 , comprising:

generating the model representation from the four quadrants using a fully connected layer; and

classifying the image using a softmax neural network layer.

5. The method of claim 4 , wherein the fully connected layer is trained using a few-shot learning approach.

6. A system for classifying a document, comprising:

a storage device configured to:

store an image derived from a document having text information, and

store a predefined user configuration, indicative of a term of interest for the document;

a document importer configured to:

convert image data in the image to machine-readable data using Optical Character Recognition (OCR); and

a neural network configured to:

perform semantic enrichment by highlighting the term of interest in the image based on the machine-readable data;

split the image into four quadrants for identifying a positional context of the term of interest in the quadrants;

generate a model representation for each of the quadrants;

concatenate the model representations of the quadrants; and

classify the image based on the concatenated model representations,

wherein the neural network comprises a first convolutional neural network to process the machine-readable data for semantic enrichment and a second convolutional neural network to split the image, wherein the first convolutional neural network and the second convolutional neural network are a ResNet-152 model.

7. The system of claim 6 , wherein the document importer is further configured to:

identify coordinates of the term of interest from the machine-readable data; and

generate a grayscale version of the image based on the identification, and

wherein the first convolutional neural network is configured to perform the semantic enrichment of the grayscale version of the image by highlighting the term of interest in the image.

8. The system of claim 6 , wherein the neural network is configured to:

convert quadrant images into a shape of 224×224×3; and

generate the model representation for each of the quadrant images for the concatenation and classification.

9. The system of claim 6 , wherein the neural network further comprises:

a fully connected layer to generate the model representation from the four quadrants; and

a softmax layer to classify the image.

10. The system of claim 9 , wherein the fully connected layer is trained using a few-shot learning approach.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2025
From: UST GLOBAL (SINGAPORE) PTE. LIMITED
To: UST GLOBAL PRIVATE LIMITED
Reel/Frame 072012/0778 →
SECURITY INTEREST Recorded Aug 13, 2025
From: UST GLOBAL PRIVATE LIMITED
To: CITIBANK, N.A., AS AGENT
Reel/Frame 072012/0804 →
SECURITY INTEREST Recorded Nov 22, 2024
From: UST GLOBAL (SINGAPORE) PTE. LIMITED
To: CITIBANK, N.A., AS AGENT
Reel/Frame 069376/0077 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: KRISHNAMURTHY, DASAPRAKASH; VALLE, JOSÉ PABLO ROMERO; HERNÁNDEZ, ÁLVARO HERNÁNDEZ
To: UST GLOBAL (SINGAPORE) PTE. LIMITED
Reel/Frame 061010/0483 →
Priority Claims (1)
IN 202211022816 · Apr 18, 2022 · national
Continuity (1)
Related Publication 20230334885A1 · Oct 19, 2023
References Cited (6)
US 20190205649A1 · Ananthanarayanan · 2019 [cited by examiner]
US 20210073585A1 · Chuang · 2021 [cited by examiner]
US 20210224977A1 · Jia · 2021 [cited by examiner]
US 20230326191A1 · Li · 2023 [cited by examiner]
WO WO2022035942A1 · 2022 [cited by examiner]
Coates et al an analysis of single-layer networks in unsupervised feature learning, Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, PMLR 15:215-223 (Year: 2011). [cited by examiner]