IP Library › Granted Patent US 11,769,054
Granted Patent B2
US 11,769,054 · App. 17/576,737 · Granted Sep 26, 2023

Deep-learning-based system and process for image recognition

Inventors: Bo Wu (Toronto, CA); Ching Leong Wan (Toronto, CA); Yuefei Zhu (Toronto, CA); Bo Wan (Toronto, CA); Seyed Hamed Yaghoubi Shahir (Toronto, CA)
Assignee: BANK OF MONTREAL
G06N3/082G06N3/04G06V10/82G06V30/1478G06V30/19147G06V30/226G06V30/412G06V30/413G06V40/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,769,054
App. No.
17/576,737
Granted
Sep 26, 2023
Kind
B2
Abstract

Disclosed are methods and systems for using artificial intelligence (AI) for image recognition by using predefined coordinates to extract a portion of a received image, the extracted portion comprising a word to be identified having at least a first letter and a second letter; executing an image recognition protocol to identify the first letter; when the server is unable to identify the second letter, the server executes an AI model having a nodal data structure to identify the second letter based upon the identified first letter, the nodal data structure comprising a set of nodes where each node represents a letter, each node connected to at least one other node, wherein connection of a first node to a second node corresponds to a probability that a letter corresponding to the second node is used in a word subsequent to a letter corresponding to the first node.

Claims (33)

1. A method comprising:

executing, by a processor, an image recognition protocol purported to identify a letter within a word;

in the event the image recognition protocol fails to identify the letter within the word, executing, by the processor, a neural network comprising a nodal data structure that identifies the letter within the word based upon a preceding letter within the word depicted within an image,

the nodal data structure comprising a set of nodes where each node represents a letter, each node within the set of nodes connected to at least one other node within the set of nodes, wherein connection of a first node to a second node corresponds to a probability that a letter corresponding to the second node is used subsequent to a preceding letter corresponding to the first node, wherein the processor queries an n-gram database to retrieve the probability of the letter being used after the preceding letter;

transmitting, by the processor, an identification of the letter to a second processor.

2. The method of claim 1 , wherein the processor extracts the word from the image using an optical character recognition protocol.

3. The method of claim 1 , wherein the word is depicted within predefined coordinates of the image.

4. The method of claim 1 , wherein the image is a check image.

5. The method of claim 1 , further comprising:

removing, by the processor, visual noise from the image.

6. The method of claim 1 , further comprising:

de-slanting, by the processor, at least a portion of the image.

7. The method of claim 5 , wherein the visual noise is a line that is not part of the word.

8. The method of claim 1 , further comprising:

training, by the processor, the neural network when the second processor indicates that the letter is correct or incorrect.

9. A system comprising:

a server comprising a processor and a non-transitory computer-readable medium containing instructions that when executed by the processor causes the processor to perform operations comprising:

executing an image recognition protocol purported to identify a letter within a word;

in the event the image recognition protocol fails to identify the letter within the word, executing a neural network comprising a nodal data structure to identify the letter within the word based upon a preceding letter within the word depicted within an image,

the nodal data structure comprising a set of nodes where each node represents a letter, each node within the set of nodes connected to at least one other node within the set of nodes, wherein connection of a first node to a second node corresponds to a probability that a letter corresponding to the second node is used subsequent to a preceding letter corresponding to the first node, wherein the processor queries an n-gram database to retrieve the probability of the letter being used after the preceding letter;

transmitting an identification of the letter to a second processor.

10. The system of claim 9 , wherein the processor extracts the word from the image using an optical character recognition protocol.

11. The system of claim 9 , wherein the word is depicted within predefined coordinates of the image.

12. The system of claim 9 , wherein the image is a check image.

13. The system of claim 9 , wherein the instructions further cause the processor to remove visual noise from the image.

14. The system of claim 9 , wherein the instructions further cause the processor to de-slant at least a portion of the image.

15. The system of claim 13 , wherein the visual noise is a line that is not part of the word.

16. The system of claim 9 , wherein the instructions further cause the processor to train the neural network when the second processor indicates that the letter is correct or incorrect.

17. A method comprising:

executing, by a processor, an image recognition protocol purported to identify a letter within a word; in the event the image recognition protocol fails to identify the letter within the word, executing, by the processor, a neural network comprising a nodal data structure that identifies the letter within the word based upon a preceding letter within the word depicted within a check image, wherein the word is depicted within an image segment of the check image associated with a data field,

the nodal data structure comprising a set of nodes where each node represents a letter, each node within the set of nodes connected to at least one other node within the set of nodes, wherein connection of a first node to a second node corresponds to a probability that a letter corresponding to the second node is used subsequent to a preceding letter corresponding to the first node, wherein the processor queries an n-gram database to retrieve the probability of the letter being used after the preceding letter;

transmitting, by the processor, an identification of the letter to a second processor.

18. The method of claim 17 , wherein the word is depicted within predefined coordinates of the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2022
From: WU, BO; WAN, CHING LEONG; ZHU, YUEFEI; WAN, BO; SHAHIR, SEYED HAMED YAGHOUBI
To: BANK OF MONTREAL
Reel/Frame 058739/0791 →
Continuity (3)
Continuation 16872938 · May 12, 2020
Provisional Application 62848721 · May 16, 2019
Related Publication 20220139095A1 · May 5, 2022
Cited By (1)
US 12,366,955