IP Library › Granted Patent US 12,314,860
Granted Patent B2
US 12,314,860 · App. 18/345,627 · Granted May 27, 2025

Deep-learning-based system and process for image recognition

Inventors: Bo Wu (Toronto, CA); Ching Leong Wan (Toronto, CA); Yuefei Zhu (Toronto, CA); Bo Wan (Toronto, CA); Seyed Hamed Yaghoubi Shahir (Toronto, CA)
Assignee: Bank of Montreal
G06N3/082G06N3/04G06V10/82G06V30/1478G06V30/19147G06V30/226G06V30/412G06V30/413G06V40/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,314,860
App. No.
18/345,627
Granted
May 27, 2025
Kind
B2
Abstract

Disclosed are methods and systems for using artificial intelligence (AI) for image recognition by using predefined coordinates to extract a portion of a received image, the extracted portion comprising a word to be identified having at least a first letter and a second letter; executing an image recognition protocol to identify the first letter; when the server is unable to identify the second letter, the server executes an AI model having a nodal data structure to identify the second letter based upon the identified first letter, the nodal data structure comprising a set of nodes where each node represents a letter, each node connected to at least one other node, wherein connection of a first node to a second node corresponds to a probability that a letter corresponding to the second node is used in a word subsequent to a letter corresponding to the first node.

Claims (32)

1. A method comprising:

receiving, by a processor, a request to identify a word depicted within an image, the word having at least a first letter and a second letter subsequent to the first letter;

identifying, by the processor, via executing an image recognition protocol, the first letter; and

when the processor is unable to identify the second letter using the image recognition protocol:

predicting, by the processor, via transmitting the identified first letter and executing a neural network, the second letter based upon the identified first letter by querying a database to retrieve a probability associated with the second letter being used after the identified first letter, the neural network including a set of nodes, each node in the set of nodes interconnected based on the probability associated with the second letter being used after the identified first letter.

2. The method of claim 1 , wherein the neural network predicts the probability that the second letter is used subsequent to the first letter.

3. The method of claim 1 , wherein the processor extracts the word from the image using an optical character recognition protocol.

4. The method of claim 1 , wherein the word is depicted within predefined coordinates of the image.

5. The method of claim 1 , wherein the image is a check image.

6. The method of claim 1 , further comprising:

removing, by the processor, visual noise from the image.

7. The method of claim 6 , wherein the visual noise is a line that is not part of the word.

8. The method of claim 1 , further comprising:

de-slanting, by the processor, at least a portion of the image.

9. The method of claim 1 , further comprising:

training, by the processor, the neural network in accordance with whether the prediction generated by the neural network is correct or incorrect.

10. A system comprising:

a server comprising a processor and a non-transitory computer-readable medium containing instructions that when executed by the processor causes the processor to perform operations comprising:

receive a request to identify a word depicted within an image, the word having at least a first letter and a second letter subsequent to the first letter;

identify via executing an image recognition protocol, the first letter; and

when the server is unable to identify the second letter using the image recognition protocol:

predict, via transmitting the identified first letter and executing a neural network, the second letter based upon the identified first letter by querying a database to retrieve a probability associated with the second letter being used after the identified first letter, the neural network including a set of nodes, each node in the set of nodes interconnected based on the probability associated with the second letter being used after the identified first letter.

11. The system of claim 10 , wherein the neural network predicts the probability that the second letter is used subsequent to the first letter.

12. The system of claim 10 , wherein the processor extracts the word from the image using an optical character recognition protocol.

13. The system of claim 10 , wherein the word is depicted within predefined coordinates of the image.

14. The system of claim 10 , wherein the image is a check image.

15. The system of claim 10 , wherein the instructions further cause the processor to:

remove visual noise from the image.

16. The system of claim 15 , wherein the visual noise is a line that is not part of the word.

17. The system of claim 10 , wherein the instructions further cause the processor to:

de-slant at least a portion of the image.

18. The system of claim 10 , wherein the instructions further cause the processor to: train the neural network in accordance with whether the prediction generated by the neural network is correct or incorrect.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2023
From: WU, BO; WAN, CHING LEONG; ZHU, YUEFEI; WAN, BO; SHAHIR, SEYED HAMED YAGHOUBI
To: BANK OF MONTREAL
Reel/Frame 064184/0755 →
Continuity (4)
Continuation 17576737 · Jan 14, 2022
Continuation 16872938 · May 12, 2020
Provisional Application 62848721 · May 16, 2019
Related Publication 20230342610A1 · Oct 26, 2023
References Cited (71)
US 5052043A · Gaborski · 1991 [cited by applicant]
US 5251268A · Colley · 1993 [cited by examiner]
US 5355437A · Takatori et al. · 1994 [cited by applicant]
US 5408588A · Ulug · 1995 [cited by applicant]
US 5442715A · Gaborski et al. · 1995 [cited by applicant]
US 5500905A · Martin et al. · 1996 [cited by applicant]
US 5511134A · Kuratomi et al. · 1996 [cited by applicant]
US 5519788A · Burges · 1996 [cited by applicant]
US 5588073A · Lee et al. · 1996 [cited by applicant]
US 5638491A · Moed · 1997 [cited by applicant]
US 5742702A · Oki · 1998 [cited by applicant]
US 5912986A · Shustorovich · 1999 [cited by applicant]
US 5950181A · Federl · 1999 [cited by applicant]
US 5987448A · Evans · 1999 [cited by examiner]
US 6101270A · Takahashi · 2000 [cited by examiner]
US 6339651B1 · Tian · 2002 [cited by examiner]
US 6453079B1 · McInerny · 2002 [cited by examiner]
US 6573844B1 · Venolia · 2003 [cited by examiner]
US 6662180B1 · Aref et al. · 2003 [cited by applicant]
US 6903723B1 · Forest · 2005 [cited by applicant]
US 7444021B2 · Napper · 2008 [cited by examiner]
US 7711192B1 · Smirnov · 2010 [cited by applicant]
US 8756499B1 · Kataoka · 2014 [cited by examiner]
US 9081482B1 · Zhai · 2015 [cited by examiner]
US 10769484B2 · Zhang · 2020 [cited by examiner]
US 10832046B1 · Al-Gharaibeh et al. · 2020 [cited by applicant]
US 10878270B1 · Cao et al. · 2020 [cited by applicant]
US 20030200505A1 · Evans · 2003 [cited by examiner]
US 20050259866A1 · Jacobs et al. · 2005 [cited by applicant]
US 20060045322A1 · Clarke et al. · 2006 [cited by applicant]
US 20060123051A1 · Hofman et al. · 2006 [cited by applicant]
US 20070237310A1 · Schmiedlin · 2007 [cited by examiner]
US 20100031330A1 · Von Ahn et al. · 2010 [cited by applicant]
US 20100054539A1 · Challa · 2010 [cited by applicant]
US 20100080462A1 · Miljanic · 2010 [cited by examiner]
US 20110063468A1 · Ahn et al. · 2011 [cited by applicant]
US 20140115521A1 · Kataoka et al. · 2014 [cited by applicant]
US 20140161365A1 · Acharya et al. · 2014 [cited by applicant]
US 20140193075A1 · Pavani et al. · 2014 [cited by applicant]
US 20140307923A1 · Johansson · 2014 [cited by applicant]
US 20150146992A1 · Yeom · 2015 [cited by applicant]
US 20150269431A1 · Haji et al. · 2015 [cited by applicant]
US 20150278658A1 · Hara · 2015 [cited by applicant]
US 20170004374A1 · Osindero · 2017 [cited by examiner]
US 20170140428A1 · Chakraborty · 2017 [cited by examiner]
US 20170168711A1 · Temple · 2017 [cited by applicant]
US 20170286803A1 · Singh et al. · 2017 [cited by applicant]
US 20170293402A1 · Morris · 2017 [cited by examiner]
US 20170372156A1 · Kalenkov et al. · 2017 [cited by applicant]
US 20180089561A1 · Oliner et al. · 2018 [cited by applicant]
US 20180189259A1 · Merl · 2018 [cited by examiner]
US 20180204265A1 · Malviya et al. · 2018 [cited by applicant]
US 20180329886A1 · Li et al. · 2018 [cited by applicant]
US 20190138606A1 · Tu et al. · 2019 [cited by applicant]
US 20190213822A1 · Jain · 2019 [cited by examiner]
US 20190311227A1 · Kriegman · 2019 [cited by examiner]
US 20190377939A1 · Malegaonkar et al. · 2019 [cited by applicant]
US 20190385054A1 · Zuev et al. · 2019 [cited by applicant]
US 20200065574A1 · Kuhlmann et al. · 2020 [cited by applicant]
US 20200364485A1 · Wu · 2020 [cited by examiner]
US 20210012138A1 · Kondoh et al. · 2021 [cited by applicant]
US 20220019834A1 · Taslakian et al. · 2022 [cited by applicant]
DE 0550132A2 · 1992 [cited by examiner]
Corrected Notice of Allowance on U.S. Appl. No. 17/576,737 dated May 25, 2023 (6 pages). [cited by applicant]
Examination Report for CA 3080916 dated Jun. 22, 2021 (7 pages). [cited by applicant]
Examination Report for CA 3080916 dated Mar. 2, 2022 (4 pages). [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 17/576,737 dated Feb. 24, 2023 (6 pages). [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 17/576,737 dated Oct. 4, 2022 (12 pages). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/872,938 dated Sep. 10, 2021 (10 pages). [cited by applicant]
Notice of Allowance on CA App. 3080916 dated Feb. 20, 2023 (1 page). [cited by applicant]
Notice of Allowance on U.S. Appl. No. 17/576,737 dated May 17, 2023 (12 pages). [cited by applicant]