Granted Patent
B2
US 12,277,786 · App. 18/476,978 · Granted Apr 15, 2025
Methods, systems, articles of manufacture and apparatus to categorize image text
Inventors:
Roberto Arroyo (Guadalajara, ES); David Jiménez (Guadalajara, ES); Javier Martínez Cebrián (Madrid, ES)
Assignee:
Nielsen Consumer LLC
View Patent ↗
Loading inventors, assignments & file history…
Abstract
Methods, apparatus, systems, and articles of manufacture are disclosed to categorize image text. An example apparatus includes region detection model training circuitry to identify candidate regions in an input image that include text, and generate bounding boxes around respective ones of the identified candidate regions. The example apparatus also includes mask application circuitry to improve optical character recognition (OCR) by applying a mask to the input image, wherein the mask removes content of the input image except for portions of the input image within the bounding boxes, and OCR circuitry to perform OCR on the masked input image to obtain text data within the bounding boxes.
Claims (35)
1. An apparatus comprising:
interface circuitry;
machine readable instructions; and
at least one processor circuit to execute the machine readable instructions to:
apply a trained object detection model to an image having product representations and descriptions associated with the product representations to detect candidate regions in the image, the image including (a) a first type of text corresponding to text in the product representations and (b) a second type of text corresponding to the descriptions associated with the product representations, the candidate regions to include the second type of text, wherein the image includes a plurality of banner images, at least two of the banner images including one or more of the product representations and corresponding ones of the descriptions;
generate bounding boxes on the image based on the candidate regions, ones of the bounding boxes to surround respective ones of the candidate regions;
improve performance of an optical character recognition (OCR) algorithm by generating a mask on the image based on the bounding boxes, the mask generated on the image at a first time prior to executing the OCR algorithm, the mask to conceal content of the image except for portions of the image within the bounding boxes; and
apply, at a second time after the first time, the OCR algorithm over the masked image to obtain text data from the bounding boxes.
2. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to generate the bounding boxes defining the candidate regions based on text appearance differentiation, the first type of text having an appearance that is differentiable from the second type of text.
3. The apparatus of claim 1 , wherein one or more of the at least one processor circuit is to post-process an output of the OCR algorithm.
4. The apparatus of claim 1 , wherein the one or more of the at least one processor circuit is to apply a trained text classification model to the text data to classify the candidate regions into categories.
5. The apparatus of claim 4 , wherein one or more of the at least one processor circuit is to code the image by generating labels on the image based on the categories identified in the candidate regions.
6. The apparatus of claim 4 , wherein the trained text classification model classifies first text data associated with a first one of the candidate regions into more than one category.
7. The apparatus of claim 4 , wherein the trained text classification model classifies respective text data associated with corresponding ones of the candidate regions into the categories based on satisfaction of a threshold probability.
8. The apparatus of claim 1 , wherein the trained object detection model includes a region proposal network.
9. At least one non-transitory computer readable storage medium comprising instructions to cause at least one processor circuit to at least:
cause a trained object detection model to identify candidate regions in an input image having product representations and descriptions associated with the product representations, the input image including (a) a first type of text corresponding to text in the product representations and (b) a second type of text corresponding to the descriptions associated with the product representations, the candidate regions to include the second type of text, the input image having a plurality of banner images, at least two of the banner images to include one or more of the product presentations representations and corresponding ones of the descriptions;
generate bounding boxes on the input image based on the candidate regions, respective bounding boxes to surround corresponding ones of the candidate regions;
improve an optical character recognition (OCR) process by generating a mask for the input image based on the bounding boxes;
apply the mask to the input image at a first time prior to performing the OCR process, wherein the mask occludes content of the input image outside the bounding boxes; and
perform, at a second time after the first time, the OCR process on the masked input image to extract text data from within the bounding boxes.
10. The at least one non-transitory computer readable storage medium of claim 9 , wherein the instructions are to cause one or more of the at least one processor circuit to generate the bounding boxes defining the candidate regions based on differentiation between the first type of text and the second type of label text.
11. The at least one non-transitory computer readable storage medium of claim 9 , wherein the instructions are to cause one or more of the at least one processor circuit to post-process an output of the OCR process.
12. The at least one non-transitory computer readable storage medium of claim 9 , wherein the instructions are to cause one or more of the at least one processor circuit to classify the text data into classes using a trained text classification model.
13. The at least one non-transitory computer readable storage medium of claim 12 , wherein the instructions are to cause one or more of the at least one processor circuit to generate indications of the classes on the input image.
14. The at least one non-transitory computer readable storage medium of claim 9 , wherein the trained object detection model includes a region proposal network.
15. The at least one non-transitory computer readable storage medium of claim 9 , wherein the instructions are to cause one or more of the at least one processor circuit to classify the text data into classes based on satisfaction of a threshold probability.
16. A method comprising:
identifying, by executing an instruction with at least one processor, candidate regions in an image using a trained object detection model, the image including a plurality of banner images having product representations and descriptions associated with the product representations, the image including (a) a first type of text corresponding to text in the product representations and (b) a second type of text corresponding to the descriptions associated with the product representations, the candidate regions corresponding to the second type of text in the image, and defined by bounding boxes surrounding instances of the second type of text in the image, wherein at least two of the banner images include one or more of the product representations and corresponding ones of the descriptions;
improving an optical character recognition (OCR) algorithm by generating, by executing an instruction with the at least one processor, a mask on the image at a first time prior to executing the OCR algorithm, the generating of the mask to be based on the candidate regions and the bounding boxes, wherein the mask obscures content of the image except for portion of the image within the bounding boxes; and
applying, by executing an instruction with the at least one processor, the OCR algorithm to the masked image to extract text data from the image, the text data corresponding to the first type of text positioned in the bounding boxes, wherein the OCR algorithm is applied to the masked image at a second time that is after the first time.
17. The method of claim 16 , further including generating the bounding boxes defining the candidate regions based on text appearance differentiation.
18. The method of claim 16 , further including classifying instances of the text data into corresponding classes by applying a trained text classification model to the text data.
19. The method of claim 18 , further including generating identifiers corresponding to the classes on the image, ones of the classes generated proximate to corresponding ones of the instances of the text data.
20. The method of claim 16 , wherein the trained object detection model includes a region proposal network.
Assignments (2)
INTELLECTUAL PROPERTY SECURITY AGREEMENT
Recorded Jun 20, 2024
From: NIELSEN CONSUMER LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AND COLLATERAL AGENT
Reel/Frame 067792/0978 →
ASSIGNMENT OF ASSIGNOR'S INTEREST
Recorded Mar 15, 2024
From: ARROYO, ROBERTO; JIMÉNEZ, DAVID; MARTÍNEZ CEBRIÁN, JAVIER
To: NIELSEN CONSUMER, LLC
Reel/Frame 066780/0095 →
Continuity (3)
Provisional Application
63053505
· Jul 17, 2020
References Cited (356)
US 3323135A
· Miller
· 1967
[cited by applicant]
US 5410611A
· Huttenlocher et al.
· 1995
[cited by applicant]
US 5606690A
· Hunter
· 1997
[cited by applicant]
US 7454063B1
· Kneisl et al.
· 2008
[cited by applicant]
US 7792709B1
· Trandal
· 2010
[cited by applicant]
US 8285047B2
· Nagarajan et al.
· 2012
[cited by applicant]
US 8494281B2
· Nagarajan
· 2013
[cited by applicant]
US 8787695B2
· Wu
· 2014
[cited by applicant]
US 8792141B2
· Moore et al.
· 2014
[cited by applicant]
US 8983170B2
· Nepomniachtchi et al.
· 2015
[cited by applicant]
US 9014432B2
· Fan et al.
· 2015
[cited by applicant]
US 9158744B2
· Rao et al.
· 2015
[cited by applicant]
US 9239952B2
· Hsu
· 2016
[cited by applicant]
US 9262686B1
· Singer
· 2016
[cited by applicant]
US 9290022B2
· Makabe
· 2016
[cited by applicant]
US 9298685B2
· Barrus
· 2016
[cited by applicant]
US 9298979B2
· Nepomniachtchi et al.
· 2016
[cited by applicant]
US 9323135B1
· Veloso
· 2016
[cited by applicant]
US 9324073B2
· Nepomniachtchi et al.
· 2016
[cited by applicant]
US 9384389B1
· Sankaranarayanan
· 2016
[cited by applicant]
US 9384839B2
· Avila et al.
· 2016
[cited by applicant]
US 9396540B1
· Sampson
· 2016
[cited by applicant]
US 9684842B2
· Deng
· 2017
[cited by applicant]
US 9710702B2
· Nepomniachtchi et al.
· 2017
[cited by applicant]
US 9747504B2
· Ma et al.
· 2017
[cited by applicant]
US 9760786B2
· Sahagun et al.
· 2017
[cited by applicant]
US 9824270B1
· Mao
· 2017
[cited by applicant]
US 9875385B1
· Humphreys
· 2018
[cited by applicant]
US 20020037097A1
· Hoyos
· 2002
[cited by applicant]
US 20030185448A1
· Seeger et al.
· 2003
[cited by applicant]
US 20070041642A1
· Romanoff et al.
· 2007
[cited by applicant]
US 20100306080A1
· Trandal
· 2010
[cited by applicant]
US 20120330971A1
· Thomas
· 2012
[cited by applicant]
US 20130170741A9
· Hsu
· 2013
[cited by applicant]
US 20140002868A1
· Landa et al.
· 2014
[cited by applicant]
US 20140188647A1
· Argue
· 2014
[cited by applicant]
US 20150039479A1
· Gotanda
· 2015
[cited by applicant]
US 20150317642A1
· Argue
· 2015
[cited by applicant]
US 20150363792A1
· Arini
· 2015
[cited by applicant]
US 20150363822A1
· Rowe
· 2015
[cited by applicant]
US 20160034863A1
· Ross
· 2016
[cited by applicant]
US 20160171585A1
· Singh
· 2016
[cited by applicant]
US 20190026803A1
· De Guzman
· 2019
[cited by applicant]
US 20190080207A1
· Chang
· 2019
[cited by applicant]
US 20200249803A1
· Sobel et al.
· 2020
[cited by applicant]
US 20220114821A1
· Arroyo et al.
· 2022
[cited by applicant]
US 20230394859A1
· Montero et al.
· 2023
[cited by applicant]
CA 2957433A1
· 2017
[cited by applicant]
CA 2957433C
· 2020
[cited by applicant]
CN 103123685A
· 2013
[cited by applicant]
CN 104866849A
· 2015
[cited by applicant]
CN 108229397A
· 2018
[cited by applicant]
CN 108829397A
· 2018
[cited by applicant]
CN 109389124A
· 2019
[cited by applicant]
CN 112446351A
· 2021
[cited by applicant]
CN 112560862A
· 2021
[cited by applicant]
DE 202013005144U1
· 2013
[cited by applicant]
GB 2595412A
· 2021
[cited by applicant]
JP H0749529A
· 1995
[cited by applicant]
JP 2008021850A
· 2008
[cited by applicant]
JP 2008210850A
· 2008
[cited by applicant]
JP 2008211850A
· 2008
[cited by applicant]
JP 2019139737A
· 2019
[cited by applicant]
JP 7049529B2
· 2022
[cited by applicant]
KR 101831204B1
· 2018
[cited by applicant]
TW 200821850A
· 2008
[cited by applicant]
WO 2013041145A1
· 2013
[cited by applicant]
WO 2013044145A1
· 2013
[cited by applicant]
WO 2018054326A1
· 2018
[cited by applicant]
WO 2018201423A1
· 2018
[cited by applicant]
WO 2020194004A1
· 2020
[cited by applicant]
WO 2022006295A1
· 2022
[cited by applicant]
WO 2022123199A1
· 2022
[cited by applicant]
Crandall, D.—“Extraction of special effects caption text events from digital video”—IJDARD 2003, pp. 138-157 (Year: 2003).
[cited by examiner]
Levenshtein, “Binary Codes Capable of Correcting Deletions, Insertions, and Reversals,” Soviet Physics—Doklady, Cybernetics and Control Theory, pp. 707-710, vol. 10, No. 8, Feb. 1966, 4 pages.
[cited by applicant]
Smith et al., “Identification of Common Molecular Subsequences,” Reprinted Journal of Molecular Biology, Academic Press Inc. (London) Ltd., pp. 195-197, dated 1981, 3 pages.
[cited by applicant]
Govindan et al., “Character Recognition—A Review,” Pattern Recognition, vol. 23, No. 7, pp. 671-683, Jul. 1990, 13 pages.
[cited by applicant]
Poulovassilis et al. “A Nested-Graph Model for the Representation and Manipulation of Complex Objects,” ACM Transactions on Information Systems, vol. 12, No. 1, dated Jan. 1994, 34 pages.
[cited by applicant]
Hochreiter et al., “Long Short-Term Memory,” communicated by Ronald Williams, Neural Computation, (1997):1735-1780, 46 pages.
[cited by applicant]
Ng et al., “On Spectral Clustering: Analysis and an Algorithm,” NIPS'01: Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, Jan. 2001, 8 pages.
[cited by applicant]
Crandall et al., “Extraction of special effects caption text events from digital video,” IJDAR, Department of Computer Science and Engineering, The Pennsylvania State University, accepted Sep. 13, 2002, 20 pages.
[cited by applicant]
Lowe, “Distinctive Image Features from Scale-Invariant Key points,” International Journal of Computer Vision (HCV), published Jan. 5, 2004, 20 pages.
[cited by applicant]
Marinai, “Introduction to Document Analysis and Recognition,” Machine Learning in Document Analysis and Recognition, published 2008, 20 pages.
[cited by applicant]
Vogel et al., “Parallel Implementations of Word Alignment Tool,” Software Engineering, Testing, and Quality Assurance for Natural Language Processing, pp. 49-57, Jun. 2008, 10 pages.
[cited by applicant]
O'Gorman et al., “Document Image Analysis,” IEEE Computer Society Executive Briefings, dated 2009, 125 pages.
[cited by applicant]
Oliveira et al., “A New Method for Text-Line Segmentation for Warped Documents,” International Conference Image Analysis and Recognition, Jun. 21, 2010, 11 pages.
[cited by applicant]
Krizhevsky et al., “ImageNet Classification with Deep Convolutional Neural Networks,” In International Conference on Neural Information Processing Systems (NIPS), published 2012, 9 pages.
[cited by applicant]
Chung et al., “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling,” ArXiv abs/1412.3555, dated Dec. 11, 2024, 9 pages.
[cited by applicant]
Nshuti, “Mobile Scanner and OCR (A First Step Towards Receipt to Spreadsheet),” published 2015, 3 pages.
[cited by applicant]
Ronneberger et al., “U-Net: Convolutional Networks for Biomedical Image Segmentation,” Medical Image Computing and Computer-Assisted Intervention (MICCAI), dated May 18, 2015, 8 pages.
[cited by applicant]
Lecun et al., “Deep Learning,” Review, Nature, vol. 521, pp. 436-444, dated May 28, 2015, 9 pages.
[cited by applicant]
Genereux et al., “NLP Challenges in Dealing with OCR-ed Documents of Derogated Quality,” Workshop on Replicability and Reproducibility in Natural Language Processing, IJCAI 2015, dated Jul. 2015, 6 pages.
[cited by applicant]
Ren et al., “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” In International Conference on Neural Information Processing Systems (NIPS), pp. 91-99, dated Jan. 6, 2016, 14 pages.
[cited by applicant]
Kim et al., “Character-Aware Neural Language Models,” Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI'IO), pp. 2741-2749, Dec. 1, 2015, 9 pages.
[cited by applicant]
Redmon et al., “You Only Look Once: Unified, Real-Time Object Detection,” In Conference on Computer Vision and Pattern Recognition (CVPR), dated May 9, 2016, 10 pages.
[cited by applicant]
Osindero et al., “Recursive Recurrent Nets with Attention Modeling for OCR in the Wild,” in Conference on Computer Vision and Pattern Recollection (CVPR), Mar. 9, 2016, 10 pages.
[cited by applicant]
Joulin et al., “Bag of Tricks for Efficient Text Classification,” In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, dated Aug. 9, 2016, 5 pages.
[cited by applicant]
Konda et al., “Magellan: Toward Building Entity Matching Management Systems Over Data Science Stacks,” Proceedings of the VLDB Endowment, vol. 9, No. 13, 2016, 4 pages.
[cited by applicant]
Kipf et al., “Semi-Supervised Classification with Graph Convolutional Networks,” 5th International Conference on Learning Representations, Feb. 22, 2017, 14 Pages.
[cited by applicant]
Ozhiganov, “Deep Dive Into OCR for Receipt Recognition,” DZone, Jun. 21, 2017, 18 pages.
[cited by applicant]
Bojanowski et al., “Enriching Word Vectors with Subword Information,” In Journal Transactions of the Association for Computational Linwstics, 2017, vol. 5, pp. 135-146, dated Jun. 2017, 12 pages.
[cited by applicant]
Bartz et at., “STN-OCT: A Single Neural Network for Text Detection and Text Recognition,” Computer Vision and Pattern Recognition, dated Jul. 27, 2017, 9 pages.
[cited by applicant]
Vaswani et al., “Attention is all you need,” In Advances in Neural Information Processing Systems, 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, last revised Dec. 6, 2017, 15 page…
[cited by applicant]
Hui, “mAP (mean Average Precision) for Object Detection,” Mar. 6, 2018, 2 pages. Retrieved from [https://medium.eom/@jonathan hui/map-mean-average-precision-for-object-detection-45cl21a311731 on Mar. 6, 2018, 2 pages.
[cited by applicant]
Velickovic et al., “Graph Attention Networks,” International Conference on Learning Representations, Feb. 4, 2018, 12 pages.
[cited by applicant]
Mudgal et al., “Deep learning for entity matching: A design space exploration,” in Proceedings of the 2018 International Conference on Management of Data, dated Jun. 10-15, 2018, 16 pages.
[cited by applicant]
Wick et al., “Calamari—A High-Performance Tensorflow-based Deep Learning Package for Optical Character Recognition,” Digital Humanities Quarterly, Jul. 5, 2018, 12 pages. [retrieved from: https://arxiv.org/ftp/arxiv/ pa…
[cited by applicant]
Akbik et al., “Contextual String Embeddings for Sequence Labeling,” In Proceedings of the 27th International Conference on Computational Linguistics (COLING), dated Aug. 2018, 12 pages.
[cited by applicant]
Follmann et al., “MVTec D2S: Densely Segmented Supermarket Dataset,” In European Conference on Computer Vision (ECCV), dated 2018, 17 pages.
[cited by applicant]
Ray et al., “U-PC: Unsupervised Planogram Compliance,” in European Conference on Computer Vision (ECCV), 2018, 15 pages. [retrieved from:http:/ /openaccess.thecvf.com/content_ ECCV _ 2018/papers/Archan_Ray_ U-PC_Unsuper…
[cited by applicant]
Li et al., “Extracting Figures and Captions from Scientific Publications,” Short Paper, CIKM18, Oct. 22-26, 2018, Torino, Italy, 4 pages.
[cited by applicant]
Elfwing et al., “Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning,” Neural Networks: Journal of the International Neural Network Society, vol. 107, Nov. 2, 2017, 18 pages.
[cited by applicant]
Huang et al., “Mask R-CNN with Pyramid Attention Network for Scene Text Detection”, arXiv:1811.09058v1, pp. 1-9, https://arxiv.org/abs/1811.09058, Nov. 22, 2018, 9 pages.
[cited by applicant]
Wikipedia, “Precision & Recall,” Dec. 17, 2018 revision, 12 pages.
[cited by applicant]
Artificial Intelligence & Image Analysis, “Intelligent Automation Eliminates Manual Data Entry From Complex Documents,” White Paper, accessed on Jan. 30, 2019, 3 pages.
[cited by applicant]
Artificial Intelligence & Image Analysis, “Historic Document Conversion,” Industry Paper, accessed on Jan. 30, 2019, 4 pages.
[cited by applicant]
Loshchilov et al., “Decoupled Weight Decay Regularization,” 2019 International Conference on Learning Representations, Jan. 4, 2019, 19 pages.
[cited by applicant]
Nathancy, “How do I make masks to set all of image background, except the text, to white?”, stakoverflow.com, https://stackoverflow.com/questions/56465359/how-do-i-make-masks-to-set-all-of-image-background-except-the-te…
[cited by applicant]
Devlin et al., “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” In Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), dated May 24, …
[cited by applicant]
Qasim et al., “Rethinking Table Recognition using Graph Neural Networks,” In Inernational Conference on Document Analysis and Recognition (ICDAR), dated Jul. 3, 2019, 6 pages.
[cited by applicant]
Feng et al., “Computer vision algorithms and hardware implementations: A survey,” Integration: the VLSI Journal, vol. 69, pp. 309-320, dated Jul. 27, 2019, 12 pages.
[cited by applicant]
Hu et al., “Hierarchical Graph Convolutional Networks for Semi-supervised Node Classification,” 2019 International Joint Conference on Artificial Intelligence, Jun. 10, 2019, 8 pages.
[cited by applicant]
Oliveira et al., “dhSegment: A generic deep-learning approach for document segmentation,” In 16th International Conference on Frontiers in Handwriting Recollection (ICFHR), Aug. 14, 2019, 6 pages.
[cited by applicant]
Zhong et al., “PubLayNet: largest dataset ever for document layout analysis,” In International Conference on Document Analysis and Recognition (ICDAR), dated Aug. 16, 2019, 8 pages.
[cited by applicant]
Jaume et al., “FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents,” International Conference on Document Analysis and Recognition (ICDAR), Oct. 29, 2019, 6 pages.
[cited by applicant]
Yadati et al., “HyperGCN: Hypergraph Convolutional Networks for Semi-Supervised Classification,” Proceedings of the 33rd International Conference on Neural Information Processing Systems, Jan. 26, 2019, 18 pages.
[cited by applicant]
International Searching Authority, “Written Opinion of the International Searching Authority”, issued in connection with International Patent Application No. PCT/IB2019/000299, dated Dec. 23, 2019, 4 Pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/IB2019/000299, on Dec. 23, 2019, 3 pages.
[cited by applicant]
Github, “Tesseract OCR,” Tesseract Repository on GitHub, retrieved from: https://github.com/tesseract-ocr/, dated 2020, 3 pages.
[cited by applicant]
Carbonell et al., “Named Entity Recognition and Relation Extraction with Graph Neural Networks in Semi Structured Documents,” 2020 International Conference on Pattern Recognition (ICPR), 6 pages.
[cited by applicant]
Zacharias et al., “Image Processing Based Scene-Text Detection and Recognition withTesseract,” arXiv (CoRR), Apr. 17, 2020, 6 pages. [retrieved from: https://arxiv.org/pdf/2004.08079.pdf].
[cited by applicant]
Liu et al. “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” International Conference on Learning Representations, Jul. 26, 2019, 13 pages.
[cited by applicant]
Xu et al., “LayoutLM: Pre-training of Text and Layout for Document Image Understanding,” in International Conference on Knowledge Discovery & Data Mining (SIGKDD), Jun. 16, 2020, 9 pages. [retrieved from: https://arxiv.…
[cited by applicant]
Dong et al. “HNHN: Hypergraph Networks with Hyperedge Neurons,” ArXiv abs/2006.12278, dated Jun. 22, 2020, 11 pages.
[cited by applicant]
Yu et al., “PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional Networks,” in International Conference on Pattern Recognition (ICPR), Jul. 18, 2020, 8 pages. [retrieved…
[cited by applicant]
Chen et al., “HGMF: Heterogeneous Graph-Based Fusion for Multimodal Data with Incompleteness,” Research Track Paper, Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, date…
[cited by applicant]
Wang et al., “DocStruct: A Multimodal Method to Extract Hierarchy Structure in Document for General Form Understanding,” 2020 Conference Empirical Methods in Natural Language Processing (EMNLP), Nov. 16-20, 2020, 11 pag…
[cited by applicant]
Zhu et al., “Heterogeneous Mini-Graph Neural Network and Its Application to Fraud Invitation Detection,” 2020 IEEE International Conference on Data Mining (ICDM), downloaded on May 18, 2021, 9 pages.
[cited by applicant]
Bandyopadhyay et al., “Hypergraph Attention Isomorphism Network by Learning Line Graph Expansion,” 2020 IEEE International Conference on Big Data (Big Data) (2020): 669-678, downloaded on May 29, 2021, 10 pages.
[cited by applicant]
Arroyo et al., “Multi-label classification of promotions in digital leaflets using textual and visual information,” Proceedings of the Workshop on Natural Language Processing in E-Commerce (EComNLP), pp. 11-20, Barcelon…
[cited by applicant]
Deepdive, “Distant Supervision,” Online available on Stanford University website, retrieved on Apr. 1, 2022, 2 pages, [retrieved from: http://deepdive.stanford.edu/distant supervision].
[cited by applicant]
Nguyen et al., “End-to-End Hierarchical Relation Extraction for Generic Form Understanding”, in International Conference on Pattern Recognition (ICPR), Jun. 2, 2021, 8 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2020/061269, mailed on Mar. 11, 2021, 4 Pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2020/061269, mailed on Mar. 11, 2021, 3 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/692,797, dated Mar. 16, 2021, 12 pages.
[cited by applicant]
Google, “Detect Text in Images,” Mar. 29, 2021, 16 pages. Retrieved from http://cloud.google.com/vision/docs/ocr.
[cited by applicant]
Xu et al. “LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding”, arXiv, Sep. 9, 2021, 10 pages.
[cited by applicant]
Ma et al., “Graph Attention Networks with Positional Embeddings,” Pacific-Asia Conference on Knowledge Discovery and Data Mining, Oct. 24, 2021, 13 pages.
[cited by applicant]
Chen et al., “TextPolar: irregular scene text detection using polar representation,” International Journal on Document Analysis and Recognition (IJDAR), May 7, 2021, 9 pages.
[cited by applicant]
Li et al., “SelfDoc: Self-Supervised Document Representation Learning,” 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 7, 2021, 10 pages.
[cited by applicant]
Hwang et al., “Spatial Dependency Parsing for Semi-Structured Document Information Extraction,” in International Joint Conference on Natural Language Processing (IJCNLP), Jul. 1, 2021, 14 pages. [retrieved from: https:/…
[cited by applicant]
Xu et al., “LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding,” 59th Annual Meeting of the Association for Computational Linguistics (ACL), arXiv, dated Jan. 10, 2022, 13 pages.
[cited by applicant]
Li et al., “StructuralLM: Structural Pre-training for Form Understanding,” 59th Annual Meeting of the Association for Computational Linguistics, May 24, 2021, 10 pages.
[cited by applicant]
Huang et al. “UniGNN: a Unified Framework for Graph and Hypergraph Neural Networks,” 30th International Joint Conference on Artificial Intelligence (IJCAI), May 3, 2021, 9 pages.
[cited by applicant]
Tang et al., “MatchVIE: Exploiting Match Relevancy between Entities for Visual Information Extraction”, in International Joint Conference on Artificial Intelligence (IJCAI), pp. 1039-1045, 2021, 7 pages.
[cited by applicant]
Qian et al., “A Region-Based Hypergraph Network for Joint Entity-Relation Extraction,” Knowledge-Based Systems. vol. 228, Sep. 27, 2021, 8 pages.
[cited by applicant]
Powalski et al., “Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer,” International Conference on Document Analysis and Recognition, Mar. 2, 2021, 17 pages.
[cited by applicant]
Davis et al., “Visual FUDGE: Form Understanding via Dynamic Graph Editing,” International Conference on Document Analysis and Recognition (ICDAR), Jul. 16, 2021, 16 pages.
[cited by applicant]
Prabhu et al., “MTL-FoUn: A Multi-Task Learning Approach to Form Understanding,” 2021 International Conference on Document Analysis and Recognition (ICDAR), Sep. 5, 2021, 5 pages.
[cited by applicant]
Garncarek et al., “LAMBERT: Layout-Aware Language Modeling for Information Extraction,” International Conference on Document Analysis and Recognition (ICDAR), May 28, 2021, 16 pages.
[cited by applicant]
Shen et al., “LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysis,” in International Conference on Document Analysis and Recognition (ICDAR), Jun. 21, 2021, 16 pages. [retrieved from: https:/…
[cited by applicant]
Hong et al., “BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents,” arXiv (CoRR), Sep. 10, 2021, 13 pages. [retrieved from:https://arxiv.org/pdf/2108.04539…
[cited by applicant]
Appalaraju et al., “DocFormer: End-to-End Transformer for Document Understanding,” arXiv (CoRR), Sep. 20, 2021, 22 pages. [retrieved from: https://arxiv .org/pdf/2106 .11539.pdf].
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/IB2019/000299, dated Sep. 28, 2021, 5 Pages.
[cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 16/692,797, dated Oct. 27, 2021, 14 pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2021/039931, mailed on Nov. 4, 2021, 3 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2021/039931, mailed on Nov. 4, 2021, 4 pages.
[cited by applicant]
International Searching Authority, “Search Report,” issued in connection with Application No. PCT/US2021/039931, dated Nov. 4, 2021, 4 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with Application No. PCT/US2021/039931, dated Nov. 4, 2021, 4 pages.
[cited by applicant]
European Patent Office, “Communication pursuant to Rules 161(2) and 162 EPC,” in connection with European Patent Application No. 19921870.2, issued Nov. 5, 2021, 3 pages.
[cited by applicant]
Zhang et al., “Entity Relation Extraction as Dependency Parsing in Visually Rich Documents,” Empirical Methods in Natural Language Processing (EMNLP), Nov. 7-11, 2021, 10 pages.
[cited by applicant]
Hwang et al., “Cost-Effective End-to-end Information Extraction for Semi-structured Document Images,” Empirical Methods in Natural Language Processing (EMNLP), Aug. 30, 2021, 9 pages.
[cited by applicant]
Li et al., “StrucTexT: Structured Text Understanding with Multi-Modal Transformers”, in ACM International Conference on Multimedia (ACM Multimedia), pp. 1912-1920., arXiv, dated Nov. 8, 2021, 9 pages.
[cited by applicant]
Leicester et al., “Using Scanner Technology to Collect Expenditure Data,” Fiscal Studies, vol. 30, Issue 3-4, 2009, 29 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/710,538, dated Apr. 19, 2024, 8 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/710,660, dated May 28, 2024, 9 pages.
[cited by applicant]
Canadian Intellectual Property Office, “Office Action,” issued in connection with Canadian Patent Application No. 3,182,471, dated May 28, 2024, 5 pages.
[cited by applicant]
Datasetlist, “Annotation tools for building datasets,” Labeling tools- List of labeling tools, Datasetlist.com, updated Dec. 2021, downloaded on Apr. 1, 2022, 12 pages. [retrieved from: https://www.datasetlist.com/tools…
[cited by applicant]
Gu et al., “UniDoc: Unified Pretraining Framework for Document Understanding,” 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Dec. 6, 2021, 12 pages.
[cited by applicant]
Wang et al., “LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding,” in Annual Meeting of the Association for Computational Linguistics (ACL), Feb. 28, 2022, 11 page…
[cited by applicant]
Park et al., “CORD: A Consolidated Receipt Dataset for Post-OCR Parsing,” 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, 4 pages.
[cited by applicant]
United States Patent and Trademark Office, “Advisory Action,” issued in connection with U.S. Appl. No. 16/692,797, dated Feb. 16, 2022, 4 pages.
[cited by applicant]
Github, “FIAT tool—Fast Image Data Annotation Tool,” Github.com, downloaded on Apr. 1, 2022, 30 pages, [retrieved from: https://github.com/christopher5106/FastAimotationTooll.
[cited by applicant]
NielsenIQ Brandbank, “Nielsen Brandbank Product Library,” Online Available. Retrieved on Apr. 1, 2022, 5 pages. [retrieved from: https://www.brandbank.com/us/product-librarv/].
[cited by applicant]
Github, “Doccano tool,” Github.com, downloaded on Apr. 1, 2022, 12 pages. [retrieved from:https://github.com/doccano/doccano].
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/692,797, dated Apr. 5, 2022, 10 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 16/692,797, dated Apr. 22, 2022, 3 pages.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” mailed in connection with International Patent Application No. PCT/US2020/061269, on May 17, 2022, 5 pages.
[cited by applicant]
European Patent Office, “Information regarding early processing before the European Patent Office,” issued in connection with European Patent Application No. 20891012.5-1218, May 20, 2022, 2 pages.
[cited by applicant]
European Patent Office, “Communication concerning corrected entries of the applicant/ patent proprietor,” issued in connection with European Patent Application No. 20891012.5-1218, May 31, 2022, 1 page.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US2020/061269, dated May 17, 2022, 5 Pages.
[cited by applicant]
Gu et al., “XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding,” Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 18, 2022, 10 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2022/034570, dated Jun. 22, 2022, 5 pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2022/034570, dated Jun. 22, 2022, 3 pages.
[cited by applicant]
European Patent Office, “Communication pursuant to Rules 161(2) and 162 EPC,” issued in connection with European Patent Application No. 20891012.5-1218, dated Jun. 29, 2022, 3 pages.
[cited by applicant]
Datasetlist, “A tool using OpenCV to annotate images for image classification, optical character reading, . . . ,” Datasetlist.com, dated Jul. 13, 2022, 30 pages.
[cited by applicant]
Mllota et al., “Text Classification Models for Form Entity Linking,” International Symposium on Distributed Computing and Artificial Intelligence, Dec. 14, 2021, 10 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/345,940, dated Aug. 18, 2022, 8 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action” , issued in connection with U.S. Appl. No. 17/075,675, dated Sep. 22, 2022, 12 Pages.
[cited by applicant]
Huang et al., “LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking, ” 30th ACM International Conference on Multimedia, Jul. 19, 2022, 10 pages.
[cited by applicant]
Zhang et al., “Multimodal Pre-training Based on Graph Attention Network for Document Understanding,” IEEE Transactions on Multimedia, vol. 25, Oct. 23, 2022, 13 pages.
[cited by applicant]
European Patent Office, “Extended European Search Report,” issued in connection with European Patent Application No. 19921870, dated Oct. 12, 2022, 11 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2022/034570, mailed on Oct. 20, 2022, 5 pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2022/034570, mailed on Oct. 20, 2022, 3 pages.
[cited by applicant]
Kim et al., “Donut: Document Understanding Transformer without OCR”, arXiv, dated Oct. 6, 2022, 29 pages.
[cited by applicant]
Mexican Institute of Industrial Property, “Representation of the Promotion Sent Through the Online Patent System,” issued in connection with Mexican Patent Application No. MX/a/2022/008170, dated Oct. 27, 2022, 35 pages…
[cited by applicant]
European Patent Office, “Communication pursuant to Rules 70(2) and 70a(2) EPC,” issued in connection with Application No. 19921870.2, dated Nov. 2, 2022, 1 page.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/364,419, dated Nov. 4, 2022, 10 pages.
[cited by applicant]
Canadian Patent Office, “Examiner's Report,” issued in connection with Canadian Patent Application No. 3, 124,868, dated Nov. 10, 2022, 4 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/364,419, dated Nov. 15, 2022, 2 pages.
[cited by applicant]
Zhong et al., “Hierarchical Message-Passing Graph Neural Networks,” Data Mining and Knowledge Discovery, Nov. 17, 2022, 29 pages.
[cited by applicant]
European Patent Office, “European Search Report,” issued in connection with European Patent Application No. 22180113.7-1207, dated Nov. 22, 2022, 25 pages.
[cited by applicant]
European Patent Office, “Extended Search Report,” in connection with European Patent Application No. 22180113.7, dated Nov. 22, 2022, 2 pages.
[cited by applicant]
Dwivedi et al., “Benchmarking Graph Neural Networks,” Journal of Machine Learning Research, Dec. 28, 2022, 49 pages.
[cited by applicant]
European Patent Office, “Extended European Search Report,” issued in connection with European Patent Application No. 22184405.3, dated Dec. 2, 2022, 7 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/379,280, dated Dec. 2, 2022, 14 Pages.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with PCT Application No. PCT/US2021/039931, dated Dec. 13, 2022, 5 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/364,419, dated Jan. 4, 2023, 2 pages.
[cited by applicant]
European Patent Office, “Communication Pursuant to Rule 69 EPC,” issued in connection with European Patent Application No. 22180113.7, dated Jan. 10, 2023, 2 pages.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with PCT Application No. PCT/US2021/039931, dated Jan. 12, 2023, 6 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/883,309, dated Jan. 20, 2023, 14 pages.
[cited by applicant]
European Patent Office, “Communication pursuant to Rule 69 EPC,” in connection with European Patent Application No. 22184405.3, dated Jan. 23, 2023, 2 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability”, issued in connection with U.S. Appl. No. 17/364,419, dated Feb. 15, 2023, 2 pages.
[cited by applicant]
United Kingdom Patent Office, “Examination Report under section 18(3),” issued in connection with GB Application No. 2112299.9, dated Feb. 17, 2023, 2 pages.
[cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 17/075,675, dated Mar. 7, 2023, 11 Pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/345,940, dated Mar. 16, 2023, 13 pages.
[cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 17/379,280, dated May 5, 2023, 17 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/883,309, dated May 11, 2023, 9 pages.
[cited by applicant]
European Patent Office, “Extended European Search Report,” issued in connection with European Patent Application No. 22214553.4, dated May 17, 2023, 9 pages.
[cited by applicant]
United States Patent and Trademark Office, “Advisory Action,” issued in connection with U.S. Appl. No. 17/075,675, issued May 30, 2023, 3 pages.
[cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2023/011859, mailed on Jun. 1, 2023, 3 pages.
[cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2023/011859, mailed on Jun. 1, 2023, 4 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/075,675, issued Jun. 26, 2023, 8 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/345,940, mailed on Jul. 7, 2023, 8 pages.
[cited by applicant]
Intellectual Property of United Kingdom, “Intention to Grant under Section 18(4),” issued in connection with United Kingdom Patent Application No. 2112299.9, mailed on Jul. 13, 2023, 2 Pages.
[cited by applicant]
United States Patent and Trademark Office, “Advisory Action,” issued in connection with U.S. Appl. No. 17/379,280, mailed on Jul. 18, 2023, 3 pages.
[cited by applicant]
Gopal et al., “What is Intelligent Document Processing?” Nano Net Technologies, URL:[https://nanonets.com/blog/intelligent-document-processing/], Jul. 19, 2023, 21 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/345,940, dated Jul. 20, 2023, 3 pages.
[cited by applicant]
Canadian Intellectual Property Office, “Examiner's Report,” issued in connection with Canadian Patent Application No. 3, 124,868, dated Aug. 10, 2023, 5 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/883,309, mailed on Aug. 17, 2023, 2 Pages.
[cited by applicant]
Intellectual Property of United Kingdom, “Notification of Grant ,” issued in connection with United Kingdom Patent Application No. 2112299.9, mailed on Aug. 29, 2023, 2 Pages.
[cited by applicant]
Amazon, “Intelligent Document Processing,” Amazon Web Services, https://aws.amazon.com/machine-learning/ml-use-cases/document-processing/fintech/, retrieved on Sep. 8, 2023, 6 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/075,675, mailed on Oct. 10, 2023, 2 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in U.S. Appl. No. 17/075,675, dated on Oct. 10, 2023, 2 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action, ” issued in connection with U.S. Appl. No. 17/710,538, dated Oct. 26, 2023, 6 Pages.
[cited by applicant]
European Patent Office, “Extended European Search Report,” issued in connection with European Patent Application No. 20891012.5, dated Nov. 17, 2023, 12 pages.
[cited by applicant]
European Patent Office, “Communication pursuant to Rules 70(2) and 70a(2) EPC,” issued in connection with European Patent Application No. 20891012.5, dated Dec. 5, 2023, 1 page.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US2022/034570, issued on Dec. 14, 2023, 7 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/598,792, dated Dec. 29, 2023, 17 pages.
[cited by applicant]
United States and Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/566, 135, dated Mar. 27, 2024, 13 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 18/191,642, dated Feb. 7, 2024, 18 pages.
[cited by applicant]
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with International Application No. PCT/US2023/011859, mailed on Aug. 6, 2024, 5 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/710,538, dated Aug. 14, 2024, 8 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/598,792, dated Aug. 27, 2024, 9 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 18/191,642, dated Aug. 28, 2024, 7 pages.
[cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/710,649, dated Sep. 16, 2024, 12 pages.
[cited by applicant]
Visich, “Bar Codes and Their Applications,” Research Foundation of State University of New York, 1990, 59 pages.
[cited by applicant]
European Patent Office, “Communication pursuant to Article 94(3) EPC,” issued in connection with European Patent Application No. 19 921 870.2-1207, on Apr. 9, 2024, 7 pages.
[cited by applicant]
United States Patent and Trademark Office, “Supplemental Notice of Allowability,” issued in connection with U.S. Appl. No. 17/710,538, dated May 8, 2024, 3 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/598,792, dated Jun. 17, 2024, 9 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 18/191,642, dated Jun. 17, 2024, 9 pages.
[cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 17/598,792, dated Jul. 3, 2024, 2 pages.
[cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 17/566,135, dated Jul. 25, 2024, 17 pages.
[cited by applicant]
United States Patent and Trademark Office, “Supplemental Notice of Allowability,” issued in connection with U.S. Appl. No. 17/710,538, dated Sep. 11, 2024, 3 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/710,660, dated Sep. 25, 2024, 9 pages.
[cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 17/566,135, dated Oct. 11, 2024, 9 pages.
[cited by applicant]
Cited By (3)