IP Library Granted Patent US 12,657,227
Granted Patent B2
US 12,657,227 · App. 17/903,161 · Granted Jun 16, 2026

Machine learning based spend classification

Inventors: Akash Baviskar (Maharashtra, IN); Krishnan Ramanathan (Kadubeesanahalli, IN); Abhilash Neog (Tarajan, IN); Dipawesh Pawar (Deopur, IN); Karthik Bangalore Mani (Bengaluru, IN)
Assignee: Oracle International Corporation
G06F16/35G06F40/211G06F40/49
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,657,227
App. No.
17/903,161
Filed
Sep 6, 2022
Granted
Jun 16, 2026
Kind
B2
Art Unit
2658
USPC
704/9
Abstract

Embodiments classify a product to a product category. Embodiments receive a textual description of the product and create an index of product categories. Embodiments use a plurality of classifiers to classify the textual description to one of the product categories, the classifiers including an index based classifier, an encyclopedia based classifier, a Bayes' rule based classifier, and an embeddings classifier.

Claims (69)

1 . A method of classifying a product to a product category, the method comprising:

receiving a textual description of the product;

creating an index of product categories;

sequentially inputting the entire textual description to a sequence of different types of classifiers until the textual description is classified, with a confidence score above a predefined threshold, as one of the product categories, wherein the confidence score is determined for each classification output by one of the sequence of classifiers, and a determination is made after every output of the classifier, except a last classifier of the sequence, whether to input the textual description to the next classifier of the sequence of classifiers based on the confidence score;

wherein a first plurality of the classifiers in a beginning of the sequence are unsupervised classifiers, followed by one or more supervised classifiers;

wherein a first textual description corresponding to a first product is classified after being input to each of the first plurality of the classifiers without being input to the one or more supervised classifiers;

wherein a second textual description corresponding to a second product is classified after being input to the first plurality of the classifiers and the one or more supervised classifiers;

wherein the sequence of classifiers comprise a plurality of syntactic match classifiers and a plurality of semantic match classifiers;

wherein the unsupervised classifiers comprise an index based classifier followed by an encyclopedia based classifier and the one or more supervised classifiers comprise a Bayes' rule based classifier followed by an embeddings classifier.

2 . The method of claim 1 , wherein the encyclopedia based classifier uses an online encyclopedia comprising a plurality of subjects with corresponding titles.

3 . The method of claim 2 , further comprising:

mapping the textual description to one of the titles using an index build of the titles;

mapping the product categories to the titles based on embedding similarity; and

mapping the textual description to the product category based on the title.

4 . The method of claim 1 , wherein the sequence of classifiers form a pipeline comprising, in sequential order, two syntactic match classifiers followed by three semantic match classifiers, wherein for each classifier a classification is output when the threshold is reached.

5 . The method of claim 1 , wherein the index based classifier preprocesses the textual description of the product, the preprocessing comprising:

converting to lower case;

keeping alphabetic characters only;

removing stop words;

converting words to base form using lemmatization; and

applying collocations.

6 . The method of claim 1 , wherein the Bayes' rule based classifier is trained using a publicly available online dataset, further comprising automatically labeling the online dataset.

7 . The method of claim 1 , wherein the embeddings classifier uses a Universal Sentence Encoder to determine sematic similarly between the textual description and one or more of the product categories.

8 . A non-transitory computer readable medium having instructions stored thereon that, when executed by one or more processors, cause the processors to classify a product to a product category, the classifying comprising:

receiving a textual description of the product;

creating an index of product categories;

sequentially inputting the entire textual description to a sequence of different types of classifiers until the textual description is classified, with a confidence score above a predefined threshold, as one of the product categories, wherein the confidence score is determined for each classification output by one of the sequence of classifiers, and a determination is made after every output of the classifier, except a last classifier of the sequence, whether to input the textual description to the next classifier of the sequence of classifiers based on the confidence score;

wherein a first plurality of the classifiers in a beginning of the sequence are unsupervised classifiers, followed by one or more supervised classifiers;

wherein a first textual description corresponding to a first product is classified after being input to each of the first plurality of the classifiers without being input to the one or more supervised classifiers;

wherein a second textual description corresponding to a second product is classified after being input to the first plurality of the classifiers and the one or more supervised classifiers;

wherein the sequence of classifiers comprise a plurality of syntactic match classifiers and a plurality of semantic match classifiers;

wherein the unsupervised classifiers comprise an index based classifier followed by an encyclopedia based classifier and the one or more supervised classifiers comprise a Bayes' rule based classifier followed by an embeddings classifier.

9 . The computer readable medium of claim 8 , wherein the encyclopedia based classifier uses an online encyclopedia comprising a plurality of subjects with corresponding titles.

10 . The computer readable medium of claim 9 , further comprising:

mapping the textual description to one of the titles using an index build of the titles;

mapping the product categories to the titles based on embedding similarity; and

mapping the textual description to the product category based on the title.

11 . The computer readable medium of claim 8 , wherein the sequence of classifiers form a pipeline comprising, in sequential order, two syntactic match classifiers followed by three semantic match classifiers, wherein for each classifier a classification is output when the threshold is reached.

12 . The computer readable medium of claim 8 , wherein the index based classifier preprocesses the textual description of the product, the preprocessing comprising:

converting to lower case;

keeping alphabetic characters only;

removing stop words;

converting words to base form using lemmatization; and

applying collocations.

13 . The computer readable medium of claim 8 , wherein the Bayes' rule based classifier is trained using a publicly available online dataset, further comprising automatically labeling the online dataset.

14 . The computer readable medium of claim 8 , wherein the embeddings classifier uses a Universal Sentence Encoder to determine sematic similarly between the textual description and one or more of the product categories.

15 . A spend classification system comprising:

one or more processors configured to classify a product to a product category by:

receiving a textual description of the product;

creating an index of product categories;

sequentially inputting the entire textual description to a sequence of different types of classifiers until the textual description is classified, with a confidence score above a predefined threshold, as one of the product categories, wherein the confidence score is determined for each classification output by one of the sequence of classifiers, and a determination is made after every output of the classifier, except a last classifier of the sequence, whether to input the textual description to the next classifier of the sequence of classifiers based on the confidence score;

wherein a first plurality of the classifiers in a beginning of the sequence are unsupervised classifiers, followed by one or more supervised classifiers;

wherein a first textual description corresponding to a first product is classified after being input to each of the first plurality of the classifiers without being input to the one or more supervised classifiers;

wherein a second textual description corresponding to a second product is classified after being input to the first plurality of the classifiers and the one or more supervised classifiers;

wherein the sequence of classifiers comprise a plurality of syntactic match classifiers and a plurality of semantic match classifiers;

wherein the unsupervised classifiers comprise an index based classifier followed by an encyclopedia based classifier and the one or more supervised classifiers comprise a Bayes' rule based classifier followed by an embeddings classifier.

16 . The system of claim 15 , wherein the encyclopedia based classifier uses an online encyclopedia comprising a plurality of subjects with corresponding titles.

17 . The system of claim 16 , the one or more processors further configured for:

mapping the textual description to one of the titles using an index build of the titles;

mapping the product categories to the titles based on embedding similarity; and

mapping the textual description to the product category based on the title.

18 . The system of claim 15 , wherein the sequence of classifiers form a pipeline comprising, in sequential order, two syntactic match classifiers followed by three semantic match classifiers, wherein for each classifier a classification is output when the threshold is reached.

19 . The system of claim 15 , wherein the index based classifier preprocesses the textual description of the product, the preprocessing comprising:

converting to lower case;

keeping alphabetic characters only;

removing stop words;

converting words to base form using lemmatization; and

applying collocations.

20 . The system of claim 15 , wherein the Bayes' rule based classifier is trained using a publicly available online dataset, the one or more processors further configured for automatically labeling the online dataset.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: BAVISKAR, AKASH; RAMANATHAN, KRISHNAN; NEOG, ABHILASH; PAWAR, DIPAWESH; BANGALORE MANI, KARTHIK
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 060994/0336 →
Priority Claims (1)
IN 202241042852 · Jul 26, 2022 · national
Continuity (1)
Related Publication 20240037482A1 · Feb 1, 2024
References Cited (28)
US 9361377B1 · Azari · 2016 [cited by examiner]
US 9483740B1 · Ansel · 2016 [cited by examiner]
US 10949623B2 · Galitsky · 2021 [cited by examiner]
US 11144827B1 · Levy · 2021 [cited by examiner]
US 20120179633A1 · Ghani · 2012 [cited by examiner]
US 20120271627A1 · Danielyan · 2012 [cited by examiner]
US 20140172652A1 · Pobbathi · 2014 [cited by examiner]
US 20140214845A1 · Garera et al. · 2014 [cited by applicant]
US 20160224662A1 · King · 2016 [cited by examiner]
US 20180032508A1 · Matskevich · 2018 [cited by examiner]
US 20180165554A1 · Zhang · 2018 [cited by examiner]
US 20190065589A1 · Wen · 2019 [cited by examiner]
US 20200349199A1 · Jayaraman · 2020 [cited by examiner]
US 20210090694A1 · Colley · 2021 [cited by examiner]
US 20210264203A1 · Fuxman et al. · 2021 [cited by applicant]
US 20220138423A1 · Zhu · 2022 [cited by examiner]
US 20220237368A1 · Tran · 2022 [cited by examiner]
US 20230066233A1 · van Dam · 2023 [cited by examiner]
US 20230102892A1 · Wu · 2023 [cited by examiner]
US 20240037482A1 · Baviskar · 2024 [cited by examiner]
Jiali Yun, Liping Jing, Jian Yu, Houkuan Huang, A multi-layer text classification framework based on two-level representation model, Expert Systems with Applications, vol. 39, Issue 2, 2012, pp. 2035-2046 (Year: 2012). [cited by examiner]
Jahanshahi, Hadi, Ozan Ozyegen, Mucahit Cevik, Beste Bulut, Deniz Yiǧit, Fahrettin Firat Gonen and Ayse Basar. “Text Classification for Predicting Multi-level Product Categories.” (2021): n. pag. [cited by examiner]
Arzucan Özgür. “Supervised and Unsupervised Machine Learning Techniques for Text Document Categorization” Jan. 2004. Boǧaziçi University. [cited by examiner]
Jiang, et al, “A Survey on Large Language Model Hallucination via a Creativity Perspective” arXiv preprint, 9 pgs, Feb. 2, 2024. [cited by applicant]
Malhotra, “What if LLM Hallucinations Were A Feature And Not A Bug? Meet dreamGPT: An Open-Source GPT-Based Solution That Uses Hallucinations From Large Language Models (LLMs) As A Feature”, Mark Tech Post, 2 pgs, May 2… [cited by applicant]
Sahu et al., “Data Augmentation for Intent Classification with Off-the-shelf Large Language Models” Proceedings of the 4th Workshop on NLP for conversational AI, pp. 47-57, May 27, 2022. [cited by applicant]
Unknown, “DivergentAI/dreamgpt: Leverage hallucinations from large language models (llms) for novelty-driven explorations”, 2 pgs, Aug. 27, 2023. [cited by applicant]
U.S. Appl. No. 18/056,463, filed May 24, 2024, Oracle Financial Services Software Limited. [cited by applicant]