IP Library Granted Patent US 12,288,032
Granted Patent B2
US 12,288,032 · App. 18/499,077 · Granted Apr 29, 2025

Secure complete phrase utterance recommendation system

Inventors: Anuprit Kale (Oakland, CA); Weiping Peng (San Francisco, CA); Na Cheng (San Francisco, CA); Rick Lindstrom (San Francisco, CA); Zachary Alexander (Snoqualmie, WA)
Assignee: Salesforce, Inc.
G06F40/289G06F16/31G06F16/3329G06F16/3344G06F16/3347G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,032
App. No.
18/499,077
Filed
Oct 31, 2023
Granted
Apr 29, 2025
Kind
B2
Examiner
WONG, LINDA
Art Unit
2655
USPC
704/9
Abstract

Described herein are systems, apparatus, methods and computer program products for machine learning intent classification. In various embodiments, historical utterances provided by users may be utilized for bot training. Context and personally identifiable information may be removed from the utterances. The utterances may be associated with vectors. The utterances and vectors may be used to determine recommendations.

Claims (59)

1. A database system, comprising:

an utterance database configured to store utterance data associated with one or more utterance phrases;

a phrase vector database configured to store phrase vector data comprising one or more phrase vectors, wherein each phrase vector is associated with a corresponding utterance phrase within the utterance database; and

a processor configured to perform operations comprising:

receiving an utterance dataset comprising a plurality of training phrases;

decoupling each of the training phrases from the other of the training phrases;

creating training data by:

associating each of the training phrases with phrase unique identifiers;

associating phrase vectors with each of the training phrases; and

associating each of the phrase vectors with phrase vector unique identifiers, wherein each phrase vector unique identifier is matched with an associated phrase unique identifier;

training a model with the training data;

receiving entry data;

determining, with the model, one or more phrase vectors matching the entry data;

determining, based on the determined one or more phrase vectors, one or more utterance phrases associated with the one or more phrase vectors; and

communicating the one or more utterance phrases to a user device for display on a graphical user interface of the user device.

2. The database system of claim 1 , wherein the operations further comprise:

determining, based on the model, an entry vector associated with the entry data.

3. The database system of claim 1 , wherein the one or more utterance phrases are determined as recommendations by the model.

4. The database system of claim 1 , wherein the determining, with the model, the one or more phrase vectors matching the entry data comprises matching one or more phrase vectors within the phrase vector database to the entry data.

5. The database system of claim 1 , wherein the determining the one or more utterance phrases comprises requesting the utterances phrases associated with the determined one or more phrase vectors from the utterance database.

6. The database system of claim 5 , wherein the determining the one or more utterance phrases comprises providing authentication data.

7. The database system of claim 1 , wherein the operations further comprise:

decoupling each of the training phrases from the other of the training phrases; and

removing personally identifiable information from each of the training phrases.

8. The database system of claim 7 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present less than a threshold number of times within the utterance dataset; and

removing the identified words.

9. The database system of claim 7 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present in conversations between a number of parties less than a threshold number; and

removing the identified words.

10. The database system of claim 7 , wherein the utterance database receives the utterance dataset.

11. A method comprising:

receiving an utterance dataset comprising a plurality of training phrases;

decoupling each of the training phrases from the other of the training phrases;

creating training data by:

associating each of the training phrases with phrase unique identifiers;

associating phrase vectors with each of the training phrases; and

associating each of the phrase vectors with phrase vector unique identifiers, wherein each phrase vector unique identifier is matched with an associated phrase unique identifier;

training a model with the training data;

receiving entry data;

determining, with the model, one or more phrase vectors matching the entry data, wherein the one or more phrase vectors are each associated with a corresponding utterance phrase stored within an utterance database, and wherein the utterance database is configured to store utterance data associated with the one or more utterance phrases;

determining, based on the determined one or more phrase vectors, one or more utterance phrases associated with the one or more phrase vectors; and

communicating the one or more utterance phrases to a user device for display on a graphical user interface of the user device.

12. The method of claim 11 , further comprising:

determining, based on the model, an entry vector associated with the entry data.

13. The method of claim 11 , wherein the one or more utterance phrases are determined as recommendations by the model.

14. The method of claim 11 , wherein the determining with the model, the one or more phrase vectors matching the entry data comprises matching one or more phrase vectors within a phrase vector database to the entry data.

15. The method of claim 11 , wherein the determining the one or more utterance phrases comprises requesting the utterances phrases associated with the determined one or more phrase vectors from the utterance database.

16. The method of claim 15 , wherein the determining the one or more utterance phrases comprises providing authentication data.

17. The method of claim 11 , further comprising:

decoupling each of the training phrases from the other of the training phrases; and

removing personally identifiable information from each of the training phrases.

18. The method of claim 17 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present less than a threshold number of times within the utterance dataset; and

removing the identified words.

19. The method of claim 17 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present in conversations between a number of parties less than a threshold number; and

removing the identified words.

20. The method of claim 17 , wherein the utterance database receives the utterance dataset.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2023
From: KALE, ANUPRIT; PENG, WEIPING; CHENG, NA; LINDSTROM, RICK; ALEXANDER, ZACHARY
To: SALESFORCE.COM, INC.
Reel/Frame 065410/0749 →
CHANGE OF NAME Recorded Oct 31, 2023
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 065415/0098 →
Continuity (3)
Continuation 17099083 · Nov 16, 2020
Provisional Application 62936967 · Nov 18, 2019
Related Publication 20240062010A1 · Feb 22, 2024
References Cited (35)
US 9529488B2 · Beechuk et al. · 2016 [cited by applicant]
US 9710613B2 · Suskind · 2017 [cited by examiner]
US 10496844B2 · Rickard, Jr. et al. · 2019 [cited by applicant]
US 10546064B2 · Cannings · 2020 [cited by examiner]
US 10552432B2 · Govindarajan et al. · 2020 [cited by applicant]
US 10565265B2 · Alexander et al. · 2020 [cited by applicant]
US 10614061B2 · Kempf et al. · 2020 [cited by applicant]
US 10628431B2 · Chittar et al. · 2020 [cited by applicant]
US 10671658B2 · Case · 2020 [cited by examiner]
US 10803127B2 · Alexander et al. · 2020 [cited by applicant]
US 10824814B2 · Faizakof et al. · 2020 [cited by applicant]
US 11501753B2 · Shen et al. · 2022 [cited by applicant]
US 11836450B2 · Kale et al. · 2023 [cited by applicant]
US 20170068646A1 · Beechuk et al. · 2017 [cited by applicant]
US 20170345426A1 · Komissarchik et al. · 2017 [cited by applicant]
US 20180089585A1 · Rickard, Jr. et al. · 2018 [cited by applicant]
US 20180096250A1 · Rickard, Jr. et al. · 2018 [cited by applicant]
US 20180096372A1 · Rickard, Jr. et al. · 2018 [cited by applicant]
US 20190089229A1 · Sameshima et al. · 2019 [cited by applicant]
US 20190095054A1 · Peng et al. · 2019 [cited by applicant]
US 20190138650A1 · Snider et al. · 2019 [cited by applicant]
US 20200065511A1 · Rickard, Jr. et al. · 2020 [cited by applicant]
US 20200097496A1 · Alexander et al. · 2020 [cited by applicant]
US 20200097544A1 · Alexander et al. · 2020 [cited by applicant]
US 20200097563A1 · Alexander et al. · 2020 [cited by applicant]
US 20200097600A1 · Sakhuja et al. · 2020 [cited by applicant]
US 20200097608A1 · Xiu et al. · 2020 [cited by applicant]
US 20200097809A1 · Velasco et al. · 2020 [cited by applicant]
US 20200117671A1 · Govindarajan et al. · 2020 [cited by applicant]
US 20200233874A1 · Chittar et al. · 2020 [cited by applicant]
US 20210150144A1 · Kale et al. · 2021 [cited by applicant]
US 20210272563A1 · Iwase · 2021 [cited by examiner]
WO 2019089229A1 · 2019 [cited by applicant]
U.S. Appl. No. 17/099,083, Non Final Office Action mailed Mar. 30, 2023, 14 pgs. [cited by applicant]
U.S. Appl. No. 17/099,083, Notice of Allowance mailed Aug. 14, 2023, 12 pgs. [cited by applicant]