IP Library Granted Patent US 11,836,450
Granted Patent B2
US 11,836,450 · App. 17/099,083 · Granted Dec 5, 2023

Secure complete phrase utterance recommendation system

Inventors: Anuprit Kale (Oakland, CA); Weiping Peng (San Francisco, CA); Na Cheng (San Francisco, CA); Rick Lindstrom (San Francisco, CA); Zachary Alexander (Snoqualmie, WA)
Assignee: Salesforce, Inc.
G06F40/289G06F16/31G06F16/3329G06F16/3344G06F16/3347G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,450
App. No.
17/099,083
Granted
Dec 5, 2023
Kind
B2
Abstract

Described herein are systems, apparatus, methods and computer program products for machine learning intent classification. In various embodiments, historical utterances provided by users may be utilized for bot training. Context and personally identifiable information may be removed from the utterances. The utterances may be associated with vectors. The utterances and vectors may be used to determine recommendations.

Claims (67)

1. A database system, comprising:

an utterance database configured to store utterance data associated with one or more utterance phrases;

a phrase vector database configured to store phrase vector data comprising one or more phrase vectors, wherein each phrase vector is associated with a corresponding utterance phrase within the utterance database; and

a processor configured to perform operations comprising:

receiving an utterance dataset comprising a plurality of training phrases;

decoupling each of the training phrases from the other of the training phrases;

creating training data by:

associating each of the training phrases with phrase unique identifiers;

associating phrase vectors with each of the training phrases; and

associating each of the phrase vectors with phrase vector unique identifiers,

wherein each phrase vector unique identifier is matched with an associated phrase unique identifier;

training a model with the training data to provide utterance recommendations;

receiving entry data associated with a user entry of text provided through a user device;

determining, based on the model, an entry vector associated with the entry data;

determining one or more phrase vectors of the phase vectors matching the entry vector;

determining, based on the determined one or more phrase vectors, one or more utterance phrases associated with the one or more phrase vectors; and

communicating the one or more utterance phrases to the user device for presentation on the user device as a response to the user entry.

2. The system of claim 1 , wherein the operations further comprise:

determining one or more phrases based on the one or more phrase vectors.

3. The system of claim 1 , wherein the determining the one or more phrase vectors matching the entry vector comprises matching one or more phrase vectors within the phrase vector database to the entry vector.

4. The system of claim 1 , wherein the determining the one or more utterance phrases comprises requesting the utterances phrases associated with the determined one or more phrase vectors from the utterance database.

5. The system of claim 4 , wherein the determining the one or more utterance phrases comprises providing authentication data.

6. The system of claim 1 , wherein the operations further comprise:

decoupling each of the training phrases from the other of the training phrases; and

removing personally identifiable information from each of the training phrases.

7. The system of claim 6 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present less than a threshold number of times within the utterance dataset; and

removing the identified words.

8. The system of claim 6 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present in conversations between a number of parties less than a threshold number; and

removing the identified words.

9. The system of claim 6 , wherein the utterance database receives the utterance dataset.

10. A method, comprising:

receiving an utterance dataset comprising a plurality of training phrases;

decoupling each of the training phrases from the other of the training phrases;

creating training data by:

associating each of the training phrases with phrase unique identifiers;

associating phrase vectors with each of the training phrases; and

associating each of the phrase vectors with phrase vector unique identifiers, wherein each phrase vector unique identifier is matched with an associated phrase unique identifier;

training a model with the training data to provide utterance recommendations;

receiving entry data associated with a user entry of text provided through a user device;

determining, based on the model, an entry vector associated with the entry data;

determining one or more phrase vectors of the phrase vectors matching the entry vector, wherein the one or more phrase vectors are each associated with a corresponding utterance phrase stored within an utterance database and

wherein the utterance database is configured to store utterance data associated with the one or more utterance phrases;

determining, based on the one or more determined phrase vectors, one or more utterance phrases associated with the one or more phrase vectors; and

communicating the one or more utterance phrases to the user device for presentation on the user device as a response to the user entry.

11. The method of claim 10 , further comprising:

determining one or more phrases based on the one or more phrase vectors.

12. The method of claim 10 , wherein the determining the one or more phrase vectors matching the entry vector comprises matching one or more phrase vectors within the phrase vector database to the entry vector.

13. The method of claim 10 , wherein the determining the one or more utterance phrases comprises requesting the utterances phrases associated with the determined one or more phrase vectors from the utterance database.

14. The method of claim 13 , wherein the determining the one or more utterance phrases comprises providing authentication data.

15. The method of claim 10 , further comprising:

decoupling each of the training phrases from the other of the training phrases; and

removing personally identifiable information from each of the training phrases.

16. The method of claim 15 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present less than a threshold number of times within the utterance dataset; and

removing the identified words.

17. The method of claim 15 , wherein the removing the personally identifiable information comprises:

analyzing the utterance dataset to identify words present in conversations between a number of parties less than a threshold number; and

removing the identified words.

18. The method of claim 15 , wherein the utterance database receives the utterance dataset.

19. The system of claim 1 , wherein the operations further comprise:

storing the training phrases of the utterance dataset and the associated phrase unique identifiers within the utterance database; and

storing the phrase vectors and the associated phrase unique identifiers within the phrase vector database.

20. The method of claim 10 , further comprising:

storing the training phrases of the utterance dataset and the associated phrase unique identifiers within the utterance database; and

storing the phrase vectors and the associated phrase unique identifiers within the phrase vector database.

Assignments (2)
CHANGE OF NAME Recorded Oct 30, 2023
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 065395/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2020
From: KALE, ANUPRIT; PENG, WEIPING; CHENG, NA; LINDSTROM, RICK; ALEXANDER, ZACHARY
To: SALESFORCE.COM, INC.
Reel/Frame 054378/0570 →
Continuity (2)
Provisional Application 62936967 · Nov 18, 2019
Related Publication 20210150144A1 · May 20, 2021
Cited By (4)
US 12,288,032 US 12,632,442 US 12,645,674 US 12,670,151