IP Library Granted Patent US 12,242,554
Granted Patent B2
US 12,242,554 · App. 17/978,091 · Granted Mar 4, 2025

Intelligent content recommendation within a communication session

Inventors: Wan Chen (Cupertino, CA); Davide Giovanardi (Saratoga, CA); Stephen Muchovej (Bishop, CA); Xiaoli Song (Redding, CA)
Assignee: Zoom Communications, Inc.
G06F16/9535G10L15/08G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,242,554
App. No.
17/978,091
Granted
Mar 4, 2025
Kind
B2
Abstract

Methods and systems provide for intelligent content recommendation within a communication session. In one embodiment, the system receives a list of content recommendation actions, each content recommendation action being associated with one or more trigger phrases constituting conditions for the content recommendation action to be performed, each trigger phrase being associated with a party the trigger phrase is to be uttered by. The system connects to a communication session with a plurality of participants, and receives a number of utterances associated with the participants in real time. For each utterance, the system determines whether a prediction of relatedness is present between the utterance and one or more trigger phrases associated with a content recommendation action. Upon determining that a prediction of relatedness is present, the system performs the associated content recommendation action by transmitting, to one or more client devices, one or more pieces of content to be recommended.

Claims (47)

1. A method, comprising:

receiving a list of content recommendation actions specifically adjusted for a particular type of communication session, each content recommendation action being associated with one or more trigger phrases comprising conditions for performance of the content recommendation action during the particular communication session, each trigger phrase being associated with a party the trigger phrase is to be uttered by, wherein the content recommendation actions and corresponding trigger phrases are generated based on actions and trigger phrases performed by other users of a communication platform;

connecting to the communication session with a plurality of participants;

receiving a plurality of utterances associated with the participants in real time during the communication session, wherein each utterance is associated with a speaker;

for each utterance, determining, by one or more pre-trained language learning models, whether a prediction of relatedness is present between the utterance and one or more trigger phrases associated with a content recommendation action from the list of content recommendation actions;

for each utterance, determining whether the speaker associated with the utterance is the party associated with the trigger phrase and the content recommendation action; and

upon determining that a prediction of relatedness is present and that the speaker is the party, performing the associated content recommendation action by transmitting, to one or more client devices, one or more pieces of content for display on the one or more client devices during the communication session, wherein the one or more pieces of content includes the corresponding trigger phrase.

2. The method of claim 1 , further comprising:

receiving a plurality of pieces of content; and

extracting, from each piece of content, a plurality of keywords representing the content;

for each utterance, determining whether a prediction of relatedness is present between the utterance and the plurality of keywords representing the content; and

upon determining that a prediction of relatedness is present, transmitting, to one or more client devices, one or more pieces of content from which the related keyword was extracted.

3. The method of claim 1 , wherein the party associated with each trigger phrase may be one or both of: a recipient party, and a customer party.

4. The method of claim 1 , wherein receiving the list of content recommendation actions comprises:

presenting, to a client device associated with a user of the communication platform, a user interface (UI) comprising a prompt for the user to submit one or more content recommendation actions and one or more trigger phrases associated with the content recommendation actions.

5. The method of claim 1 , wherein at least a subset of the content recommendation actions comprises at least one of: a recommended response to be uttered, one or more pieces of content to be recommended, and one or more content links to be provided.

6. The method of claim 1 , wherein the one or more pieces of content to be recommended are directed to a recipient party to provide a response to a customer party.

7. The method of claim 6 , wherein the recipient party comprises one or more of: a sales agent, a customer service agent, and a technical support agent.

8. The method of claim 1 , wherein determining whether the predictions of relatedness are present further comprises determining whether a prediction of relatedness is present between the utterance and one or more variations on the one or more trigger phrases associated with the content recommendation action.

9. The method of claim 1 , wherein determining whether a prediction of relatedness is present is performed at least in part by one or more sentence embedding models.

10. The method of claim 1 , further comprising:

generating, based on the received list of content recommendation actions, one or more additional trigger phrases to be associated with one or more of the content recommendation actions.

11. The method of claim 1 , further comprising:

detecting that one of the trigger phrases has been associated with a content recommendation action that differs in intent from the trigger phrase; and

associating the trigger phrase with a different content recommendation action.

12. The method of claim 1 , wherein a subset of the trigger phrases are each associated with a plurality of content recommendation actions.

13. A communication system comprising one or more processors configured to perform operations of:

receiving a list of content recommendation actions specifically adjusted for a particular type of communication session, each content recommendation action being associated with one or more trigger phrases comprising conditions for performance of the content recommendation action to during the particular communication session, each trigger phrase being associated with a party the trigger phrase is to be uttered by, wherein the content recommendation actions and corresponding trigger phrases are generated based on actions and trigger phrases performed by other users of a communication platform;

connecting to the communication session with a plurality of participants;

receiving a plurality of utterances associated with the participants in real time during the communication session, wherein each utterance is associated with a speaker;

for each utterance, determining, by one or more pre-trained language learning models, whether a prediction of relatedness is present between the utterance and one or more trigger phrases associated with a content recommendation action from the list of content recommendation actions;

for each utterance, determining whether the speaker associated with the utterance is the party associated with the trigger phrase and the content recommendation action; and

upon determining that a prediction of relatedness is present and that the speaker is the party, performing the associated content recommendation action by transmitting, to one or more client devices, one or more pieces of content for display on the one or more client devices during the communication session, wherein the one or more pieces of content includes the corresponding trigger phrase.

14. The communication system of claim 13 , wherein determining whether the prediction of relatedness is present is performed at least in part by one or more intent detection algorithms.

15. The communications system of claim 13 , wherein the one or more pieces of content to be recommended are directed to a recipient party to provide a response to a customer party.

16. The communications system of claim 13 , wherein determining whether the predictions of relatedness are present further comprises determining whether a prediction of relatedness is present between the utterance and one or more variations on the one or more trigger phrases associated with the content recommendation action.

17. A non-transitory computer-readable medium comprising:

instructions for receiving a list of content recommendation actions specifically adjusted for a particular type of communication session, each content recommendation action being associated with one or more trigger phrases comprising conditions for performance of the content recommendation action during the particular communication session, each trigger phrase being associated with a party the trigger phrase is to be uttered by, wherein the content recommendation actions and corresponding trigger phrases are generated based on actions and trigger phrases performed by other users of a communication platform;

instructions for connecting to the communication session with a plurality of participants;

instructions for receiving a plurality of utterances associated with the participants in real time during the communication session, wherein each utterance is associated with a speaker;

for each utterance, instructions for determining, by one or more pre-trained language learning models, whether a prediction of relatedness is present between the utterance and one or more trigger phrases associated with a content recommendation action from the list of content recommendation actions;

for each utterance, determining whether the speaker associated with the utterance is the party associated with the trigger phrase and the content recommendation action; and

upon determining that a prediction of relatedness is present and that the speaker is the party, instructions for performing the associated content recommendation action by transmitting, to one or more client devices, one or more pieces of content for display on the one or more client devices during the communication session, wherein the one or more pieces of content includes the corresponding trigger phrase.

18. The non-transitory computer-readable medium of claim 17 , wherein the party associated with each trigger phrase may be one or both of: a recipient party, and a customer party.

19. The non-transitory computer-readable medium of claim 17 , wherein the instructions for receiving the list of content recommendation actions comprises:

instructions for presenting, to a client device associated with a user of the communication platform, a user interface (UI) comprising a prompt for the user to submit one or more content recommendation actions and one or more trigger phrases associated with the content recommendation actions.

20. The non-transitory computer-readable medium of claim 17 , wherein at least a subset of the content recommendation actions comprises at least one of: a recommended response to be uttered, one or more pieces of content to be recommended, and one or more content links to be provided.

Assignments (2)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2023
From: CHEN, WAN; GIOVANARDI, DAVIDE; SONG, XIAOLI; MUCHOVEJ, STEPHEN
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 063076/0261 →