IP Library Granted Patent US 11,887,359
Granted Patent B2
US 11,887,359 · App. 17/375,473 · Granted Jan 30, 2024

Content suggestions for content digests for assistant systems

Inventors: Zheng Zhou (San Jose, CA); Kun Han (Moutain View, CA); Fuchun Peng (Palo Alto, CA)
Assignee: Meta Platforms, Inc.
G06V10/82G06F3/011G06F3/013G06F3/017G06F3/167G06F7/14G06F9/453G06F16/176G06F16/2255G06F16/2365G06F16/243G06F16/248G06F16/24552G06F16/24575G06F16/24578G06F16/338G06F16/3323G06F16/3329G06F16/3344G06F16/904G06F16/9038G06F16/90332G06F16/90335G06F16/951G06F16/9535G06F18/2411G06F40/205G06F40/295G06F40/30G06F40/40G06N3/006G06N3/08G06N7/01G06N20/00G06Q50/01G06V10/764G06V20/10G06V40/28G10L15/02G10L15/063G10L15/07G10L15/16G10L15/183G10L15/187G10L15/1815G10L15/1822G10L15/22G10L15/26G10L17/06G10L17/22H04L12/2816H04L41/20H04L41/22H04L43/0882H04L43/0894H04L51/02H04L51/18H04L51/216H04L51/52H04L67/306H04L67/535H04L67/5651H04L67/75H04W12/08G06F2216/13G10L13/00G10L13/04G10L2015/223G10L2015/225H04L51/046H04L67/10H04L67/53
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,887,359
App. No.
17/375,473
Granted
Jan 30, 2024
Kind
B2
Abstract

In one embodiment, a method includes, by one or more computing systems, receiving, from a client system via an assistant xbot, a first audio input from a user, parsing the first audio input to identify a request for a content digest from an online social network, retrieving a plurality of content objects from the online social network, each of the content objects being accessible by the user, generating a customized newsfeed summary based on a determined semantical meaning of each of the plurality of content objects, and sending, to the client system via the assistant xbot, instructions for presenting an audio clip to the user responsive to the request for the content digest, wherein the audio clip comprises the customized newsfeed summary.

Claims (78)

1. A method comprising:

receiving, from a client system via an assistant xbot, a first audio input from a user;

parsing the first audio input to identify a request for a content digest from an online social network;

retrieving a plurality of content objects from the online social network responsive to the content digest, each of the content objects being accessible by the user;

generating a customized newsfeed summary responsive to the content digest, wherein the customized newsfeed summary comprises a plurality of content summaries corresponding to the plurality of content objects, and wherein each content summary is based on a determined semantical meaning of one of the content objects of the plurality of content objects;

generating one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary, wherein the one or more content suggestions are generated based on the determined semantical meaning of the respective content object; and

sending, to the client system via the assistant xbot, instructions for presenting an audio clip to the user responsive to the request for the content digest, wherein the audio clip comprises (1) the customized newsfeed summary comprising the plurality of content summaries corresponding to the plurality of content objects and (2) the one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary.

2. The method of claim 1 , wherein the content suggestions comprise one or more of:

a comment;

a like;

an audio clip;

an image;

a video;

a link;

a message; or

a review.

3. The method of claim 1 , wherein the content suggestions comprises a prompt to the user to generate a comment to be associated with the corresponding content object.

4. The method of claim 1 , further comprising:

determining, based on a query model, a semantical-embedding for each retrieved content, wherein the semantical-embedding for each content object represents a semantical meaning of the respective content object;

determining one or more categories for each retrieved content object, wherein each category is selected from a plurality of predefined categories;

generating, based on a response model, a set of content suggestions for one or more of the retrieved content objects based on the one or more categories associated with the content object and the semantical-embedding of the content object, wherein each the set of content suggestions comprises one or more content suggestions responsive to the respective content object; and

ranking, for each set of content suggestions, the one or more content suggestions in the respective set based on a comparison of a semantical-embedding associated with each content suggestion to the semantical-embedding of the content object, wherein the content suggestions are presented based on their respective rankings.

5. The method of claim 4 , further comprising training the query model by:

accessing a plurality of prior content objects, wherein each of the prior content objects is associated with a predefined category from the plurality of predefined categories;

determining a plurality of semantical-embeddings for the plurality of prior content objects, respectively; and

generating a plurality of clusters of prior content objects based on the semantical-embeddings of the plurality of prior content objects.

6. The method of claim 4 , further comprising training the response model by:

accessing a plurality of prior content responses, wherein each prior content response is associated with a prior content object from the plurality of prior content objects;

determining a plurality of semantical-embeddings for the plurality of prior content responses, respectively; and

generating, for the prior content objects within each predefined category, a plurality of clusters of prior content responses based on the semantical-embeddings of the plurality of prior content responses.

7. The method of claim 6 , wherein training the response model further comprises training a pair NN model by:

selecting a prior content response associated with a prior content object as a positive input for the pair NN model; and

selecting a random prior content response as a negative input for the pair NN model.

8. The method of claim 6 , further comprising:

assigning each of the prior content responses of the plurality prior content responses to its corresponding prior content object, wherein the semantical-embedding of the prior content response is associated with the semantical-embedding of the corresponding prior content object; and

assigning the one or more clusters of prior content responses to one or more clusters of prior content objects.

9. The method of claim 8 , wherein generating the set of content suggestions for each retrieved content object further comprises:

identifying, for each of the retrieved content objects, which cluster of prior content objects the retrieved content object is associated with based on a comparison of the semantical-embedding of the retrieved content object with the semantical-embeddings of the prior content objects in the respective cluster; and

selecting, for each of the retrieved content objects, one or more of the prior content responses from the cluster of prior content responses assigned to the identified cluster of prior content objects as content suggestions for the set of content suggestions for the retrieved content object.

10. The method of claim 1 , further comprising:

determining, for each retrieved content object, whether the content object is accessible by the user based on a privacy setting associated with content object.

11. The method of claim 1 , wherein the first audio input comprises a voice command to invoke the retrieval of the plurality of objects.

12. The method of claim 1 , wherein the instructions for presenting the customized newsfeed summary comprises presenting a summary of each of the retrieved content objects based on its determined semantical meaning.

13. The method of claim 1 , further comprising:

receiving, from the client system via the assistant xbot, a second audio input from the user;

parsing the second audio input to identify a selection of one of the retrieve content objects; and

to the client system via the assistant xbot, instructions for presenting an audio clip to the user comprising the selected content object.

14. The method of claim 1 , further comprising:

accessing a user profile of the user from a user context engine; and

modifying customized newsfeed summary based on the user profile of the user.

15. The method of claim 1 , further comprising:

receiving, from the client system via the assistant xbot, a second audio input from the user;

parsing the second audio input to identify a selection of one of the one or more content suggestions to respond to the one or more of the retrieved content objects used to generate the customized newsfeed summary; and

performing, responsive to the selection, the one of the one or more content suggestions to respond to the one or more of the retrieved content objects used to generate the customized newsfeed summary.

16. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive, from a client system via an assistant xbot, a first audio input from a user;

parse the first audio input to identify a request for a content digest from an online social network;

retrieve a plurality of content objects from the online social network responsive to the content digest, each of the content objects being accessible by the user;

generate a customized newsfeed summary responsive to the content digest, wherein the customized newsfeed summary comprises a plurality of content summaries corresponding to the plurality of content objects, and wherein each content summary is based on a determined semantical meaning of one of the content objects of the plurality of content objects;

generate one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary, wherein the one or more content suggestions are generated based on the determined semantical meaning of the respective content object; and

send, to the client system via the assistant xbot, instructions for presenting an audio clip to the user responsive to the request for the content digest, wherein the audio clip comprises (1) the customized newsfeed summary comprising the plurality of content summaries corresponding to the plurality of content objects and (2) the one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary.

17. The media of claim 16 , wherein the content suggestions comprise one or more of:

a comment;

a like;

an audio clip;

an image;

a video;

a link;

a message; or

a review.

18. The media of claim 16 , wherein the content suggestions comprises a prompt to the user to generate a comment to be associated with the corresponding content object.

19. A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:

receive, from a client system via an assistant xbot, a first audio input from a user;

parse the first audio input to identify a request for a content digest from an online social network;

retrieve a plurality of content objects from the online social network responsive to the content digest, each of the content objects being accessible by the user;

generate a customized newsfeed summary responsive to the content digest, wherein the customized newsfeed summary comprises a plurality of content summaries corresponding to the plurality of content objects, and wherein each content summary is based on a determined semantical meaning of one of the content objects of the plurality of content objects;

generate one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary, wherein the one or more content suggestions are generated based on the determined semantical meaning of the respective content object; and

send, to the client system via the assistant xbot, instructions for presenting an audio clip to the user responsive to the request for the content digest, wherein the audio clip comprises (1) the customized newsfeed summary comprising the plurality of content summaries corresponding to the plurality of content objects and (2) the one or more content suggestions that are each interactable to respond to one or more of the retrieved content objects used to generate the customized newsfeed summary.

Assignments (3)
CHANGE OF NAME Recorded Feb 1, 2024
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 066438/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2024
From: ZHOU, ZHENG; HAN, KUN; PENG, FUCHUN
To: FACEBOOK, INC.
Reel/Frame 066309/0895 →
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
Continuity (3)
Continuation 16103775 · Aug 14, 2018
Provisional Application 62660876 · Apr 20, 2018
Related Publication 20210342410A1 · Nov 4, 2021
Cited By (2)
US 12,400,069 US 12,513,100