Granted Patent B2

US 12,367,693 · App. 18/378,245 · Granted Jul 22, 2025

Inventors: Vítor Silva Sousa (Los Angeles, CA); Nils Murrugarra-Llerena (Los Angeles, CA); Leonardo Ribas Machado das Neves (Marina del Rey, CA); Neil Shah (Los Angeles, CA)

Assignee: Snap Inc.

G06V20/70G06F16/5866G06F18/214G06F18/2431G06N3/08G06N3/04G06V2201/10H04L51/10

Abstract

Claims (52)

1. A system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

processing images to identify elements in the images;

associating labels with the images based on one or more conditions indicating when to associate labels with images based on the elements identified in the images;

determining engagement scores for the labels based on interactions of users with the images associated with the labels;

adjusting the engagement scores to determine a dynamic seasonality for an interaction of the interactions of the users, the dynamic seasonality based on an average of subtracting a trend component from values of the interaction;

in response to determining that an engagement score of the adjusted engagement scores for a label of the labels transgresses a threshold value, recommending images associated with the label to users of an interaction platform, and generating augmentations based on the label for the recommended images, the augmentations comprising at least one of stickers, captions, or songs; and

providing the generated augmentations to the users.

2. The system of claim 1 , wherein the operations further comprise:

in response to determining that the adjusted engagement score of the adjusted engagement scores is in a normality range, generating content items associated with the label or generating a report indicating the label and the adjusted engagement score.

3. The system of claim 2 , wherein the operations further comprise:

causing the report to be displayed by a computer.

4. The system of claim 1 , wherein the operations further comprise:

causing the adjusted engagement scores to be displayed on a display of a computer.

5. The system of claim 1 , wherein the operations further comprise:

storing the interactions of the users with the images.

6. The system of claim 1 , wherein in response to determining to associate the label with the images further comprises:

associating ancestors of the label within a hierarchy of labels with the images.

7. The system of claim 1 , wherein the interactions of the users with the images comprises a plurality of content consumption metrics, and wherein the operations further comprise:

determining a passion as an engagement score for the label based on multiplying a weight of a plurality of weights with a corresponding content consumption metric of the plurality of content consumption metrics.

8. The system of claim 7 wherein the plurality of weights is a first plurality of weights and wherein the operations further comprise:

determining a popularity as an engagement score for the label based on multiplying a weight of a second plurality of weights with a corresponding content consumption metric of the plurality of content consumption metrics.

9. The system of claim 1 further comprising:

adjusting the adjusted engagement scores to determine a trend momentum (TM), the TM based on subtracting a first simple moving average (SMA) with a first window from a second SMA with a second window, wherein the second window is shorter than the first window.

10. The system of claim 1 , wherein the images are generated by client devices associated with the users.

11. The system of claim 1 , wherein the elements comprise objects, scenes, and actions.

12. The system of claim 1 , wherein metadata is associated with the images, and wherein the one or more conditions are further based on the metadata.

13. The system of claim 12 , wherein the one or more conditions are further based on augmentations added to the images.

14. The system of claim 1 wherein an element of the elements is identified based on using a convolution neural network trained to identify the element.

15. The system of claim 1 further comprising:

determining the interactions of users based on a date range.

16. A non-transitory storage medium comprising instructions that, when executed by one or more processors of a system, cause the system to perform operations, the operations comprising:

processing images to identify elements in the images;

associating labels with the images based on one or more conditions indicating when to associate labels with images based on the elements identified in the images;

determining engagement scores for the labels based on interactions of users with the images associated with the labels;

adjusting the engagement scores to determine a dynamic seasonality for an interaction of the interactions of the users, the dynamic seasonality based on an average of subtracting a trend component from values of the interaction;

in response to determining that an engagement score of the adjusted engagement scores for a label of the labels transgresses a threshold value, recommending images associated with the label to users of an interaction platform, and generating augmentations based on the label for the recommended images, the augmentations comprising at least one of stickers, captions, or songs; and

providing the generated augmentations to the users.

17. The non-transitory storage medium of claim 16 , wherein the operations further comprise:

in response to determining that the adjusted engagement score of the adjusted engagement scores is in a normality range, generating content items associated with the label or generating a report indicating the label and the adjusted engagement score.

18. The non-transitory storage medium of claim 16 , wherein in response to determining to associate the label with the images further comprises:

associating ancestors of the label within a hierarchy of labels with the images.

19. A method performed on a computer, the method comprising:

processing images to identify elements in the images;

associating labels with the images based on one or more conditions indicating when to associate labels with images based on the elements identified in the images;

determining engagement scores for the labels based on interactions of users with the images associated with the labels;

adjusting the engagement scores to determine a dynamic seasonality for an interaction of the interactions of the users, the dynamic seasonality based on an average of subtracting a trend component from values of the interaction;

in response to determining that an engagement score of the adjusted engagement scores for a label of the labels transgresses a threshold value, recommending images associated with the label to users of an interaction platform, and generating augmentations based on the label for the recommended images, the augmentations comprising at least one of stickers, captions, or songs; and

providing the generated augmentations to the users.

20. The method of claim 19 , wherein the method further comprises:

in response to determining that the adjusted engagement score of the adjusted engagement scores is in a normality range, generating content items associated with the label or generating a report indicating the label and the adjusted engagement score.

Assignments (1)

Continuity (3)

References Cited (63)