IP Library Granted Patent US 11,170,035
Granted Patent B2
US 11,170,035 · App. 16/370,373 · Granted Nov 9, 2021

Context based media curation

Inventors: Kaveh Anvaripour (Santa Monica, CA); Ebony James Charlton (Los Angeles, CA); Travis Chen (Los Angeles, CA); Celia Nicole Mourkogiannis (Los Angeles, CA); Kevin Dechau Tang (Los Angeles, CA)
Assignee: Snap Inc.
G06F16/434G06F16/24578G06F16/41G06F16/438G06F16/44G06F16/48G06K7/1413G06K7/1417G06N20/00H04L51/10H04L51/12G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,170,035
App. No.
16/370,373
Granted
Nov 9, 2021
Kind
B2
Abstract

A media curation system configured to perform operations that include, capturing an image at a client device, wherein the image includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image at the client device.

Claims (60)

1. A method comprising:

receiving an input at the client device, the input including an input context and an image that comprises a plurality of image features, the input context comprising at least temporal data;

identifying an object based on the plurality of image features of the image in response to the receiving the input;

selecting a category based on the object identified based on the plurality of image features of the image, the category corresponding with one or more media tags;

generating a query that comprises a set of query terms based on at least the category;

accessing a media repository that comprises a plurality of media items based on the query, each media item among the plurality of media items associated with a media tag;

filtering a set of media items from the plurality of media items of the media repository based on the one or more media tags that corresponds with the category and the temporal data of the input context;

generating a collection of media content that comprises the set of media items, the collection of media content comprising a ranking of the set of media items based on the plurality of image features and the input context; and

causing display of a presentation of the collection of media content at the client device based on the ranking, the presentation of the collection of media content including an indicator that displays the number of media items among the collection of media content.

2. The method of claim 1 , wherein the identifying the category based on the plurality of image features of the image includes:

identifying an object depicted in the image based on the plurality of image features; and

identifying the category based on the object depicted in the image.

3. The method of claim 1 , wherein the method further comprises:

receiving a request to assign one or more media tags to at least a portion of the plurality of media items.

4. The method of claim 1 , wherein the method further comprises:

receiving a selection of media content from among the presentation of the collection of media content; and

presenting the media content at the client device based on the plurality of image features.

5. The method of claim 1 , wherein the object is a first object, and the generating the query includes:

identifying the first object depicted in the image based on a first subset of the plurality of image features;

identifying a second object depicted in the image based on a second subset of the plurality of image features;

selecting a first category that corresponds with the first object and a second category that corresponds with the second object;

generating the set of query terms of the query based on the first category and the second category; and

querying the media repository based on the query.

6. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

receiving an input at the client device, the input including an input context and an image that comprises a plurality of image features, the input context comprising at least temporal data;

identifying an object based on the plurality of image features of the image in response to the receiving the input;

selecting a category based on the object identified based on the plurality of image features of the image, the category corresponding with one or more media tags;

generating a query that comprises a set of query terms based on at least the category;

accessing a media repository that comprises a plurality of media items based on the query, each media item among the plurality of media items associated with a media tag;

filtering a set of media items from the plurality of media items of the media repository based on the one or more media tags that corresponds with the category and the temporal data of the input context;

generating a collection of media content that comprises the set of media items, the collection of media content comprising a ranking of the set of media items based on the plurality of image features and the input context; and

causing display of a presentation of the collection of media content at the client device based on the ranking, the presentation of the collection of media content including an indicator that displays the number of media items among the collection of media content.

7. The system of claim 6 , wherein the identifying the category based on the plurality of image features of the image includes:

identifying an object depicted in the image based on the plurality of image features; and

identifying the category based on the object depicted in the image.

8. The system of claim 6 , wherein the instructions cause the system to perform operations further comprising:

receiving a request to assign one or more media tags to at least a portion of the plurality of media items.

9. The system of claim 6 , wherein the instructions cause the system to perform operations further comprising:

receiving a selection of media content from among the presentation of the collection of media content; and

presenting the media content at the client device based on the plurality of image features.

10. The system of claim 6 , wherein the object is a first object, and the generating the query includes:

identifying the first object depicted in the image based on a first subset of the plurality of image features;

identifying a second object depicted in the image based on a second subset of the plurality of image features;

selecting a first category that corresponds with the first object and a second category that corresponds with the second object;

generating the set of query terms of the query based on the first category and the second category; and

querying the media repository based on the query.

11. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving an input at the client device, the input including an input context and an image that comprises a plurality of image features, the input context comprising at least temporal data;

identifying an object based on the plurality of image features of the image in response to the receiving the input;

selecting a category based on the object identified based on the plurality of image features of the image, the category corresponding with one or more media tags;

generating a query that comprises a set of query terms based on at least the category;

accessing a media repository that comprises a plurality of media items based on the query, each media item among the plurality of media items associated with a media tag;

filtering a set of media items from the plurality of media items of the media repository based on the one or more media tags that corresponds with the category and the temporal data of the input context;

generating a collection of media content that comprises the set of media items, the collection of media content comprising a ranking of the set of media items based on the plurality of image features and the input context; and

causing display of a presentation of the collection of media content at the client device based on the ranking, the presentation of the collection of media content including an indicator that displays the number of media items among the collection of media content.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the identifying the category based on the plurality of image features of the image includes:

identifying an object depicted in the image based on the plurality of image features; and

identifying the category based on the object depicted in the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: ANVARIPOUR, KAVEH; CHARLTON, EBONY JAMES; CHEN, TRAVIS; MOURKOGIANNIS, CELIA NICOLE; TANG, KEVIN DECHAU
To: SNAP INC.
Reel/Frame 057765/0283 →
Continuity (1)
Related Publication 20200311116A1 · Oct 1, 2020
Cited By (2)
US 12,475,158 US 12,536,567