Contextual media filter search
Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.
1. A method comprising:
capturing, using one or more processors, an image frame at a client device, the image frame comprising a depiction of an object;
identifying the object within the image frame, the identifying the object within the image frame comprising:
identifying a first set of image features within the image frame;
storing the first set of features in an indexing structure;
identifying a second set of image features based on the first set of image features, the identifying comprising:
mapping each feature in the first set of image features to a representative feature in a set of representative features; and
generating a plurality of counts, each of the counts being associated with an occurrence of each representative feature in the set of representative features;
searching the indexing structure using the second set of image features;
accessing media content associated with the object within a media repository in response to identifying the object within the image frame;
accessing a media template, the media template defining a set of presentation positions within a graphical user interface of the client device, the set of presentation positions corresponding to presentation positions of the accessed media content; and
based on the accessed media template, causing presentation of the media content within the image frame at the client device.
2. The method of claim 1 , wherein defining the set of presentation positions comprises defining one or both of a presentation format and a layout of the accessed media content.
3. The method of claim 1 , wherein defining the set of presentation positions comprises defining an orientation of the accessed media content.
4. The method of claim 1 , wherein the media content comprises a plurality of augmented reality experience selections.
5. The method of claim 4 , wherein the plurality of augmented reality experience selections are configured to interact with the object within the image frame in real time.
6. The method of claim 4 , wherein the plurality of augmented reality experience selections is associated with a plurality of special effects, respectively.
7. The method of claim 1 , further comprising:
receiving an initiation of an input comprising a tactile input onto the graphical user interface of the client device;
detecting that a property of the tactile input transgresses a threshold value; and
capturing the image frame in response to the property of the tactile input transgressing the threshold value.
8. The method of claim 1 , wherein the first set of features are local features identified within predefined regions within the image frame.
9. The method of claim 1 , wherein the second set of image features are global features identified using an entirety of the image frame.
10. The method of claim 1 , wherein the image frame is received from a messaging application on the client device.
11. A system comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising:
capturing, using one or more processors, an image frame at a client device, the image frame comprising a depiction of an object;
identifying the object within the image frame, the identifying the object within the image frame comprising:
identifying a first set of image features within the image frame;
storing the first set of features in an indexing structure;
identifying a second set of image features based on the first set of image features, the identifying comprising:
mapping each feature in the first set of image features to a representative feature in a set of representative features; and
generating a plurality of counts, each of the counts being associated with an occurrence of each representative feature in the set of representative features;
searching the indexing structure using the second set of image features;
accessing media content associated with the object within a media repository in response to identifying the object within the image frame;
accessing a media template, the media template defining a set of presentation positions within a graphical user interface of the client device, the set of presentation positions corresponding to presentation positions of the accessed media content; and
based on the accessed media template, causing presentation of the media content within the image frame at the client device.
12. The system of claim 11 , wherein defining the set of presentation positions comprises defining one or both of a presentation format and a layout of the accessed media content.
13. The system of claim 11 , wherein defining the set of presentation positions comprises defining an orientation of the accessed media content.
14. The system of claim 11 , wherein the media content comprises a plurality of augmented reality experience selections.
15. The system of claim 14 , wherein the plurality of augmented reality experience selections are configured to interact with the object within the image frame in real time.
16. The system of claim 14 , wherein the plurality of augmented reality experience selections is associated with a plurality of special effects, respectively.
17. The system of claim 11 , further comprising:
receiving an initiation of an input comprising a tactile input onto the graphical user interface of the client device;
detecting that a property of the tactile input transgresses a threshold value; and
capturing the image frame in response to the property of the tactile input transgressing the threshold value.
18. The system of claim 11 , wherein the first set of features are local features identified within predefined regions within the image frame.
19. The system of claim 11 , wherein the second set of image features are global features identified using an entirety of the image frame.
20. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
capturing, using one or more processors, an image frame at a client device, the image frame comprising a depiction of an object;
identifying the object within the image frame, the identifying the object within the image frame comprising:
identifying a first set of image features within the image frame;
storing the first set of features in an indexing structure;
identifying a second set of image features based on the first set of image features, the identifying comprising:
mapping each feature in the first set of image features to a representative feature in a set of representative features; and
generating a plurality of counts, each of the counts being associated with an occurrence of each representative feature in the set of representative features;
searching the indexing structure using the second set of image features;
accessing media content associated with the object within a media repository in response to identifying the object within the image frame;
accessing a media template, the media template defining a set of presentation positions within a graphical user interface of the client device, the set of presentation positions corresponding to presentation positions of the accessed media content; and
based on the accessed media template, causing presentation of the media content within the image frame at the client device.