Object identification in social media post
Various embodiments of systems and methods allow the presentation of a content item with a marketplace section. A system can receive a content item and analyze the content item to identify at least one featured object in the content item. The system can then match the at least one featured object with a marketplace item. If the marketplace item passes various filtering criteria, then the author of the content item can approve the marketplace item being presented with the content item. A system can then receive data for the content item from an application server and data for the marketplace item from a marketplace server and generate a unified presentation of the content item and the marketplace item. A user can then interact with a marketplace section to buy the marketplace item.
1. A computer-implemented method for presenting a content item with an associated marketplace item, comprising:
receiving a social media post, the post including a first image and having an author, the first image being compressed to a first file size;
detecting at least one object represented in the first image;
in response to detecting the at least one object, receiving a second image, the second image including a representation of the at least one object and being a second file size larger than the first file size;
determining one or more features of the at least one object in the second image;
determining an approbation score of the object in the social media post;
determining that the approbation score is above a certain amount;
identifying a marketplace item corresponding to the object, based at least in part on the one or more features, and available for consumption; and
providing for display with a social media post, using a server associated with a marketplace provider and based at least in part on the approbation score, a selectable element representing the marketplace item and an option to purchase the marketplace item, the selectable element being presentable within a region at least partially overlapping the social media post and including a third image of the item, different from the first image, corresponding to a representation of the marketplace item.
2. The computer-implemented method of claim 1 , wherein the post is presented in a social media application for a first server and the selectable element is inserted into the social media application, the method further comprising:
receiving a selection of the selectable element; and
overlaying an interactive purchasing window on the social media application, the interactive purchasing element being served by the second server.
3. The computer-implemented method of claim 2 wherein the selection of the selectable element is associated with a user of the social media application, further comprising:
authenticating the user with the server associated with the marketplace provider using the interactive purchasing element.
4. A computer-implemented method for presenting a content item with an associated marketplace item, comprising:
obtaining a user-provided content item, the content item including at least a first image being compressed to a first file size;
detecting at least one object represented in the content item;
receiving a second image, the second image being a second file size larger than the first file size;
determining one or more features of the at least one object in the second image;
determining an approbation score of the at least one object in the content item;
determining that the approbation score satisfies a predetermined criteria;
match the at least one object with a marketplace item, based at least in part on the one or more features; and
present a selectable element associated with the marketplace item and the content item, the selectable element being presentable within a region at least partially overlapping the content item and including a third image of the item, different from the first image, corresponding to a representation of the marketplace item.
5. The computer-implemented method of claim 4 , further comprising:
determining a context of the object in the content item; and
determining that the context is positive.
6. The computer-implemented method of claim 5 , wherein determining a context of the object is based on a caption in the content item.
7. The computer-implemented method of claim 5 , wherein determining a context of the object is based on a reaction to the content item published with the content item, the reaction being by a user that is not an author of the content item.
8. The computer-implemented method of claim 4 , wherein the content item has an author, wherein matching the at least one object with the marketplace item includes:
receiving permission from the author to search marketplace purchases of the author;
determining a set of marketplace items that match the object, the set of marketplace items including the marketplace item; and
determining that the marketplace item is a marketplace purchase of the author.
9. The computer-implemented method of claim 4 , wherein the content item has an author, the method further comprising receiving approval from the author to present the object with the post.
10. The computer-implemented method of claim 4 , wherein the content item has an author, the method further comprising:
determining a credibility metric of the author; and
determining that the credibility metric is above a predetermined amount.
11. The computer-implemented method of claim 4 , wherein the content item has an author, the method further comprising:
matching the object with a plurality of marketplace items; and
receiving a selection from the author of the marketplace item from the plurality of marketplace items.
12. The computer-implemented method of claim 4 , wherein the content item is provided by a first service, the selectable element is provided by a second service, and the first service and the second service are third parties to each other.
13. The computer-implemented method of claim 4 , further comprising:
determining a context of the content item;
obtaining a context filter from a seller of the marketplace item; and
determining that the context satisfies the context filter.
14. A system, comprising:
at least one processor; and
memory including instructions that, when executed by the at least one processor, cause the system to:
obtain a social media post, the content item including at least a first image being compressed to a first file size;
detect at least one object represented in the social media post;
receive a second image, the second image being a second file size larger than the first file size;
determine one or more features of the at least one object in the second image;
determine an approbation score of the object in the social media post;
determine that the approbation score is above a threshold amount;
match the at least one object represented in the social media post with a marketplace item, based at least in part on the one or more features; and
display the social media post and a selectable element for purchasing the marketplace item, the selectable element being presentable within a region at least partially overlapping the social media post and including a third image of the item, different from the first image, corresponding to a representation of the marketplace item.
15. The system of claim 14 , wherein the instructions when executed further cause the system to:
determine a sentiment of the social media post; and
determine that the sentiment is positive.
16. The system of claim 14 , wherein the social media post has an author and the instructions when executed further cause the system to:
receive permission from the author to search marketplace purchases of the author;
determine a set of marketplace items that match the object, the set of marketplace items including the marketplace item; and
determine that the marketplace item is a marketplace purchase of the author.
17. The system of claim 14 , wherein the social media post has an author and the instructions when executed further cause the system to receive approval from the author to display the selectable element for purchasing the marketplace item with the social media post.
18. The system of claim 14 , wherein the social media post has an author and the instructions when executed further cause the system to:
determine a credibility metric of the author; and
determine that the credibility metric is above a predetermined amount.
19. The system of claim 14 , wherein the social media post has an author and the instructions when executed further cause the system to:
match the object with a plurality of marketplace items; and
receive a selection from the author of the marketplace item from the plurality of marketplace items.
20. The system of claim 14 , wherein the social media post is provided by a first service and the selectable element is provided by a second service, the first service and the second service being third parties to each other.