Three-dimensional reconstruction of a product from content including the product provided to an online system by users
A publishing user identifies a product offered by the user to an online system by providing multiple images of a product viewed at different angles to the online system. The online system applies an identification model to content items obtained from other users to identify the product. From images of the product from the publishing user and content items from other users having at least a threshold confidence of including the product, the online system generates a three-dimensional reconstruction of the product. The online system may subsequently use the three-dimensional reconstruction of the product to display the product to users or to allow other users to identify the product from the online system.
1. A method comprising:
obtaining information identifying products offered by a publishing user of an online system, the obtained information including one or more pictures of a product corresponding to different angles of the product;
obtaining, at the online system, content items from other users of the online system different from the publishing user;
determining, by the online system, a confidence of an object identified in a content item obtained from a user different from the publishing user matching the product by applying an identification model to the object identified in the content item and to the pictures of the product obtained from the publishing user;
determining that the confidence of the object identified in the content item obtained from the user different from the publishing user equals or exceeds a threshold confidence value;
generating, by the online system, a three-dimensional reconstruction of the product by applying a three-dimensional reconstruction process to the one or more pictures of the product obtained from the publishing user and to the content item obtained from the user different from the publishing user in response to the determining;
storing, by the online system, the three-dimensional reconstruction of the product in association with the information identifying the product obtained from the publishing user;
rendering the three-dimensional representation of the product generated by the online system applying the three-dimensional reconstruction process to the one or more pictures of the product obtained from the publishing user and to the content item obtained from the user different from the publishing user onto a three-dimensional model of an additional user into a video included in a content item obtained from another user of the online system, the content item including a tag identifying the additional user, and the additional user different from the publishing user and from the user different from the publishing user from whom the content item in which the product was identified was obtained; and
displaying the video to the additional user including the three-dimensional representation of the product rendered onto the three-dimensional model of the additional user.
2. The method of claim 1 , further comprising:
displaying the three-dimensional reconstruction of the product in association with information identifying the product on a product page identifying one or more products offered by the publishing user.
3. The method of claim 1 , further comprising:
rendering the three-dimensional reconstruction of the product onto an image of an additional user; and
displaying the three-dimensional reconstruction of the product rendered onto the image of the additional user to the additional user.
4. The method of claim 3 , wherein the three-dimensional reconstruction of the product is rendered onto the image of the additional user in response to a request from the additional user.
5. The method of claim 1 , further comprising:
rendering the three-dimensional reconstruction of the product onto an image of the user different from the publishing user in response to a request from the user different from the publishing user.
6. A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor cause the processor to:
obtain information identifying products offered by a publishing user of an online system, the obtained information including one or more pictures of a product corresponding to different angles of the product;
obtain at the online system, content items from other users of the online system different from the publishing user;
determine, by the online system, a confidence of an object identified in a content item obtained from a user different from the publishing user matching the product by applying a identification model to the object identified in the content item and to the pictures of the product obtained from the publishing user;
determine that the confidence of the object identified in the content item obtained from the user different from the publishing user equals or exceeds a threshold confidence value;
generate, by the online system, a three-dimensional reconstruction of the product by applying a three-dimensional reconstruction process to the one or more pictures of the product obtained from the publishing user and to the content item obtained from the user different from the publishing user in response to the determining;
store, by the online system, the three-dimensional reconstruction of the product in association with the information identifying the product obtained from the publishing user;
render the three-dimensional representation of the product generated by the online system applying the three-dimensional reconstruction process to the one or more pictures of the product obtained from the publishing user and to the content item obtained from the user different from the publishing user onto a three-dimensional model of an additional user into a video included in a content item obtained from another user of the online system, the content item including a tag identifying the additional user, the additional user different from the publishing user and from the user different from than the publishing user from whom the content item in which the product was identified was obtained; and
display the video to the additional user including the three-dimensional representation of the product rendered onto the three-dimensional model of the additional user.
7. The computer program product of claim 6 , wherein the non-transitory computer readable storage medium further has instructions encoded thereon that, when executed by the processor, cause the processor to:
display the three-dimensional reconstruction of the product in association with information identifying the product on a product page identifying one or more products offered by the publishing user.
8. The computer program product of claim 6 , wherein the non-transitory computer readable storage medium further has instructions encoded thereon that, when executed by the processor, cause the processor to:
render the three-dimensional reconstruction of the product onto an image of an additional user; and
display the three-dimensional reconstruction of the product rendered onto the image of the additional user to the additional user.
9. The computer program product of claim 8 , wherein the three-dimensional reconstruction of the product is rendered onto the image of the additional user in response to a request from the additional user.
10. The computer program product of claim 6 , wherein the non-transitory computer readable storage medium further has instructions encoded thereon that, when executed by the processor, cause the processor to:
render the three-dimensional reconstruction of the product onto an image of the user different from the publishing user in response to a request from the user.