Systems and methods for generating augmented reality scenes for physical items
Systems and methods are provided for the generation of augmented reality (AR) scenery for a physical item. The AR scenery allows a customer to interact with the physical item in the real-world, while also allowing the customer to view the physical item in a virtual setting that may be tailored to the customer and/or to the physical item. According to an embodiment, an AR scene is generated for a physical item. The AR scene includes computer-generated scenery and at least a portion of an image of the physical item, where the computer-generated scenery is based on information associated with the user and/or the physical item. The AR scene is then displayed on a device.
1. A computer-implemented method comprising:
obtaining an image of a physical real-world product for sale, the image having been captured by a device associated with a user;
determining an identity of the physical real-world product;
obtaining an indication of a plurality of different virtual scenes in which to present the physical real-world product using augmented reality (AR), at least two of the virtual scenes each of a respective different room in which the physical real-world product may be presented, each different virtual scene associated with a respective different three-dimensional (3D) model, each for generating respective different virtual content, and each associated with at least one of the user and the physical real-world product, and wherein at least one of the virtual scenes is recommended based on the identity of the physical real-world product;
instructing the device to display the indication of the plurality of different virtual scenes;
receiving a selection of a particular virtual scene associated with a particular 3D model of the plurality of different 3D models;
generating an AR scene comprising both: (1) computer-generated scenery including the virtual content of the particular virtual scene associated with the particular 3D model that was selected and (2) at least a portion of the image of the physical real-world product; and
instructing the device to display the AR scene.
2. The computer-implemented method of claim 1 , wherein:
the physical real-world product is a first product,
the method further comprises obtaining an indication of a second product associated with at least one of the user and the first product, and
the computer-generated scenery comprises a virtual representation of the second product.
3. The computer-implemented method of claim 1 , wherein determining the identity of the physical real-world product comprises receiving an indication of the physical real-world product.
4. The computer-implemented method of claim 1 , wherein determining the identity of the physical real-world product comprises analysing the image.
5. The computer-implemented method of claim 1 , wherein generating the AR scene comprises:
determining the dimensions of the physical real-world product, and
scaling the computer-generated scenery relative to the dimensions of the physical real-world product.
6. The computer-implemented method of claim 1 , wherein generating the AR scene comprises anchoring the portion of the image to a virtual point in the computer-generated scenery.
7. The computer-implemented method of claim 1 , further comprising:
receiving a request to modify the AR scene;
generating a modified AR scene based on the request; and
instructing the device to display the modified AR scene.
8. The computer-implemented method of claim 1 , wherein the image is a first image, the physical real-world product is a first physical item, the device is a first device and the user is a first user, the method further comprising:
obtaining a second image of a second physical item, the second image having been captured by a second device associated with a second user, wherein the AR scene further comprises a virtual representation of the second physical item.
9. The computer-implemented method of claim 1 , wherein the indication of the plurality of different virtual scenes is obtained using a machine learning model.
10. The computer-implemented method of claim 1 , wherein generating the AR scene comprises generating the visual content and one or more of audio content and haptic content.
11. The computer-implemented method of claim 1 , further comprising recommending the at least one of the virtual scenes based on both the identity of the physical real-world product and information associated with the user.
12. The computer-implemented method of claim 1 , wherein the plurality of different virtual scenes are each recommended based on the identity of the physical real-world product.
13. The computer-implemented method of claim 1 , wherein the at least one of the virtual scenes is recommended based on product information corresponding to the identity of the physical real-world product.
14. A system comprising:
a memory to store an image of a physical real-world product for sale, the image having been captured by a device associated with a user;
at least one processor to:
determine an identity of the physical real-world product;
obtain an indication of a plurality of different virtual scenes in which to present the physical real-world product using augmented reality (AR), at least two of the virtual scenes each of a respective different room in which the physical real-world product may be presented, each different virtual scene associated with a respective different three-dimensional (3D) model, each for generating respective different virtual content, and each associated with at least one of the user and the physical real-world product, and wherein at least one of the virtual scenes is recommended based on the identity of the physical real-world product;
instruct the device to display the indication of the plurality of different virtual scenes;
receive a selection of a particular virtual scene associated with a particular 3D model of the plurality of different 3D models;
generate an AR scene comprising both: (1) computer-generated scenery including the virtual content of the particular virtual scene associated with the particular 3D model that was selected and (2) at least a portion of the image of the physical real-world product; and
instruct the device to display the AR scene.
15. The system of claim 14 , wherein:
the physical real-world product is a first product,
the at least one processor is to obtain an indication of a second product associated with at least one of the user and the first product, and
the computer-generated scenery comprises a virtual representation of the second product.
16. The system of claim 14 , wherein the at least one processor is further to:
determine the dimensions of the physical real-world product, and
scale the computer-generated scenery relative to the dimensions of the physical real-world product.
17. The system of claim 14 , wherein the at least one processor is further to anchor the portion of the image to a virtual point in the computer-generated scenery.
18. The system of claim 14 , wherein the at least one processor is further to:
receive a request to modify the AR scene;
generate a modified AR scene based on the request; and
instruct the device to display the modified AR scene.
19. The system of claim 14 , wherein the image is a first image, the physical real-world product is a first physical item, the device is a first device, the user is a first user, and the memory is further to:
store a second image of a second physical item, the second image having been captured by a second device associated with a second user, wherein the AR scene further comprises a virtual representation of the second physical item.
20. The system of claim 14 , wherein the indication of the plurality of different virtual scenes is obtained using a machine learning model.
21. The system of claim 14 , wherein the AR scene comprises the visual content and one or more of audio content and haptic content.
22. The system of claim 14 , wherein the at least one processor is to recommend the at least one of the virtual scenes based on both the identity of the physical real-world product and information associated with the user.
23. The system of claim 14 , wherein the plurality of different virtual scenes are each recommended based on the identity of the physical real-world product.
24. The system of claim 14 , wherein the at least one of the virtual scenes is recommended based on product information corresponding to the identity of the physical real-world product.