Augmented reality enabled dynamic product presentation
Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.
1. A computer-implemented method comprising:
obtaining, by a computer, a first utterance indicating an object;
providing for display, by the computer, a three-dimensional environment representing a physical space, the three-dimensional environment including a virtual object representing the object indicated by the first utterance; and
obtaining, by the computer, a second utterance providing a checkout instruction, the checkout instruction of the second utterance indicating the virtual object situated in the three-dimensional environment for a purchase transaction.
2. The method according to claim 1 , wherein the three-dimensional environment includes an augmented reality representation comprising the virtual object situated in an image of the physical space obtained via a camera feed,
wherein the method further comprises:
obtaining, by the computer, an instruction to change the three-dimensional environment from the augmented reality representation to a virtual reality representation of the physical space of the three-dimensional environment; and
providing for display, by the computer, the virtual reality representation including the virtual object representing the object situated in the virtual reality representation.
3. The method according to claim 1 , further comprising:
obtaining, by the computer, source image data via a camera feed for a region of the physical space;
determining, by the computer, one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generating, by the computer, the three-dimensional environment comprising an augmented reality representation of the region of the physical space in the camera feed based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the augmented reality representation.
4. The method according to claim 1 , further comprising:
obtaining, by the computer, a source image data for a region of the physical space;
determining, by the computer, one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generating, by the computer, the three-dimensional environment comprising a virtual reality representation of the region of the physical space based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the virtual reality representation.
5. The method according to claim 1 , further comprising updating, by the computer, one or more attributes of the three-dimensional environment representing a region of the physical space based upon source image data for the region of the physical space.
6. The method according to claim 1 , further comprising:
obtaining, by the computer, a location of a client device, wherein the three-dimensional environment is provided for display at the client device; and
generating, by the computer, a type of representation of the three-dimensional environment based upon the location of the client device relative to the physical space, wherein the type of representation includes at least one of an augmented reality representation or a virtual reality representation.
7. The method according to claim 1 , further comprising determining, by the computer, the position of the virtual object according to one or more attributes of the virtual object and a plurality of spatial parameters of the three-dimensional environment.
8. The method according to claim 7 , further comprising identifying, by the computer, a positioning collision in the three-dimensional environment based upon the position determined for the virtual object and a second position of a second virtual object representing a second object in the three-dimensional environment.
9. The method according to claim 1 , further comprising updating, by the computer, one or more attributes of the virtual object in the three-dimensional environment based upon updated media data including the object represented by the virtual object.
10. The method according to claim 1 , further comprising selecting, by the computer, a region of the physical space to be represented in the three-dimensional virtual environment based upon a user input associated with the first utterance.
11. A system comprising:
a computer comprising at least one processor configured to:
obtain a first utterance indicating an object;
provide for display a three-dimensional environment representing a physical space, the three-dimensional environment including a virtual object representing the object indicated by the first utterance; and
obtain a second utterance providing a checkout instruction, the checkout instruction of the second utterance indicating the virtual object situated in the three-dimensional environment for a purchase transaction.
12. The system according to claim 11 , wherein the three-dimensional environment includes an augmented reality representation comprising the virtual object situated in an image of the physical space obtained via a camera feed,
wherein the at least one processor of the computer is further configured to:
obtain an instruction to change the three-dimensional environment from the augmented reality representation to a virtual reality representation of the physical space of the three-dimensional environment; and
provide the virtual reality representation including the virtual object representing the object situated in the virtual reality representation.
13. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain source image data via a camera feed for a region of the physical space;
determine one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generate the three-dimensional environment comprising an augmented reality representation of the region of the physical space in the camera feed based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the augmented reality representation.
14. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain a source image data for a region of the physical space;
determine one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generate the three-dimensional environment comprising a virtual reality representation of the region of the physical space based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the virtual reality representation.
15. The system according to claim 11 , wherein the at least one processor of the computer is further configured to update one or more attributes of the three-dimensional environment representing a region of the physical space based upon source image data for the region of the physical space.
16. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain a location of a client device, wherein the three-dimensional environment is provided for display at the client device; and
generate a type of representation of the three-dimensional environment based upon the location of the client device relative to the physical space, wherein the type of representation includes at least one of an augmented reality representation or a virtual reality representation.
17. The system according to claim 11 , wherein the at least one processor of the computer is further configured to determine the position of the virtual object according to one or more attributes of the virtual object and a plurality of spatial parameters of the three-dimensional environment.
18. The system according to claim 17 , wherein the at least one processor of the computer is further configured to identify a positioning collision in the three-dimensional environment based upon the position determined for the virtual object and a second position of a second virtual object representing a second object in the three-dimensional environment.
19. The system according to claim 11 , wherein the at least one processor of the computer is further configured to update one or more attributes of the virtual object in the three-dimensional environment based upon updated media data including the object represented by the virtual object.
20. A non-transitory machine-readable storage medium having computer-executable instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform operations of:
obtaining a first utterance indicating an object;
providing for display a three-dimensional environment representing a physical space, the three-dimensional environment including a virtual object representing the object indicated by the first utterance; and
obtaining a second utterance providing a checkout instruction, the checkout instruction of the second utterance indicating the virtual object situated in the three-dimensional environment for a purchase transaction.