Mobile AR prototyping for proxemic and gestural interactions with real-world IoT enhanced spaces
One or more devices, systems, methods and/or non-transitory, machine-readable mediums are described herein for specifying one or more events in an augmented reality (AR) environment relative to a real-world (RW) environment. A system can comprise a memory that stores executable components, and a processor, coupled to the memory, that executes or facilitates execution of the executable components. The executable components can comprise a visual component that analyzes captured visual content of a RW environment, an interface component that integrates the visual content of the RW environment with AR content of an AR environment overlaying the RW environment, and a design component that facilitates in-situ placement of the AR content in the AR environment based on the visual content being overlayed, wherein the AR content comprises a specification of an event to be executed in the RW environment that triggers a virtual asset in the AR environment.
1. A system, comprising:
at least one memory that stores executable components; and
at least one processor, coupled to the at least one memory, that executes or facilitates execution of the executable components, the executable components comprising:
a visual component that analyzes captured visual content of a real-world environment;
an interface component that renders an interface on a mobile device that displays the captured visual content of the real-world environment overlayed with augmented reality (AR) content of an AR environment and one or more menus; and
a design component that,
in response to receipt, via a first interaction with the interface, of a selection of a virtual asset from the one or more menus, adds the virtual asset to the AR content overlayed on the captured visual content,
places the virtual asset at a first location on the captured visual content indicated via a second interaction with the interface,
in response to receipt, via a third interaction with the interface, of an indication of a second location within the real-world environment to be associated with an event, adds an event proxy graphic representing the event to the AR content overlayed on the captured visual content at the second location, and
configures, based on interactions with the virtual asset and the event proxy graphic received via the interface, a mapping between the event and the virtual asset, wherein the mapping configures the virtual asset to perform an effect in response to detection of the event.
2. The system of claim 1 , wherein the event is a person being at a defined location within the real-world environment, the person being within a defined distance from a device represented by the virtual asset, a defined gesture performed by the person, or a defined orientation of the person.
3. The system of claim 2 , wherein the executable components further comprise a gesture recognition component that identifies the gesture absent a view of a full body of the person within the captured visual content.
4. The system of claim 1 , wherein at least one of the first interaction or the second interaction is received via a first-person view rendered via the interface or a third-person view rendered by the interface.
5. The system of claim 1 , wherein the effect performed by the virtual asset represents at least one of a visual response or an audio response to be triggered in the AR environment in response to detection of the event in the real-world environment.
6. The system of claim 1 , wherein
the executable components further comprise a detection component that detects an execution of the event in the real-world environment, and
detection of the event by the detection component causes the virtual asset to perform the effect in the AR environment.
7. The system of claim 6 , wherein,
while in a first-person testing mode, the detection component tests performance of the effect in response to triggering of the event via detection of a three-dimensional pose of the mobile device, and
while in a third-person testing mode, the detection component tests performance of the effect in response to detection of a test subject within the real-world environment performing the event.
8. The system of claim 1 , wherein the interface component further displays, at a periphery of the interface, a portion of the AR content that is not in a current view of the AR environment being displayed via the interface.
9. The system of claim 1 , wherein
the interface component further recognizes a horizontal plane and a vertical plane of the real-world environment, and visualizes, via the interface, an AR horizontal plane and an AR vertical plane corresponding to the horizontal plane and the vertical plane of the real-world environment, and
the interface component further recognizes the captured visual content of the real-world environment relative to the AR horizontal plane and the AR vertical plane.
10. A non-transitory machine-readable medium comprising executable instructions that, in response to execution by a processor, facilitate performance of operations, the operations comprising:
capturing visual content of a real-world environment;
rendering, via a mobile device, an interface that displays the visual content with an augmented reality (AR) environment and one or more menus overlaying the visual content;
in response to receiving, via a first interaction with the interface, a selection of a virtual asset from the one or more menus, adding the virtual asset to the AR environment overlayed on the visual content;
in response to receiving, via a second interaction with the interface, a first indication of a first location on the visual content, placing the virtual asset at the first location on the visual content;
in response to receiving, via a third interaction with the interface, a second indication of a second location on the visual content to be associated with an event, adding an event proxy graphic representing the event to the AR environment overlayed on the visual content at the second location; and
configuring, based on interactions with the virtual asset and the event proxy graphic received via the interface, a mapping between the event and an effect of the virtual asset, wherein the mapping configures the virtual asset to trigger the effect in response to detection of the event.
11. The non-transitory machine-readable medium of claim 10 , wherein at least one of the first interaction, the second interaction, or the third interaction is received via a first-person view or a third-person view displayed via the interface.
12. The non-transitory machine-readable medium of claim 10 , wherein
the event is a gesture performed by a person within the real-world environment, and
the operations further comprise recognizing the gesture absent a view of a full body of the person within the visual content.
13. The non-transitory machine-readable medium of claim 10 , wherein
the event is at least one of an orientation of a person within the real-world environment or a gesture of the person at a location within the real-world environment or within a distance from a device represented by the virtual asset.
14. The non-transitory machine-readable medium of claim 10 , wherein the operations further comprise displaying, at a periphery of the interface, AR content that is not in a view of the AR environment presently being displayed via the interface.
15. The non-transitory machine-readable medium of claim 10 , wherein the operations further comprise detecting the event independent of a location of a person in the real-world environment.
16. A method, comprising:
integrating, by a system operatively coupled to a processor, visual content of a real-world environment with an augmented reality (AR) environment overlaying the real-world environment on an interface rendered via a mobile device;
in response to receiving, via a first interaction with the interface, a selection of a virtual asset from a menu of virtual assets rendered on the interface, adding the virtual asset to the AR environment overlayed on the visual content;
in response to receiving, via a second interaction with the interface, a first indication of a first location within the real-world environment, overlaying the virtual asset at the first location on the visual content;
in response to receiving, via a third interaction with the interface, a second indication of a second location within the real-world environment to be associated with an event, adding an event proxy graphic corresponding to the event at the second location on the visual content; and
in response to receiving interactions with the virtual asset and the event proxy graphic defining a mapping between the event and the virtual asset, setting the mapping between the event and the virtual asset, wherein the mapping configures the virtual asset to trigger an effect in response to detection of the event.
17. The method of claim 16 , wherein the effect is at least one of a visual response or an audible response in the AR environment.
18. The method of claim 16 , wherein
at least one of the first interaction or the second interaction is received via a first-person view or a third-person rendered via the interface.
19. The method of claim 18 , further comprising specifying, by the system, the AR content to be placed on both of a pair of mobile devices.
20. The method of claim 16 , wherein the event is at least one of a person being at a specified location within the real-world environment, the person being within a specified distance from the first location of the virtual asset, a specified gesture performed by the person, or a specified orientation of the person.