Controlling Augmented Reality Content Via Selection of Real-World Locations or Objects
A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real-world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.
1 . A method for defining a route for a virtual object to travel along in an augmented reality (AR) application, the method comprising:
receiving position data indicating a position and orientation of a controller, the position data defining an axis of the controller;
performing ray casting to determine a location or object in a 3D map of a real-world that intersects the axis;
receiving a selection indication;
selecting, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint;
defining the route for the virtual object to travel along based on the waypoint; and
providing, to a client device, AR data including the virtual object traversing along the route.
2 . The method of claim 1 , further comprising identifying one or more real-world objects in the 3D map, wherein defining the route is further based on the identified one or more real-world objects.
3 . The method of claim 2 , further comprising determining, for an identified real-world object, whether the virtual object will step over, jump over, climb over, or crawl under the identified real-world object while traversing the route.
4 . The method of claim 2 , further comprising determining at least one of a shape, surface, material, or texture of an identified real-world object, wherein defining the route is further based on the determined shape, surface, material, or texture of the identified real-world object.
5 . The method of claim 4 , wherein at least one of:
wherein the identified real-world object is a body of water and the route is defined to avoid the body of water;
wherein defining the route comprises defining the route up a wall made of stone or brick while avoiding glass windows; or
wherein defining the route comprises defining the route to avoid snow while permitting traversal on dirt or asphalt.
6 . The method of claim 1 , further comprising receiving one or more traversal characteristics of the virtual object that will traverse the route, wherein defining the route is further based on the one or more traversal characteristics of the virtual object.
7 . The method of claim 6 , wherein at least one of:
wherein the one or more traversal characteristics comprise a jump height of the virtual object, and defining the route based on the one or more traversal characteristics comprises defining the route so that the virtual object jumps over at least one real-world object, or
wherein the one or more traversal characteristics comprise an ability for the virtual object to climb, and defining the route based on the one or more traversal characteristics comprises defining the route so that the virtual object climbs over or around at least one real-world object.
8 . The method of claim 6 , wherein at least one of:
wherein the one or more traversal characteristics comprise movement speeds of the virtual object for different ground materials, and defining the route based on the one or more traversal characteristics comprises defining the route to avoid ground materials associated with slower movement speeds for the virtual object; or
wherein the one or more traversal characteristics comprise an ability for the virtual object to fly or glide, and defining the route based on the one or more traversal characteristics comprises defining an aerial portion of the route.
9 . The method of claim 1 , further comprising selecting multiple waypoints responsive to multiple selection indications at different locations in the 3D map, and defining the route to intersect each of the multiple waypoints.
10 . The method of claim 1 , wherein defining the route comprises defining the route to avoid the waypoint.
11 . The method of claim 1 , wherein at least one of:
further comprising selecting two waypoints at different locations in the 3D map, and determining a movement direction for the virtual object based on the two waypoints; or
further comprising selecting two waypoints at different locations in the 3D map, wherein a movement speed of the virtual object along the route is based on a distance between the two waypoints.
12 . A non-transitory computer-readable medium storing instructions that, when executed by a computing system, cause the computing system to perform operations comprising:
receiving position data indicating a position and orientation of a controller, the position data defining an axis of the controller;
performing ray casting to determine a location in a 3D map of a real-world that intersects the axis;
receiving a selection indication;
selecting, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint;
defining a route for a virtual object to travel along based on the waypoint; and
providing, to a client device, AR data including the virtual object traversing along the route.
13 . The non-transitory computer-readable medium of claim 12 , wherein the operations further comprise identifying one or more real-world objects in the 3D map, wherein defining the route is further based on the identified one or more real-world objects.
14 . The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise determining, for an identified real-world object, whether the virtual object will step over, jump over, climb over, or crawl under the identified real-world object while traversing the route.
15 . The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise determining at least one of a shape, surface, material, or texture of an identified real-world object, wherein defining the route is further based on the determined shape, surface, material, or texture of the identified real-world object.
16 . The non-transitory computer-readable medium of claim 15 , wherein at least one of:
wherein the identified real-world object is a body of water and the route is defined to avoid the body of water;
wherein defining the route comprises defining the route up a wall made of stone or brick while avoiding glass windows; or
wherein defining the route comprises defining the route to avoid snow while permitting traversal on dirt or asphalt.
17 . The non-transitory computer-readable medium of claim 12 , wherein the operations further comprise receiving one or more traversal characteristics of the virtual object that will traverse the route, wherein defining the route is further based on the one or more traversal characteristics of the virtual object.
18 . The non-transitory computer-readable medium of claim 17 , wherein at least one of:
wherein the one or more traversal characteristics comprise a jump height of the virtual object, and defining the route based on the one or more traversal characteristics comprises defining the route so that the virtual object jumps over at least one real-world object; or
wherein the one or more traversal characteristics comprise an ability for the virtual object to climb, and defining the route based on the one or more traversal characteristics comprises defining the route so that the virtual object climbs over or around at least one real-world object.
19 . The non-transitory computer-readable medium of claim 17 , wherein at least one of:
wherein the one or more traversal characteristics comprise movement speeds of the virtual object for different ground materials, and defining the route based on the one or more traversal characteristics comprises defining the route to avoid ground materials associated with slower movement speeds for the virtual object; or
wherein the one or more traversal characteristics comprise an ability for the virtual object to fly or glide, and defining the route based on the one or more traversal characteristics comprises defining an aerial portion of the route.
20 . The non-transitory computer-readable medium of claim 12 , wherein the operations further comprise selecting multiple waypoints responsive to multiple selection indications at different locations in the 3D map, and defining the route to intersect each of the multiple waypoints.