GESTURE-BASED CASTING AND MANIPULATION OF VIRTUAL CONTENT IN ARTIFICIAL-REALITY ENVIRONMENTS
Embodiments are directed to a near eye display (NED) system for displaying artificial reality content to a user and to manipulate displayed content items based upon gestures performed by users of the NED system. A user of the NED system may perform a gesture simulating the throwing of an object to “cast” a content item to a target location in an artificial reality (AR) environment displayed by the NED system. The gesture may comprise a first portion in which the user's hand “grabs” or “pinches” a virtual object corresponding to the content item and moves backwards relative to their body, and a second portion in which the user's hand moves forwards relative to their body and releases the virtual object. The target location may be identified based upon a trajectory associated with the backwards motion of the first portion of the gesture.
1 . A system comprising:
a near eye display (NED) comprising:
an optical assembly having an electronic display that is configured to display images in accordance with display instructions;
an imaging device configured to capture one or more images of a portions of a local area of the NED; and
a controller configured to:
determine that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images;
responsive to the slice gesture,
display a first virtual menu at a position along a trajectory of the slice gesture, using the electronic display of the NED.
2 . The system of claim 1 , wherein the trajectory is a linear path that extends in a particular direction.
3 . The system of claim 2 , wherein the particular direction is a downward direction relative to a body of the user.
4 . The system of claim 2 , wherein the linear path spans a distance of at least nine inches and the first hand moved through the linear path in at most a half a second.
5 . The system of claim 1 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture.
6 . The system of claim 5 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together.
7 . The system of claim 6 , wherein the at least two fingers are an index and middle finger.
8 . The system of claim 1 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture.
9 . A method comprising:
capturing, via an imaging device, one or more images of a portions of a local area of a near eye display (NED);
determining that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images; and
responsive to the slice gesture, displaying using the electronic display of the NED a first virtual menu at a position along a trajectory of the slice gesture.
10 . The method of claim 9 , wherein the trajectory is a linear path that extends in a particular direction.
11 . The method of claim 10 , wherein the particular direction is a downward direction relative to a body of the user.
12 . The method of claim 10 , wherein the linear path spans a distance of at least nine inches and the first hand moved through the linear path in at most a half a second.
13 . The method of claim 9 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture.
14 . The method of claim 13 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together.
15 . The method of claim 14 , wherein the at least two fingers are an index and middle finger.
16 . The method of claim 9 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture.
17 . A non-transitory computer readable medium storing instructions that, when executed by a processor of a near-eye display (NED), cause the NED to perform steps comprising:
capturing, via an imaging device, one or more images of a portions of a local area of the NED;
determining that a first hand of a user of the NED located within the local area is performing a slice gesture, using the captured one or more images; and
responsive to the slice gesture, displaying using the electronic display of the NED a first virtual menu at a position along a trajectory of the slice gesture.
18 . The computer readable medium of claim 17 , wherein the slice gestured corresponds to one or more fingers of the first hand remaining in a particular position as the first hand moves through the trajectory of the slice gesture.
19 . The computer readable medium of claim 18 , wherein the particular position corresponds to at least two fingers of the first hand being extended and held together.
20 . The computer readable medium of claim 17 , wherein a centerline of the first virtual menu coincides with the trajectory of the slice gesture.