VIRTUAL OBJECT MANIPULATION WITH GESTURES IN A MESSAGING SYSTEM
The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.
1 . A method, comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.
2 . The method of claim 1 , wherein the first updated hand gesture data includes data for both hands of a user such that multi-gesture movements involving both hands are recognized, and wherein expanding the virtual object comprises detecting closure of thumbs on both hands simultaneously.
3 . The method of claim 1 , wherein rotating the virtual object includes:
determining a direction of rotation based on relative positions of the changed hand positions;
rotating the virtual object in a first direction when a first hand position is higher than a second hand position; and
rotating the virtual object in a second direction opposite to the first direction when the first hand position is lower than the second hand position.
4 . The method of claim 1 , wherein performing additional size modification comprises:
detecting third updated hand gesture data indicating a reduction gesture; and
reducing the virtual object in overall size in response to the third updated hand gesture data.
5 . The method of claim 1 , wherein the virtual object is utilized by an application for performing a set of operations based at least in part on location, position, and size of the virtual object after each modification.
6 . The method of claim 1 , wherein an open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and a closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.
7 . The method of claim 1 , wherein the method comprises a sequential workflow including:
a first phase comprising selecting and expanding the virtual object;
a second phase comprising rotating the expanded virtual object; and
a third phase comprising modifying size dimensions of the rotated virtual object.
8 . The method of claim 1 , further comprising:
rendering the virtual object after each modification operation; and
providing the rendered virtual object for display within a scene comprising real world video frame data and virtual object data.
9 . The method of claim 1 , wherein detecting closure of thumbs on each hand closer to index fingers comprises detecting a pinch gesture on each hand simultaneously.
10 . The method of claim 1 , further comprising:
continuously detecting changes in hand location video frame data and hand position video frame data; and
generating updated hand gesture data in response to each detected change to enable real-time virtual object manipulation.
11 . A system comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.
12 . The system of claim 11 , wherein the first updated hand gesture data includes data for both hands of a user such that multi-gesture movements involving both hands are recognized, and wherein expanding the virtual object comprises detecting closure of thumbs on both hands simultaneously.
13 . The system of claim 11 , wherein rotating the virtual object includes:
determining a direction of rotation based on relative positions of the changed hand positions;
rotating the virtual object in a first direction when a first hand position is higher than a second hand position; and
rotating the virtual object in a second direction opposite to the first direction when the first hand position is lower than the second hand position.
14 . The system of claim 11 , wherein performing additional size modification comprises:
detecting third updated hand gesture data indicating a reduction gesture; and
reducing the virtual object in overall size in response to the third updated hand gesture data.
15 . The system of claim 11 , wherein the virtual object is utilized by an application for performing a set of operations based at least in part on location, position, and size of the virtual object after each modification.
16 . The system of claim 11 , wherein an open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and a closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.
17 . The system of claim 11 , wherein the operations further comprise a sequential workflow including:
a first phase comprising selecting and expanding the virtual object;
a second phase comprising rotating the expanded virtual object; and
a third phase comprising modifying size dimensions of the rotated virtual object.
18 . The system of claim 11 , wherein the operations further comprise:
rendering the virtual object after each modification operation; and
providing the rendered virtual object for display within a scene comprising real world video frame data and virtual object data.
19 . The system of claim 11 , wherein detecting closure of thumbs on each hand closer to index fingers comprises detecting a pinch gesture on each hand simultaneously.
20 . A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
selecting a virtual object for manipulation based on hand gesture data;
expanding the virtual object to a larger size in response to first updated hand gesture data indicating closure of thumbs on each hand closer to index fingers;
rotating the virtual object in a particular direction in response to second updated hand gesture data indicating changed hand positions; and
performing additional size modification of the virtual object in response to third updated hand gesture data.