Virtual object manipulation with gestures in a messaging system
The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.
1 . A method, comprising:
detecting, using one or more hardware processors, from a set of frames, a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture;
detecting, using the one or more hardware processors, from a second set of frames, a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture;
in response to the third gesture and the fourth gesture, selecting a first virtual object in a first scene, wherein the first scene comprises a first representation of a real world scene, and the first virtual object;
detecting, using the one or more hardware processors, a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture;
detecting, using the one or more hardware processors, a first change in the first location and the first position and a second change in the second location and the second position; and
in response to the first change and the second change, modifying, using the one or more hardware processors, a set of dimensions of the first virtual object to a different set of dimensions, wherein the first scene comprises real world video frame data and virtual object data, the virtual object data comprising information utilized for rendering the first virtual object.
2 . The method of claim 1 , further comprising:
detecting a first subsequent change in the first location and the first position and a second subsequent change in the second location and the second position; and
in response to the first subsequent change and the second subsequent change, rotating the first virtual object in a direction of rotation around an axis of rotation.
3 . The method of claim 2 , further comprising:
rendering the first virtual object based at least in part on the rotating within the first scene; and
providing for display the rendered first virtual object within the first scene.
4 . The method of claim 2 , wherein the direction of rotation is based on determining the first subsequent change in the first location and the first position relative to the second subsequent change in the second location and the second position,
wherein the direction of rotation is a first direction based on the first location and the first position being higher than the second location and the second position, and
wherein the direction of rotation is a second direction based on the first location and the first position being lower than the second location and the second position.
5 . The method of claim 4 , wherein the first direction is counter clockwise and the second direction is clockwise, or the first direction is clockwise and the second direction is counter clockwise.
6 . The method of claim 1 , wherein the open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and the closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.
7 . The method of claim 1 , wherein the first change and the second change result in an increase of distances between the first location and the first position of the first representation of the first finger and the second location and the second position of the second representation of the second finger, and modifying the set of dimensions of the first virtual object comprises enlarging the set of dimensions in at least one dimension.
8 . The method of claim 1 , wherein the first change and the second change result in a reduction of distances between the first location and the first position of the first representation of the first finger and the second location and the second position of the second representation of the second finger, and modifying the set of dimensions of the first virtual object comprises reducing the set of dimensions in at least one dimension.
9 . A system comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:
detecting, using one or more hardware processors, from a set of frames, a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture;
detecting, using the one or more hardware processors, from a second set of frames, a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture;
in response to the third gesture and the fourth gesture, selecting a first virtual object in a first scene, wherein the first scene comprises a first representation of a real world scene, and the first virtual object;
detecting, using the one or more hardware processors, a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture;
detecting, using the one or more hardware processors, a first change in the first location and the first position and a second change in the second location and the second position; and
in response to the first change and the second change, modifying, using the one or more hardware processors, a set of dimensions of the first virtual object to a different set of dimensions, wherein the first scene comprises real world video frame data and virtual object data, the virtual object data comprising information utilized for rendering the first virtual object.
10 . The system of claim 9 , wherein the operations further comprise:
detecting a first subsequent change in the first location and the first position and a second subsequent change in the second location and the second position; and
in response to the first subsequent change and the second subsequent change, rotating the first virtual object in a direction of rotation around an axis of rotation.
11 . The system of claim 10 , wherein the operations further comprise:
rendering the first virtual object based at least in part on the rotating within the first scene; and
providing for display the rendered first virtual object within the first scene.
12 . The system of claim 10 , wherein the direction of rotation is based on determining the first subsequent change in the first location and the first position relative to the second subsequent change in the second location and the second position,
wherein the direction of rotation is a first direction based on the first location and the first position being higher than the second location and the second position, and
wherein the direction of rotation is a second direction based on the first location and the first position being lower than the second location and the second position.
13 . The system of claim 12 , wherein the first direction is counter clockwise and the second direction is clockwise, or the first direction is clockwise and the second direction is counter clockwise.
14 . The system of claim 9 , wherein the open trigger finger gesture includes a particular gesture including a thumb and an index finger indicating a firearm or shooting hand sign, and the closed trigger finger gesture includes the thumb and the index finger pointing in a same direction.
15 . The system of claim 9 , wherein the first change and the second change result in an increase of distances between the first location and the first position of the first representation of the first finger and the second location and the second position of the second representation of the second finger, and modifying the set of dimensions of the first virtual object comprises enlarging the set of dimensions in at least one dimension.
16 . The system of claim 9 , wherein the first change and the second change result in a reduction of distances between the first location and the first position of the first representation of the first finger and the second location and the second position of the second representation of the second finger, and modifying the set of dimensions of the first virtual object comprises reducing the set of dimensions in at least one dimension.
17 . A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
detecting, using one or more hardware processors, from a set of frames, a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture;
detecting, using the one or more hardware processors, from a second set of frames, a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture;
in response to the third gesture and the fourth gesture, selecting a first virtual object in a first scene, wherein the first scene comprises a first representation of a real world scene, and the first virtual object;
detecting, using the one or more hardware processors, a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture;
detecting, using the one or more hardware processors, a first change in the first location and the first position and a second change in the second location and the second position; and
in response to the first change and the second change, modifying, using the one or more hardware processors, a set of dimensions of the first virtual object to a different set of dimensions, wherein the first scene comprises real world video frame data and virtual object data, the virtual object data comprising information utilized for rendering the first virtual object.