One-handed gesture sequences in virtual, augmented, and mixed reality (xR) applications
Systems and methods for enabling one-handed gesture sequences in virtual, augmented, and mixed reality (xR) applications are described. In an illustrative, non-limiting embodiment, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: receive a gesture sequence from a user wearing a Head-Mounted Device (HMD) coupled to the IHS, where the HMD is configured to display an xR application; identify the gesture sequence as a one-handed sequence; and execute a command in response to the one-handed sequence.
1. An Information Handling System (IHS), comprising:
a processor; and
a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to:
receive a gesture sequence from a user wearing a Head-Mounted Device (HMD) coupled to the IHS, wherein the HMD is configured to: (a) display a virtual, augmented, or mixed reality (xR) application, and (b) provide a plurality of video frames captured using a camera mounted on the HMD;
identify the gesture sequence as a one-handed sequence by performing a gesture recognition process upon: a first set of video frames corresponding to a start phase, a second set of video frames corresponding to a motion phase, and a third set of video frames corresponding to an end phase; and
execute a command in response to the one-handed sequence, wherein the one-handed gesture sequence is selected from a set comprising at least one of:
(a) a select gesture sequence comprising a hand with palm out hovering over an object to be selected with fingers spread apart over the object, index finger movement over a given portion of the object, and an annotation gesture, wherein to execute the command, the IHS adds a visual effect to at least a portion of the object, adds the visual effect to the given portion of the object to the exclusion of a remainder portion of the object, and associates an annotation with the given portion of the object;
(b) a menu open gesture sequence comprising a hand held up with palm facing in and fingers together, wherein to execute the command, the IHS displays a menu over the hand;
(c) a menu close gesture sequence comprising a hand held up with a palm facing in behind a menu until the menu is selected, followed by fingers closing, wherein to execute the command, the IHS closes the menu;
(d) a lock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers in extended position, and the index and middle fingers crossed, wherein to execute the command, the IHS locks access to the object;
(e) an unlock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers crossed, followed by the index and middle fingers in extended position, wherein to execute the command, the IHS unlocks access to the object; or
(f) a collaborator list gesture sequence comprising a hand moving four extended fingers, wherein to execute the command, the IHS displays a list of collaborators in the xR application.
2. The IHS of claim 1 , wherein the set further comprises a deselect gesture sequence comprising (i) a hand with palm out hovering over an object with fingers spread apart followed by (ii) fingers being closed together over the object; and wherein to execute the command, the IHS removes a visual effect from the object.
3. The IHS of claim 1 , wherein the menu open gesture sequence further comprises at least one of: (i) the hand moving away while a visual effect is displayed around the menu, wherein the command further comprises closing the menu; or (ii) the hand moving away after the visual effect disappears, wherein to execute the command, the IHS maintains the menu on display.
4. The IHS of claim 1 , wherein the set further comprises a menu repositioning gesture sequence comprising (i) a hand held up with a palm facing in behind a menu until the menu is selected, followed by (ii) the hand moving to another position with the palm facing in; and wherein to execute the command, the IHS moves the menu to the other position.
5. The IHS of claim 1 , wherein the set further comprises a workspace minimization gesture sequence comprising (i) a hand horizontally leveled with palm facing down at a top or bottom portion of a display, followed by (ii) the hand moving horizontally leveled with palm facing down to an opposite portion of the display across a workspace; and wherein to execute the command, the IHS minimizes the workspace and displays a placeholder.
6. The IHS of claim 1 , wherein the set further comprises a workspace maximization gesture sequence comprising (i) a hand horizontally leveled with palm facing down at a top or bottom portion of a display having a placeholder, followed by (ii) the hand moving horizontally leveled with palm facing down to an opposite portion of the display; and wherein to execute the command, the IHS maximizes the workspace and removes the placeholder.
7. The IHS of claim 1 , wherein to receive the gesture sequence, the program instructions, upon execution, further cause the IHS to receive an audio signal captured using a microphone mounted on the HMD.
8. The IHS of claim 7 , wherein the set further comprises an audio mute or unmute gesture sequence comprising at least one hand covering or uncovering at least one ear, and wherein executing the command further comprises muting or unmuting only one audio channel.
9. A method, comprising:
receiving a gesture sequence from a user wearing a Head-Mounted Device (HMD) coupled to the IHS, wherein the HMD is configured to display a virtual, augmented, or mixed reality (xR) application;
identifying the gesture sequence as a one-handed sequence; and
executing a command in response to the one-handed sequence, wherein the one-handed gesture sequence is selected from a set comprising at least one of:
(a) a select gesture sequence comprising a hand with palm out hovering over an object to be selected with fingers spread apart over the object, index finger movement over a given portion of the object, and an annotation gesture, wherein executing the command further comprises adding a visual effect to at least a portion of the object, adding the visual effect to the given portion of the object to the exclusion of a remainder portion of the object, and associating an annotation with the given portion of the object;
(b) a menu open gesture sequence comprising a hand held up with palm facing in and fingers together, wherein executing the command further comprises displaying a menu over the hand;
(c) a menu close gesture sequence comprising a hand held up with a palm facing in behind a menu until the menu is selected, followed by fingers closing, wherein executing the command further comprises closing the menu;
(d) a lock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers in extended position, and the index and middle fingers crossed, wherein executing the command further comprises locking access to the object;
(e) an unlock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers crossed, followed by the index and middle fingers in extended position, wherein executing the command further comprises unlocking access to the object; or
(f) a collaborator list gesture sequence comprising a hand moving four extended fingers, wherein to execute the command, wherein executing the command further comprises displaying a list of collaborators in the xR application.
10. A hardware memory device of an Information Handling System (IHS) having program instructions stored thereon that, upon execution by a hardware processor, cause the IHS to:
receive a gesture sequence from a user wearing a Head-Mounted Device (HMD) coupled to the IHS, wherein the HMD is configured to display a virtual, augmented, or mixed reality (xR) application;
identify the gesture sequence as a one-handed sequence; and
execute a command in response to the one-handed sequence, wherein the one-handed gesture sequence is selected from a set comprising at least one of:
(a) a select gesture sequence comprising a hand with palm out hovering over an object to be selected with fingers spread apart over the object, index finger movement over a given portion of the object, and an annotation gesture, wherein to execute the command, the IHS adds a visual effect to at least a portion of the object, adds the visual effect to the given portion of the object to the exclusion of a remainder portion of the object, and associates an annotation with the given portion of the object;
(b) a menu open gesture sequence comprising a hand held up with palm facing in and fingers together, wherein to execute the command, the IHS displays a menu over the hand;
(c) a menu close gesture sequence comprising a hand held up with a palm facing in behind a menu until the menu is selected, followed by fingers closing, wherein to execute the command, the IHS closes the menu;
(d) a lock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers in extended position, and the index and middle fingers crossed, wherein to execute the command, the IHS locks access to the object;
(e) an unlock gesture sequence comprising a hand hovering over an object to be locked with index and middle fingers crossed, followed by the index and middle fingers in extended position, wherein to execute the command, the IHS unlocks access to the object; or
(f) a collaborator list gesture sequence comprising a hand moving four extended fingers, wherein to execute the command, the IHS displays a list of collaborators in the xR application.