Multi-factor intention determination for augmented reality (AR) environment control
Examples of augmented reality (AR) environment control advantageously employ multi-factor intention determination and include: performing a multi-factor intention determination for summoning a control object (e.g., a menu, a keyboard, or an input panel) using a set of indications in an AR environment, the set of indications comprising a plurality of indications (e.g., two or more of a palm-facing gesture, an eye gaze, a head gaze, and a finger position simultaneously); and based on at least the set of indications indicating a summoning request by a user, displaying the control object in a position proximate to the user in the AR environment (e.g., docked to a hand of the user). Some examples continue displaying the control object while at least one indication remains, and continue displaying the control object during a timer period if one of the indications is lost.
1 . A system comprising:
a processor; and
a computer-readable medium storing instructions that are operative upon execution by the processor to:
perform a multi-factor intention determination for summoning a first control object using a first set of indications in an augmented reality (AR) environment, the first set of indications comprising a plurality of indications;
based on the first set of indications indicating a summoning request by a user, display the first control object in a first position proximate to the user in the AR environment;
detect activation of a persistence object within the AR environment;
display the persistence object based on detecting the activation of the persistence object;
dock the first control object to the persistence object;
detect an indication of dismissal of the persistence object;
based on detecting the indication of dismissal, cease displaying the persistence object;
detect a loss of the first set of indications;
detect an indication of an intention to use the first control object; and
based on detecting the indication of the intention, continue displaying the first control object.
2 . The system of claim 1 , wherein the instructions are further operative to:
provide a visual indication of detecting an indication of the first set of indications.
3 . The system of claim 2 , wherein providing the visual indication comprises displaying a highlighting effect of a hand.
4 . The system of claim 1 , wherein the indication for the intention to use the first control object is selected from a list consisting of: a hand within a proximity threshold of the first control object, a finger pointing toward the first control object, an eye gaze towards the first control object and a palm-facing gesture with a different hand than a hand associated with the first set of indications.
5 . The system of claim 1 , wherein the instructions are further operative to:
continue displaying the first control object in a docked position while the persistence object remains within the AR environment.
6 . The system of claim 1 , wherein the instructions are further operative to:
based on detecting the indication of dismissal, cease displaying the first control object.
7 . A computerized method comprising:
performing a multi-factor intention determination for summoning a first control object using a first set of indications in an augmented reality (AR) environment, the first set of indications comprising a plurality of indications;
based on at least the first set of indications indicating a summoning request by a user, displaying the first control object in a first position proximate to the user in the AR environment;
detecting activation of a persistence object within the AR environment;
displaying the persistence object based on detecting the activation of the persistence object;
docking the first control object to the persistence object;
detecting an indication of dismissal of the persistence object;
based on detecting the indication of dismissal, ceasing displaying the persistence object;
detecting a loss of the first set of indications;
detecting an indication of an intention to use the first control object; and
based on detecting the indication of the intention, continue displaying the first control object.
8 . The method of claim 7 , further comprising:
providing a visual indication of detecting an indication of the first set of indications.
9 . The method of claim 8 , wherein providing the visual indication comprises displaying a highlighting effect of a hand.
10 . The method of claim 7 , wherein the indication for the intention to use the first control object is selected from a list consisting of: a hand within a proximity threshold of the first control object, a finger pointing toward the first control object, an eye gaze towards the first control object, and a palm-facing gesture with a different hand than a hand associated with the first set of indications.
11 . The method of claim 7 , further comprising:
continuing displaying the first control object in a docked position while the persistence object remains within the AR environment.
12 . The method of claim 7 , further comprising:
based on detecting the indication of dismissal, ceasing displaying the first control object.
13 . One or more non-transitory computer storage devices having computer-executable instructions stored thereon, which, upon execution by a computer, cause the computer to perform operations comprising:
performing a multi-factor intention determination for summoning a first control object using a first set of indications in an augmented reality (AR) environment, the first set of indications comprising a plurality of indications;
based on at least the first set of indications indicating a summoning request by a user, displaying the first control object in a first position proximate to the user in the AR environment;
detecting activation of a persistence object within the AR environment;
displaying the persistence object based on detecting the activation of the persistence object;
docking the first control object to the persistence object;
detecting an indication of dismissal of the persistence object;
based on detecting the indication of dismissal, ceasing displaying the persistence object;
detecting a loss of the first set of indications;
detecting an indication of an intention to use the first control object; and
based on detecting the indication of the intention, continue displaying the first control object.
14 . The one or more non-transitory computer storage devices of claim 13 , wherein the operations further comprise:
providing a visual indication of detecting an indication of the first set of indications, wherein providing the visual indication comprises displaying a highlighting effect of a hand.
15 . The one or more non-transitory computer storage devices of claim 13 , wherein the indication for the intention to use the first control object is selected from a list consisting of: a hand within a proximity threshold of the first control object, a finger pointing toward the first control object, an eye gaze towards the first control object, and a palm-facing gesture with a different hand than a hand associated with the first set of indications.
16 . The one or more non-transitory computer storage devices of claim 13 , wherein the operations further comprise:
continuing displaying the first control object in a docked position while the persistence object remains within the AR environment.
17 . The one or more non-transitory computer storage devices of claim 13 , wherein the operations further comprise:
based on detecting the indication of dismissal, ceasing displaying the first control object.