User control in augmented reality
An apparatus, method and computer-program is described relating to user control in augmented reality (AR). For example, the method may comprise determining, based on motion of a user, one or more future step locations along a path. The method may also comprise displaying, via an augmented reality display device associated with the user, one or more interactive items. Each of the one or more interactive items may be associated with a respective one of the future step locations and is displayed so as to be perceived at a respective display position which is at or near said associated respective future step location. The method may also comprise detecting a control input associated with a particular interactive item, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.
1. An apparatus comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
predict, based on monitoring of one or more motion characteristics of a user occurring in a predetermined time period prior to a current time, one or more future step locations along a path;
display, via an augmented reality display device associated with the user, one or more interactive items, from which one or more interactive items are associated with a respective one of the future step locations and displayed so as to be perceivable at a respective display position which is at or near said associated respective future step location; and
detect a control input associated with a particular interactive item of the one or more interactive items associated with the respective one of the future step locations, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.
2. The apparatus of claim 1 , further caused to display, via the augmented reality display device, a first user notification, and at least a first interactive item providing a first control option relating to the first user notification, the first control option being associated with a first future step location along the path.
3. The apparatus of claim 2 , further caused to display, via the augmented reality display device, a second interactive item providing a second control option relating to the first user notification, the second control option providing an alternative to the first control option, the second control option being associated with the first future step location, or a second future step location after the first future step location along the path.
4. The apparatus of claim 3 , wherein the second control option is associated with a second future step location after the first future step location, the first and second future step locations being separated by a third step location.
5. The apparatus of claim 4 , further caused to display, via the augmented reality display device, a second, different user notification and wherein at least a control option relating to the second user notification is associated with the third step location.
6. The apparatus of claim 1 , further caused to estimate a future time when the user will reach the selection area of the particular interactive item, and wherein the detection of the control input is further caused to receive a user input at or near the estimated future time.
7. The apparatus of claim 1 , further caused to monitor a position of at least part of the user relative to the selection area of the particular interactive item, and wherein the detection of the control input is further caused to receive a user input when the position of said at least part of the user corresponds with the selection area.
8. The apparatus of claim 6 , wherein the user input is at least one of a gesture, voice command or hardware input.
9. The apparatus of claim 1 , wherein the selection area of the particular interactive item is separate, and lateral to, said associated future step location with respect to the path, and wherein the detection of the control input is further caused to determine that at least part of the user moves sideways from the path and into the selection area.
10. The apparatus of claim 1 , further caused to monitor an angle between a gaze direction of the user and the path, and to disable detection of the control input for at least the particular interactive item if the monitored angle is greater than a predetermined amount.
11. The apparatus of claim 1 , further caused to display a first group of interactive items at respective display positions, and a second group of interactive items, comprising the same plurality of interactive items, at later respective display positions, and wherein, responsive to a detection that the user has stepped over a selection area associated with a first interactive item of the first group of interactive items, the apparatus is further caused to remove the first interactive item from the second group of interactive items so that it is not displayed.
12. The apparatus of claim 1 , wherein the prediction of the one or more future step locations is further based on an environment or terrain in which the user is currently located.
13. A method, comprising:
predicting, based on monitoring of one or more motion characteristics of a user occurring in a predetermined time period prior to a current time, one or more future step locations along a path;
displaying, via an augmented reality display device associated with the user, one or more interactive items, from which one or more interactive items are associated with a respective one of the future step locations and being displayed so as to be perceivable at a respective display position which is at or near said associated respective future step location; and
detecting a control input associated with a particular interactive item of the one or more interactive items associated with the respective one of the future step locations, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.
14. The method of claim 13 , further comprising:
displaying, via the augmented reality display device, a first user notification, and at least a first interactive item providing a first control option relating to the first first user notification, the control option being associated with a first future step location along the path.
15. The method of claim 14 , further comprising:
displaying, via the augmented reality display device, a second interactive item providing a second control option relating to the first user notification, the second control option providing an alternative to the first control option, the second control option being associated with the first future step location, or a second future step location after the first future step location along the path.
16. The method of claim 15 , wherein the second control option is associated with a second future step location after the first future step location, the first and second future step locations being separated by a third step location.
17. The method of claim 16 , further comprising:
displaying, via the augmented reality display device, a second, different user notification and wherein at least a control option relating to the second user notification is associated with the third step location.
18. The method of claim 13 , further comprising:
estimating a future time when the user will reach the selection area of the particular interactive item, and wherein detecting the control input comprises receiving a user input at or near the estimated future time.
19. A non-transitory computer readable medium comprising program instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:
predicting, based on monitoring of one or more motion characteristics of a user occurring in a predetermined time period prior to a current time, one or more future step locations along a path;
displaying, via an augmented reality display device associated with the user, one or more interactive items, from which one or more interactive items are associated with a respective one of the future step locations and being displayed so as to be perceivable at a respective display position which is at or near said associated respective future step location; and
detecting a control input associated with a particular interactive item of the one or more interactive items associated with the respective one of the future step locations, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.