Changing view order of augmented reality objects based on user gaze
View Patent ↗Disclosed embodiments provide techniques for adjusting the Z-index of an augmented reality (AR) object. When an AR object covers a first object, the user gazes at the first object for a predetermined amount of time, and then the AR object Z-index is adjusted with respect to the Z-index of the first object, such that the AR object is now rendered behind the first object, such that the user can continue to view the first object. The first object can be a physical object, a virtual object, or another augmented reality object. This allows the user to conveniently continue viewing the first object. Embodiments provide techniques for reverting the Z-index of the AR object at a later time when the user is ready to respond to the AR object. In this way, the user experience for augmented reality systems is enhanced.
1. A computer-implemented method for controlling a Z-index of an augmented reality object in an augmented reality system, the method comprising:
detecting a first object as currently focused on by a user;
detecting presence of an overlapping augmented reality object that obstructs a view of the first object;
determining that the user is maintaining gaze on the first object for at least a predetermined threshold period of time;
rendering a confirmation message; wherein the confirmation message comprises a first area and a second area, wherein the first area comprises an indication that adjustment is desired, and wherein the second area comprises an indication that adjustment is not desired; detecting the user gaze on a first area of the confirmation message, and
responsive to the determination and the detection of the user gaze on the first area of the confirmation message, adjusting the Z-index for the augmented reality object, wherein the adjusting includes altering an opacity parameter of the augmented reality object for partial transparency.
2. The method of claim 1 , further comprising, responsive to the user maintaining gaze on the augmented reality object for at least a predetermined period of time, reverting the Z-index for the augmented reality object.
3. The method of claim 1 , further comprising, responsive to detecting an eye gesture, reverting the Z-index for the augmented reality object.
4. The method of claim 3 , wherein detecting an eye gesture comprises detecting one of a blink pattern, a wink pattern, and an eye gaze pattern.
5. The method of claim 4 , wherein detecting a blink pattern comprises detecting a predetermined first time period of closed eyes, followed by a predetermined second time period of opened eyes.
6. The method of claim 4 , wherein detecting a blink pattern comprises detecting a predetermined first time period of a first eye closed and a second eye opened, followed by a predetermined second time period of the first eye opened and the second eye opened.
7. The method of claim 4 , wherein detecting an eye gaze pattern comprises detecting eyes focused in a first direction for a predetermined first time period, followed by detecting the eyes focused in a second direction for a predetermined second time period.
8. The method of claim 1 , wherein the overlapping augmented reality object only obstructs a partial view of the first object and adjusting the Z-index for only the obstructing portion of the augmented reality object.
9. The method of claim 1 , further comprising moving a position of the overlapping augmented reality object to a non-overlapping location with respect to the first object.
10. The method of claim 1 , wherein the first object is a physical object.
11. The method of claim 1 , wherein the first object is a virtual reality object.
12. The method of claim 1 , further comprising rendering a confirmation message prior to setting the new Z-index for the augmented reality object.
13. An electronic communication device comprising: a forward-facing digital camera;
a user-facing digital
camera; a processor;
a memory coupled to the processor, the memory containing instructions, that when executed by the processor, perform the steps of:
detecting a first object as currently focused on by a user;
detecting presence of an overlapping augmented reality object that obstructs a view of the first object;
determining that the user is maintaining gaze on the first object for at least a predetermined threshold period of time;
rendering a confirmation message; wherein the confirmation message comprises a first area and a second area, wherein the first area comprises an indication that adjustment is desired, and wherein the second area comprises an indication that adjustment is not desired; detecting the user gaze on a first area of the confirmation message, and
responsive to the determination and the detection of the user gaze on the first area of the confirmation message, adjusting the Z-index for the augmented reality object, wherein the adjusting includes altering an opacity parameter of the augmented reality object for partial transparency.
14. The device of claim 13 , wherein the memory further comprises instructions, that when executed by the processor, perform the step of, responsive to the user maintaining gaze on the augmented reality object for at least a predetermined period of time, reverting the Z-index for the augmented reality object.
15. The device of claim 13 , wherein the memory further comprises instructions, that when executed by the processor, perform the step of, responsive to detecting an eye gesture, reverting the Z-index for the augmented reality object.
16. The device of claim 13 , further comprising an eyewear apparatus comprising: a first lens configured and disposed to be worn in front of a first eye of a user; a second lens configured and disposed to be worn in front of a second eye of a user; a first projection mechanism configured and disposed to display the augmented reality object on the first lens; and a second projection mechanism configured and disposed to display the augmented reality object on the second lens.
17. A computer program product for controlling a Z-index of an augmented reality object in an augmented reality system, for an electronic computing device comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the electronic computing device to:
detect a first object as currently focused on by a user;
detect presence of an overlapping augmented reality object that obstructs a view of the first object;
determining that the user is maintaining gaze on the first object for at least a predetermined threshold period of time;
rendering a confirmation message; wherein the confirmation message comprises a first area and a second area, wherein the first area comprises an indication that adjustment is desired, and wherein the second area comprises an indication that adjustment is not desired; detecting the user gaze on a first area of the confirmation message, and responsive to the determination and the detection of the user gaze on the first area of the confirmation message, adjust the Z-index for the augmented reality object, wherein the adjusting includes altering an opacity parameter of the augmented reality object for partial transparency.
18. The computer program product of claim 17 , further comprising program instructions executable by a processor to cause the electronic computing device to, responsive to the user maintaining gaze on the augmented reality object for at least a predetermined period of time, revert the Z-index for the augmented reality object.
19. The computer program product of claim 17 , further comprising program instructions executable by a processor to cause the electronic computing device to, responsive to detecting an eye gesture, revert the Z-index for the augmented reality object.