Granted Patent B2

US 12,487,463 · App. 18/953,917 · Granted Dec 2, 2025

Inventors: Marja Pauliina Salmimaa (Tampere, FI); Akos Vetek (Espoo, FI); Aleksi Ikkala (Espoo, FI); Tero Simo Ilari Jokela (Tampere, FI)

Assignee: Nokia Technologies Oy

G02B27/0172G02B27/0093G06F3/013

Abstract

Claims (56)

1 . An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:

track eye positions of a user during simultaneous display of first and second content to the user, wherein the first content comprises content displayed by a head-worn display device so that it is perceived by the user as located at a first distance from the user and the second content is displayed by a display screen of a further display device located at a second distance from the user;

modify, responsive to the difference between the first and second distance being below a predetermined threshold, the display of either, or both, of the first and second content such as to modify a spatial position at which they appear with respect to one another;

determine which of the displayed first and second content the user is looking at based at least on eye position movements, if any, tracked subsequent to the modifying;

cause change of the display of the other one of the first and second content which the user is not determined to be looking at such as to reduce its visibility relative to the content that the user is determined to be looking at.

2 . The apparatus of claim 1 , wherein the apparatus is further caused to:

estimate, based on eye positions of the user, a viewing distance of the user, and

wherein the modifying further comprises performing the modification in response to detecting that the viewing distance corresponds to the first distance or the second distance.

3 . The apparatus of claim 1 , wherein the modifying further comprises performing the modification in response to determining that the first and second content at least partially overlap one another with respect to the user's field-of-view.

4 . The apparatus of claim 1 , wherein

the modifying comprises modifying the distance at which the first content is perceived by the user from the first distance to a new distance from the user, which is away from the second distance, and

the determining which of the displayed first and second content the user is looking at comprises determining that the user is looking at the first content if eye position movements of the user correspond with a new viewing distance which moves towards, or matches, the new distance.

5 . The apparatus of claim 4 , wherein the distance at which the first content is perceived by the user is modified a plurality of times to each of a plurality of new distances in sequence.

6 . The apparatus of claim 5 , wherein at least some of the new distances are changed by a greater amount than that used for the preceding new distance of the sequence.

7 . The apparatus of claim 4 ,

wherein the distance at which the first content is perceived by the user is modified by modifying the disparity of first and second images representing the first content which are simultaneously and respectively displayed by first and second screens of the head-worn display device.

8 . The apparatus of claim 1 ,

wherein the modifying comprises at least modifying either, or both, of the first and second content such that one appears to move laterally with respect to the other.

9 . The apparatus of claim 8 ,

wherein the modifying comprises modifying the first content such that it appears to move laterally at a first speed and the second content such that it appears to move laterally at a second speed, wherein the first speed is greater than the second speed.

10 . The apparatus of claim 9 , wherein the apparatus is further caused to:

detect motion of the further display device with respect to the head-worn display device,

wherein the modifying comprises increasing/decreasing the second speed as the further display device gets closer to/further from the head-worn display device.

11 . The apparatus of claim 8 , wherein the apparatus is further caused to generate an initial estimate that a particular one of the first and second content is being looked at by the user,

wherein the modifying comprises modifying the other one of the first and second content which the user is not determined to be looking at so that it appears to move laterally whilst maintaining the particular content static.

12 . The apparatus of claim 1 , wherein causing change of the display of the other one of the first and second content which the user is not determined to be looking at comprises:

disabling display of the other content;

reducing luminance of the other content;

reducing color saturation of the other content;

increasing transparency of the other content;

changing angular resolution of the other content; and/or

changing spatial resolution of the other content.

13 . The apparatus of claim 1 ,

wherein in response to determining that the user is looking at the second content, causing change of the display of the other one of the first and second content which the user is not determined to be looking at comprises changing the distance at which the first content is perceived by the user such that it is behind the second content.

14 . A method, comprising:

tracking eye positions of a user during simultaneous display of first and second content to the user, wherein the first content comprises content displayed by a head-worn display device so that it is perceived by the user as located at a first distance from the user and the second content is displayed by a display screen of a further display device located at a second distance from the user;

modifying, responsive to the difference between the first and second distance being below a predetermined threshold, the display of either, or both, of the first and second content such as to modify a spatial position at which they appear with respect to one another;

determining which of the displayed first and second content the user is looking at based at least on eye position movements, if any, tracked subsequent to the modifying; and

causing change of the display of the other one of the first and second content which the user is not determined to be looking at such as to reduce its visibility relative to the content that the user is determined to be looking at.

15 . The method of claim 14 , further comprising:

estimating, based on eye positions of the user, a viewing distance of the user, and

wherein the modification is performed in response to detecting that the viewing distance corresponds to the first distance or the second distance.

16 . The method of claim 14 , wherein the modification is performed in response to determining that the first and second content at least partially overlap one another with respect to the user's field-of-view.

17 . The method of claim 14 , wherein

the modification modifies the distance at which the first content is perceived by the user from the first distance to a new distance from the user, which is away from the second distance, and

the user is determined to be looking at the first content if eye position movements of the user correspond with a new viewing distance which moves towards, or matches, the new distance.

18 . The method of claim 17 , wherein the distance at which the first content is perceived by the user is modified by modifying the disparity of first and second images representing the first content which are simultaneously and respectively displayed by first and second screens of the head-worn display device.

19 . The method of claim 14 , wherein the modification modifies either, or both, of the first and second content such that one appears to move laterally with respect to the other.

20 . The method of claim 19 , wherein the modification modifies the first content such that it appears to move laterally at a first speed and the second content such that it appears to move laterally at a second speed, wherein the first speed is greater than the second speed.

21 . A non-transitory computer readable medium comprising program instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:

tracking eye positions of a user during simultaneous display of first and second content to the user, wherein the first content comprises content displayed by a head-worn display device so that it is perceived by the user as located at a first distance from the user and the second content is displayed by a display screen of a further display device located at a second distance from the user;

modifying, responsive to the difference between the first and second distance being below a predetermined threshold, the display of either, or both, of the first and second content such as to modify spatial position at which they appear with respect to one another;

determining which of the displayed first and second content the user is looking at based at least on eye position movements, if any, tracked subsequent to the modifying; and

causing change of the display of the other one of the first and second content which the user is not determined to be looking at such as to reduce its visibility relative to the content that the user is determined to be looking at.

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (26)