IP Library › Granted Patent US 11,493,766
Granted Patent B2
US 11,493,766 · App. 17/125,080 · Granted Nov 8, 2022

Method and system for controlling transparency of a displaying device

Inventor: Henrik Andersson (Danderyd, SE)
Assignee: Tobii AB
G02B27/0172G02B27/0075G02B27/0093G06F3/013G02B2027/0138G02B2027/0185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,493,766
App. No.
17/125,080
Granted
Nov 8, 2022
Kind
B2
Abstract

A method for controlling the transparency level of a transparent displaying device arranged to display one or more virtual objects, the method comprising the steps of: obtaining a gaze point of a user; obtaining a position of at least one virtual object displayed by the displaying device; determining whether the attention of the user is directed to the virtual object based on the obtained gaze point; and if so, adjusting a transparency level of the displaying device. A system operative for controlling the transparency level in a displaying device, as well as a displaying device comprising such a system is also disclosed.

Claims (53)

1. A method for controlling a transparency level of a displaying device configured to display one or more virtual objects, the method comprising the steps of:

obtaining a gaze point of a user;

obtaining a position of at least one virtual object displayed by the displaying device;

determining whether an attention of the user is directed to a virtual object of the at least one virtual object based on the obtained gaze point; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze point, adjusting a first transparency level of an area surrounding the virtual object to which the attention of the user is directed, wherein a second transparency level associated with the virtual object is maintained as the virtual object and the surrounding area are displayed by the displaying device.

2. The method according to claim 1 , further comprising the steps of:

obtaining a gaze convergence distance of the user;

determining whether the attention of the user is directed to the virtual object based on the obtained gaze convergence distance; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze convergence distance, further adjusting the first transparency level of the surrounding area.

3. The method according to claim 2 , wherein the step of obtaining the gaze point and/or the gaze convergence distance of the user comprises using an eye tracker to acquire gaze data for each of eyes of the user and calculating the gaze point and/or the gaze convergence distance based on the acquired gaze data.

4. The method according to claim 3 , wherein the gaze convergence distance is a function of an interpupillary distance, IPD, of the user based on an acquired pupil position of a left eye and a right eye of the user.

5. The method according to claim 1 , wherein the step of adjusting first the transparency level comprises adjusting the first transparency level in dependence on a distance between the gaze point and/or a gaze convergence distance and the virtual object.

6. The method according to claim 1 , wherein the displaying device comprises a separate or integrated transparency-control layer, wherein the virtual object is rendered between the transparency-control layer and the user.

7. The method according to claim 1 , wherein the step of adjusting the first transparency level comprises adjusting brightness, opacity, color and/or contrast of the displaying device.

8. The method according to claim 1 , wherein the step of adjusting the first transparency level comprises adjusting the first transparency level in dependence on one or more of:

size of the virtual object;

surface texture of the virtual object;

color of the virtual object;

geometry of the virtual object;

surrounding environment; and

dwelling time.

9. The method according to claim 1 , wherein adjusting the first transparency level of the area surrounding the virtual object includes:

determining a size of the virtual object; and

determining, based on the size of the virtual object, an extent of the adjustment of the first transparency level of the area surrounding the virtual object.

10. A system for controlling a transparency level of a displaying device configured to display one or more virtual objects the system comprising:

processing circuitry; and

a memory, said memory containing instructions executable by said processing circuitry, whereby the system is operative for:

obtaining a gaze point of a user;

obtaining a position of at least one virtual object displayed by the displaying device;

determining whether an attention of the user is directed to a virtual object of the at least one virtual object based on the obtained gaze point; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze point, adjusting a first transparency level of an area surrounding the virtual object to which the attention of the user is directed, wherein a second transparency level associated with the virtual object is maintained as the virtual object and the surrounding area are displayed by the displaying device.

11. The system according to claim 10 , wherein the system is further operative for:

obtaining a gaze convergence distance of the user;

determining whether an attention of the user is directed to the virtual object based on the obtained gaze convergence distance; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze convergence distance, further adjusting the first transparency level of the surrounding area.

12. The system according to claim 11 , further comprising:

at least one eye tracker configured to acquire gaze data for eyes of a user,

wherein the system is operative for calculating the gaze point and/or the gaze convergence distance based on the acquired gaze data.

13. A displaying device having a system for controlling a transparency level, the displaying device comprising:

a transparent displaying device arranged to display one or more virtual objects;

processing circuitry; and

a memory, said memory containing instructions executable by said processing circuitry, whereby the system is operative for:

obtaining a gaze point of a user;

obtaining a position of at least one virtual object displayed by the displaying device;

determining whether an attention of the user is directed to a virtual object of the at least one virtual object based on the obtained gaze point; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze point, adjusting a first transparency level of an area surrounding the virtual object to which the attention of the user is directed, wherein a second transparency level associated with the virtual object is maintained as the virtual object and the surrounding area are displayed by the displaying device.

14. The displaying device according to claim 13 , wherein the displaying device comprises a separate or integrated transparency-control layer, wherein the virtual object is rendered between the transparency-control layer and the user.

15. The displaying device according to claim 13 , wherein the displaying device is a head-mounted display, HMD, or a head-up display, HUD.

16. A non-transitory computer-readable storage medium storing thereon a computer program comprising computer readable code means to be run in a system for controlling a transparency level of a displaying device configured to display one or more virtual objects, which computer readable code means when run in the system causes the system to perform operations comprising:

obtaining a gaze point of a user;

obtaining a position of at least one virtual object displayed by the displaying device;

determining whether an attention of the user is directed to a virtual object of the at least one virtual object based on the obtained gaze point; and

in response to determining that the attention of the user is directed to the virtual object based on the obtained gaze point, adjusting a first transparency level of an area surrounding the virtual object to which the attention of the user is directed, wherein a second transparency level associated with the virtual object is maintained as the virtual object and the surrounding area are displayed by the displaying device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2022
From: ANDERSSON, HENRIK
To: TOBII AB
Reel/Frame 061263/0119 →
Priority Claims (1)
SE 1951484-3 · Dec 17, 2019 · national
Continuity (1)
Related Publication 20210208403A1 · Jul 8, 2021