Local dimming of mixed reality glasses in medical environment
The disclosed method encompasses performing local dimming of a dimmed area within a display area of mixed reality glasses. The dimmed area comprises a part of the display area on which a virtual object is displayed. While local dimming increases perceptibility of the virtual object, it might impair usability since it blocks real world objects from view. This is avoided by reducing a dimming intensity of the local dimming in at least a part of the dimmed area.
1 . A method of controlling local dimming of mixed reality glasses, comprising:
performing of local dimming of a dimmed area, which is a part of a display area of the mixed reality glasses which is occupied by a virtual object, and
reducing, based on determining that at least a part of the dimmed area, which is the part of the display area of the mixed reality glasses which is occupied by the virtual object, reduces visibility of a real-world object, a dimming intensity of the local dimming in at least the part of the dimmed area, wherein reducing the dimming intensity involves cutting out a part of the dimmed area which covers an object of interest, and wherein cutting out a part of the dimmed area includes:
placing an imaginary object around the object of interest wherein the imaginary object is larger than the object of interest,
calculating a projection of the imaginary object into the dimmed area, and
reducing the dimming intensity of segments of the dimmed area which overlap with the projection.
2 . The method of claim 1 , wherein reducing the dimming intensity involves monotonically reducing the dimming intensity with an increasing size of the dimmed area.
3 . The method of claim 2 , wherein the size of the dimmed area is calculated from a distance of the virtual object to the mixed reality glasses and a size of the virtual object.
4 . The method of claim 1 , wherein reducing the dimming intensity involves setting the dimming intensity in a range from 65 percent to 100 percent of a maximum dimming intensity.
5 . The method of claim 1 , wherein the virtual object is a 2D panel.
6 . The method of claim 1 , wherein cutting out a part of the dimmed area means setting the dimming intensity in the cut-out part of the dimmed area to zero.
7 . The method of claim 1 , wherein the imaginary object is larger than the object of interest.
8 . The method of claim 1 , wherein the object of interest is a hand or a medical instrument.
9 . The method of claim 8 , wherein the object of interest is the hand and the method further comprises the step of performing tracking of the hand by the mixed reality glasses.
10 . The method of claim 1 , wherein the dimming intensity gradually increases at a border of the dimmed area.
11 . The method of claim 1 , wherein the dimmed area is smaller than an entire display area of the mixed reality glasses.
12 . A non-transitory computer readable storage comprising instructions which, when executed by a computer, cause the computer to control local dimming of mixed reality glasses, comprising:
performing of local dimming of a dimmed area, which is a part of a display area of the mixed reality glasses which is occupied by a virtual object, and
reducing, based on determining that at least a part of the dimmed area, which is the part of the display area of the mixed reality glasses which is occupied by the virtual object, reduces visibility of a real-world object, a dimming intensity of the local dimming in at least the part of the dimmed area, wherein reducing the dimming intensity involves cutting out a part of the dimmed area which covers an object of interest, and wherein cutting out a part of the dimmed area includes:
placing an imaginary object around the object of interest wherein the imaginary object is larger than the object of interest,
calculating a projection of the imaginary object into the dimmed area, and
reducing the dimming intensity of segments of the dimmed area which overlap with the projection.
13 . A computer for controlling local dimming of mixed reality glasses, the computer configured to instruct the mixed reality glasses to:
perform local dimming of a dimmed area, which is a part of a display area of the mixed reality glasses which is occupied by a virtual object, and
reduce, based on determining that at least a part of the dimmed area, which is the part of the display area of the mixed reality glasses which is occupied by the virtual object, reduces visibility of a real-world object, a dimming intensity of the local dimming in at least the part of the dimmed area, wherein reducing the dimming intensity involves cutting out a part of the dimmed area which covers an object of interest, and wherein cutting out a part of the dimmed area includes:
placing an imaginary object around the object of interest wherein the imaginary object is larger than the object of interest,
calculating a projection of the imaginary object into the dimmed area, and
reducing the dimming intensity of segments of the dimmed area which overlap with the projection.