Granted Patent B2

US 12,586,323 · App. 18/526,657 · Granted Mar 24, 2026

Inventor: Jan Heitger (Munich, DE)

G06T19/006G06F3/011G06F3/0304G06F3/0346G06T7/20G06T7/70G06T7/0002G06T2207/30168

Abstract

Claims (27)

1 . A computer implemented method comprising:

displaying, via a display of an augmented reality (AR) device, views of image data obtained by a camera of the AR device as the AR device is moved by a user;

tracking a position of a target object within the displayed views;

determining a visibility of at least one of: i. the tracked target object and ii. a virtual object to be superimposed on the tracked target object on the display, wherein the position of the virtual object is dependent on the position of the target object;

for each view of a plurality of the displayed views, storing, in response to generation of a trigger signal, the each view in association with a respective visibility matrix comprising at least one visibility matrix element indicative of visibility of the target object within the each view;

retrieving a respective visibility matrix for a plurality of the stored displayed views;

selecting a plurality of the stored displayed views based on the retrieved visibility matrices;

determining a displaying order of the selected views based on the retrieved visibility matrices; and

displaying the selected views via the display of the AR device simultaneously or successively in the determined order.

2 . The method of claim 1 , wherein the displaying the selected views via the display of the AR device is performed in response to determining that the AR device is in a read mode.

3 . The method of claim 1 , wherein the trigger signal is generated depending on the visibility.

4 . The method of claim 3 , further comprising:

displaying a second view of the image data obtained by the camera of the AR device via a display of another AR device;

wherein, within the displayed second view, the trigger signal triggers either a masking of the target object or a displaying of only the target object.

5 . The method of claim 3 , wherein the trigger signal triggers a storing of the displayed view.

6 . The method of claim 3 , wherein the trigger signal is configured to provide an indication to a user of the AR device to enable the user to store the displayed view.

7 . The method of claim 3 , wherein determining the visibility comprises at least one of: i. determining an image quality of the displayed view; and ii. determining whether at least a portion of the target object is visible within the displayed view; and, iii. determining whether at least a portion of the virtual object is visible within the displayed view.

8 . The method of claim 3 , wherein the visibility is determined based on sensor data indicative of at least one of position and motion of the target object.

9 . The method of claim 3 , wherein the visibility is determined based on sensor data indicative of at least one of position and motion of the AR device.

10 . The method of claim 3 , wherein the visibility is determined based on the tracked position of the target object.

11 . The method of claim 3 , wherein generating the trigger signal further comprises comparing the visibility of the displayed view with a previously determined visibility of a corresponding previously displayed view or previously stored displayed view.

12 . The method of claim 3 , wherein the tracking of the position of the target object is based on previously obtained target object information.

13 . The method of claim 3 , wherein the trigger signal is configured to provide an indication to point a user of the AR device in a certain direction.

14 . The method of claim 3 , wherein the trigger signal is configured to indicate a target position for the AR device.

15 . A computer-readable storage medium comprising instructions which, when executed by an augmented reality device, causes the augmented reality device to carry out the method of claim 1 .

16 . The method of claim 2 , wherein the read mode has been triggered by the AR device being placed in a substantially horizontal position.

17 . The method of claim 2 , wherein the read mode has been triggered by the user selecting the read mode from a plurality of modes comprising the read mode and a preview mode.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (26)