IP Library › Granted Patent US 11,836,873
Granted Patent B2
US 11,836,873 · App. 17/617,031 · Granted Dec 5, 2023

Augmented photo capture

Inventor: Jan Heitger (Munich, DE)
Assignee: RE'FLEKT GmbH
G06T19/006G06F3/011G06F3/0346G06T7/20G06T7/70G06T7/0002G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,873
App. No.
17/617,031
Granted
Dec 5, 2023
Kind
B2
Abstract

There is provided a computer implemented method comprising: displaying, via a display of an augmented reality, AR, device, a view of image data obtained by a camera of the AR device; tracking a position of a target object within the displayed view; determining a visibility of the tracked target object and/or a virtual object to be superimposed on the tracked target object on the display, wherein the position of the virtual object is dependent on the position of the target object; and generating a trigger signal depending on the visibility.

Claims (30)

1. A computer implemented method comprising:

displaying ( 210 ), via a display of an augmented reality (AR) device, a view of image data obtained by a camera of the AR device;

tracking ( 220 ) a position of a target object within the displayed view;

determining ( 230 ) a visibility of at least one of: i. the tracked target object and ii. a virtual object to be superimposed on the tracked target object on the display, wherein the position of the virtual object is dependent on the position of the target object;

generating ( 240 ) a trigger signal depending on the visibility;

storing ( 250 ) the displayed view;

storing a visibility matrix associated with the stored displayed view, wherein the visibility matrix comprises at least one visibility matrix element indicative of the visibility of the target object;

retrieving ( 320 ) a respective visibility matrix for a plurality of previously stored displayed views;

selecting ( 330 ) a plurality of the stored displayed views based on the retrieved visibility matrices;

determining ( 340 ) a displaying order based on the retrieved visibility matrices; and

displaying ( 350 ) the plurality of selected displayed views via the display of the AR device or another display of another AR device in the determined order, wherein the selected displayed views are displayed at least one of: simultaneously and successively.

2. The method of claim 1 , wherein the trigger signal triggers the storing of the displayed view.

3. The method of claim 1 , wherein the trigger signal is configured to provide an indication to a user of the AR device to enable the user to store the displayed view.

4. The method of claim 1 , wherein the determining the visibility comprises at least one of: i. determining an image quality of the displayed view, ii. determining what portion of the target object is visible within the displayed view, and, iii. determining what portion of the virtual object is visible within the displayed view.

5. The method of claim 1 , wherein the visibility is determined based on sensor data indicative of a position of at least one of: the AR device and the target object.

6. The method of claim 1 , wherein the visibility is determined based on the tracked position of the target object.

7. The method of claim 1 , wherein the generating the trigger signal further comprises comparing the visibility of the displayed view with a previously determined visibility of a previous displayed view.

8. The method of claim 1 , wherein the tracking of the position of the target object is based on previously obtained target object information.

9. The method of claim 1 , further comprising:

determining whether an orientation of the AR device is in a read mode position,

wherein, in response to determining that the orientation is in the read mode position, the trigger signal triggers the displaying of the retrieved displayed views via the display of the AR device.

10. The method of claim 1 , further comprising:

displaying ( 550 ) a second view of the image data obtained by the camera of the AR device via a display of another AR device;

wherein, within the displayed second view, the trigger signal triggers either a masking of the target object or a displaying of only the target object.

11. The method of claim 1 , wherein the trigger signal is configured to provide an indication to point a user of the AR device in a certain direction.

12. An augmented reality device ( 100 ) comprising means for carrying out the method of claim 1 .

13. A computer-readable storage medium comprising instructions which, when executed by an augmented reality device, cause the augmented reality device to carry out the method of claim 1 .

14. The method of claim 1 , wherein the trigger signal is configured to indicate a target position for the AR device.

15. The method of claim 1 , wherein the visibility is determined based on sensor data indicative of a motion of at least one of the AR device and the target object.

16. The method of claim 9 , wherein the read mode position is a substantially horizontal position.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2024
From: RE'FLEKT GMBH
To: PTC INC.
Reel/Frame 069298/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2021
From: HEITGER, JAN
To: RE'FLEKT GMBH
Reel/Frame 058315/0241 →
Priority Claims (1)
DE 10 2019 116 834.1 · Jun 21, 2019 · national
Continuity (1)
Related Publication 20220343610A1 · Oct 27, 2022
Cited By (2)
US 12,429,947 US 12,586,323