IP Library Granted Patent US 11,600,012
Granted Patent B2
US 11,600,012 · App. 16/139,551 · Granted Mar 7, 2023

Display of a virtual object linked to a real object in an augmented reality display device

Inventors: Hermann Georg Mayer (Prien am Chiemsee, DE); Hans Schweizer (Plattling, DE)
Assignee: SIEMENS HEALTHCARE GMBH
G06T7/70G06T7/0002G06T7/277G06T19/006G06T2207/10016G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,600,012
App. No.
16/139,551
Granted
Mar 7, 2023
Kind
B2
Abstract

A method for determining the position of a real object and displaying a virtual object linked to the real object in an augmented reality display device is provided. For this purpose, a tracking system is used to detect a position of the real object) at different consecutive measurement times and in each case to calculate an estimated position for the measurement times. A reliability value is determined on the basis of the detected position of the real object and of the estimated position of the real object and shown in the augmented reality display device. The present method furthermore discloses a corresponding augmented reality system having an augmented reality display device for displaying a real object and a virtual object linked to the real object).

Claims (20)

1. A method for determining a position of a real object and displaying a virtual object linked to the real object in an augmented reality display device, the method comprising:

detecting a position of the real object at different consecutive measurement times;

calculating an estimated position in each case for the different consecutive measurement times; and

determining a reliability value on a basis of the detected position of the real object and of the estimated position of the real object and shown in the augmented reality display device, wherein the estimated position is calculated using a plurality of motion parameters, the plurality of motion parameters being based on kinematics or dynamics of the real object and a guide structure that is coupled to the real object that takes into account a degree of freedom of the real object and the guide structure, wherein the degree of freedom used to calculate the estimated position of the real object depends on the detected position of the real object and a current position of the guide structure which is determined by sensors attached to the guide structure; and

displaying a result of determining the reliability value, to the user.

2. The method as claimed in claim 1 , wherein markers are used in the augmented reality display device to show the reliability value.

3. The method as claimed in claim 1 , wherein, to show the reliability value, the virtual object is shifted toward the detected position of the real object in the augmented reality display device depending on the reliability value.

4. The method as claimed in claim 3 , wherein the virtual object is shifted toward the detected position of the real object in the augmented reality display device when the reliability value lies above a defined first limit value.

5. The method as claimed in claim 4 , wherein, to show the reliability value, the virtual object is shifted toward the estimated position of the real object in the augmented reality display device when the position of the real object is not able to be detected, which takes place only under a condition that the reliability value lies above a defined second limit value during a defined number of previous, consecutive measurement times, further wherein the second limit value is higher than the first limit value.

6. The method as claimed in claim 3 , wherein a speed at which the virtual object is shifted toward the detected position of the real object is based on the reliability value.

7. The method as claimed in claim 1 , wherein the virtual object comprises at least one of the following objects:

a symbol;

a virtual depiction of the real object; and

an item of information relating to the real object.

8. The method as claimed in claim 1 , wherein the estimated position is calculated with consideration to error reduction methods.

9. The method as claimed in claim 8 , wherein the error reduction methods comprise a Kalman filter.

10. The method as claimed in claim 1 , wherein the position of the real object is detected by way of a camera, and/or wherein the position of the real object is detected by way of markers that are connected to the real object and/or to the guide structure that is coupled to the real object.

11. A computer program product, comprising a computer readable hardware storage device having computer readable program code stored therein, said program code executable by a processor of a computer system to implement a method as claimed in claim 1 .

12. A non-transitory computer-readable medium on which program sections able to be read and able to be executed by a computer unit are stored in order to execute all of the steps of the method as claimed in claim 1 when the program sections are executed by the computer unit.

13. An augmented reality system having an augmented reality display device for displaying a real object and a virtual object linked to the real object, wherein the augmented reality system comprises a computer unit that in each case calculates an estimated position of the real object at different consecutive measurement times, and an evaluation unit that determines a reliability value on the basis of the estimated position and of a detected position of the real object and ensures that the reliability value is shown in the augmented reality display device; wherein the estimated position is calculated using a plurality of motion parameters, the plurality of motion parameters being based on kinematics or dynamics of the real object and a guide structure that is coupled to the real object that takes into account a degree of freedom of the real object and the guide structure, wherein the degree of freedom used to calculate the estimated position of the real object depends on the detected position of the real object and a current position of the guide structure which is determined by sensors attached to the guide structure.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2018
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 047827/0928 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2018
From: SCHWEIZER, HANS
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 047348/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2018
From: MAYER, HERMANN GEORG
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 047348/0821 →
Priority Claims (1)
DE 10 2017 216 953.2 · Sep 25, 2017 · national
Continuity (1)
Related Publication 20190096084A1 · Mar 28, 2019