IP Library Granted Patent US 10,890,447
Granted Patent B2
US 10,890,447 · App. 16/006,620 · Granted Jan 12, 2021

Device, system and method for displaying measurement gaps

Inventors: Bernhard Metzler (Dornbirn, AT); Rune Fjellvang (Oslo, NO)
Assignee: HEXAGON TECHNOLOGY CENTER GMBH
G01C15/00G01C15/002G06T11/60G06T19/006G06T7/70G06T2200/24G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,890,447
App. No.
16/006,620
Granted
Jan 12, 2021
Kind
B2
Abstract

An Augmented Reality (AR)-device, including a visual sensor configured for capturing an environment of the AR device, a display configured for providing a real view of the environment, and overlays onto the real view according to AR-data, wherein the AR data are spatially linked to a reference system and comprise designed data, measured data, and remeasurement indications, a computer configured for reading and controlling the visual sensor, determining a pose of the AR-device relative to the reference system, at least one of receiving, generating and storing the AR-data, and generating the overlays. The remeasurement indications are based on an evaluation of the measured data, and spatially linked to the reference system at corresponding locations of the environment where the measured data lack a target quality.

Claims (77)

1. An Augmented Reality (AR)-device, comprising:

a visual sensor configured for capturing an environment of the AR device;

a display configured for providing:

a real view of the environment, wherein a reference system is linked to the environment, and

overlays onto the real view according to AR-data, wherein the AR data are spatially linked to a reference system, and comprise designed data and measured data; and

a computer configured for:

reading and controlling the visual sensor,

determining a pose of the AR-device relative to the reference system,

at least one of receiving, generating and storing the AR-data, and

generating the overlays;

wherein the AR-data further comprise remeasurement indications which are:

based on an evaluation of the measured data in terms of quality, and

spatially linked to the reference system at corresponding locations of the environment where the measured data lack a target quality.

2. The AR-device according to claim 1 , wherein the AR-data further comprise remeasurement instructions which are:

based on an analysis of the remeasurement indications in context of the structure of the environment, and

spatially linked to the reference system at corresponding locations of the environment where a surveying instrument is required to be set up for a remeasurement.

3. The AR-device according to claim 1 , wherein the evaluation is adapted to match the quality of the measured data with the target quality.

4. The AR-device according to claim 1 , further comprising:

a pose sensor configured for tracking a position and an orientation of the AR-device, wherein the computer is further configured for reading and controlling the pose sensor.

5. The AR-device according to claim 1 , wherein the computer is further configured for performing a Visual Simultaneous Localization and Mapping (VSLAM)-process.

6. The AR-device according to claim 1 , wherein the computer is further configured for at least one of:

receiving results of the evaluation,

receiving results of the analysis,

processing the evaluation, and

processing the analysis.

7. A surveying system comprising:

an Augmented Reality (AR)-device, comprising:

a visual sensor configured for capturing an environment of the AR device;

a display configured for providing:

a real view of the environment, wherein a reference system is linked to the environment, and

overlays onto the real view according to AR-data, wherein the AR data are spatially linked to a reference system, and comprise designed data and measured data;

a computer configured for:

reading and controlling the visual sensor,

determining a pose of the AR-device relative to the reference system,

at least one of receiving, generating and storing the AR-data, and

generating the overlays;

wherein the AR-data further comprise remeasurement indications which are based on an evaluation of the measured data in terms of quality, and are spatially linked to the reference system at corresponding locations of the environment where the measured data lack a target quality; and

a surveying instrument configured for:

generating measured data of the environment and

transmitting the measured data to the AR-device.

8. The surveying system according to claim 7 , wherein the surveying instrument is configured for at least one of:

processing the evaluations,

transmitting the results of the evaluation to the AR-device,

processing the analysis,

transmitting the results of the analysis to the AR-device.

9. A method for providing indications of locations to be remeasured to a user of an Augmented Reality(AR)-device, the method comprising:

capturing an environment of the AR-device using a visual sensor of the AR-device;

determining a pose of the AR-device relative to the reference system;

providing a real-view of the environment on a display of the AR-device, wherein a reference system is linked to the environment;

generating and providing overlays onto the real view on the display according to AR-data, wherein the AR data are spatially linked to a reference system, and comprise designed data and measured data;

evaluating the measured data in terms of quality;

generating the remeasurement indications based on the evaluation of the measured data, wherein the remeasurement indications are spatially linked to the reference system at corresponding locations of the environment where the measured data lack a target quality; and

providing the remeasurement indications as overlays on the display of the AR-device.

10. The method according to claim 9 , further comprising:

analyzing the remeasurement indications in context of the structure of the environment, and

generating the remeasurement instructions based on the analysis of the remeasurement indications, wherein the remeasurement instructions are spatially linked to the reference system at corresponding locations of the environment where a surveying instrument is required to be set up for a remeasurement.

11. The method according to claim 9 , wherein at least one of:

evaluating the measured data,

generating the remeasurement indications,

analyzing the remeasurement indications, and

generating the remeasurement instructions,

is performed by at least one of:

the AR device,

a surveying instrument of a surveying system including the AR-device, and

a server.

12. The method according to claim 9 , wherein the measured data are provided to the AR-device by at least one of:

generating the measured data with the visual sensor of the AR device,

generating the measured data with the surveying instrument and transmitting the measured data from the surveying instrument to the AR-device,

transmitting the measured data from a server to the AR-device, and

storing the measured data on the computer of the AR-device.

13. The method according to claim 9 , wherein the results of the evaluation are provided to the AR device by at least one of:

processing the evaluation with the computer of the AR-device, and

receiving the results of the evaluation with the AR device from at least one of a surveying instrument of a surveying system including the AR-device and a server.

14. The method according to claim 9 , wherein the results of the analysis are provided to the AR device by at least one of:

processing the analysis with the computer of the AR device, and

receiving the results of the analysis with the AR device from at least one of a surveying instrument of a surveying system including the AR-device and a server.

15. A computer program product having computer-executable instructions for controlling and executing the method of claim 9 , when being run by a computer of the AR-device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2025
From: HEXAGON TECHNOLOGY CENTER GMBH
To: HEXAGON INNOVATION HUB GMBH
Reel/Frame 073833/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2018
From: METZLER, BERNHARD; FJELLVANG, RUNE
To: HEXAGON TECHNOLOGY CENTER GMBH
Reel/Frame 046219/0406 →
Priority Claims (1)
EP 17175589 · Jun 12, 2017 · regional
Continuity (1)
Related Publication 20180356222A1 · Dec 13, 2018