Seamless bridging AR-device and AR-system

1. An Augmented Reality (AR)-device comprising:

a visual sensor configured for capturing an environment of the AR-device,

a display configured for providing:

a real view of the environment, and

overlays onto the real view according to AR-data, wherein the AR-data comprise at least one of design data and measured data,

a computer configured for:

reading and controlling the visual sensor,

at least one of receiving, generating and storing

the AR-data, and

identification features which are assigned to each of a plurality of reference systems, wherein

each reference system is defined by a surveying instrument being one of a total station, a theodolite, a tachymeter, a laser scanner, or a laser tracker, and

the identification features are generated and provided to the AR-device by the surveying instrument of the corresponding reference system,

generating the overlays, and

establishing a referenced status of the AR-device relative to each of the reference systems in each case by:

identifying a reference system based on at least one identification feature captured by the visual sensor, and

determining a pose of the AR-device relative to the identified reference system,

wherein the computer is further configured for

maintaining the referenced status in case of loss of visual contact between the visual sensor and the at least one identification feature, based on a Visual Simultaneous Localization and Mapping (VSLAM)-process.

2. The AR-device according to claim 1 ,

wherein the VSLAM-process and establishing the referenced status are based at least on the output of the visual sensor.

3. The AR-device according to claim 1 , further comprising:

a position and orientation sensor configured to provide position and orientation data for the computer, wherein the VSLAM-process is further based on the position and orientation data.

4. The AR-device according to claim 1 , wherein the identification features comprise surveyed data.

5. An Augmented Reality (AR)-system comprising

an AR-device comprising:

a visual sensor configured for capturing an environment of the AR-device,

a display configured for providing:

a real view of the environment, and

overlays onto the real view according to AR-data, wherein the AR-data comprise at least one of design data and measured data,

a computer configured for:

reading and controlling the visual sensor,

at least one of receiving, generating and storing:

(i) the AR-data, and

(ii) identification features which are assigned to each of a plurality of reference systems,

generating the overlays,

establishing a referenced status of the AR-device relative to each of the reference systems in each case by:

(i) identifying a reference system based on at least one identification feature captured by the visual sensor, and

(ii) determining a pose of the AR-device relative to the identified reference system, and

maintaining the referenced status in case of loss of visual contact between the visual sensor and the at least one identification feature, based on a Visual Simultaneous Localization and Mapping (VSLAM)-process; and

at least two surveying instruments, each defining one of the plurality of reference systems,

wherein:

each surveying instrument is one of a total station, a theodolite, a tachymeter, a laser scanner, or a laser tracker; and

the identification features are generated and provided to the AR-device by the surveying instrument of the corresponding reference system.

6. The AR-system according to claim 5 ,

wherein the at least two surveying instruments are configured to generate and provide the AR-data to the AR-device.

7. The AR-system according to claim 5 ,

wherein the identification features are one or more of

image data,

a coded marker pattern, or

landmark coordinates.

8. A method for establishing and seamlessly bridging a referenced status of an Augmented Reality (AR)-device, the method comprising:

capturing an environment of the AR-device using a visual sensor of the AR-device;

at least one of receiving, generating and storing identification features which are assigned to each of a plurality of reference systems

wherein

each reference system is defined by a surveying instrument being one of a total station, a theodolite, a tachymeter, a laser scanner, or a laser tracker and

the identification features are generated and provided to the AR-device by the surveying instrument of the corresponding reference system,

generating overlays onto a real view of the environment displayed on a display of the AR-device, wherein the AR-data comprise at least one of design data and measured data;

establishing a referenced status of the AR-device relative to each of the reference systems in each case by:

identifying a reference system based on at least one identification feature captured by the visual sensor, and

determining a pose of the AR-device relative to the identified reference system;

identifying a first reference system based on at least one of first identification features captured by the visual sensor;

establishing a referenced status of the AR-device with respect to the first reference system; and

based on a Visual Simultaneous Localiszation and Mapping (VSLAM)-process, maintaining the referenced status even in case none of the at least one first identification feature is visible to the visual sensor.

9. The method according to claim 8 , further comprising:

identifying a second reference system based on at least one of second identification features captured by the visual sensor, and

by determining a pose of the AR-device relative to the second identification feature, establishing a referenced status of the AR-device with respect to the second reference system.

10. The method according to claim 9 , further comprising:

spatially interrelating the first identification features of the first reference system with the second identification features of the second reference system by generating according transformation parameters.

11. The method according to claim 10 , further comprising

generating an indication based on

at least one of the first identification features, or at least one of the second identification features,

the position of the origin of the first reference system or of the second reference system, and

providing the indication on the display of the AR-device.

12. The method according to claim 11 ,

wherein the indication comprises at least one of

an arrow pointing in the direction of an according origin of a reference system or in the direction of an identification feature assigned to an according reference system, and

a distance value of the distance between the AR-device and an according origin of a reference system or of the distance between the AR-device and an identification feature assigned to an according reference system.

13. The method according to claim 10 ,

wherein generating the transformation parameters is based on the VSLAM-process.

14. The method according to claim 13 , wherein the referenced status with respect to the first reference system is maintained even in case none of the first identification features is visible to the visual sensor, and wherein the referenced status with respect to the second reference system is maintained even in case none of the second identification features is visible to the visual sensor.

15. The method according to claim 13 ,

wherein at least one of

determining the pose of the AR-device relative to the first identification features, and

determining the pose of the AR-device relative to the second identification features

comprises using an image processing algorithm from photogrammetry or computer vision, in particular using a VSLAM-process.

16. The method according to claim 13 ,

wherein at least one of

determining the pose of the AR-device relative to the first identification features and

determining the pose of the AR-device relative to the second identification comprises using supportive position and orientation data obtained by the position and orientation sensor comprised by the AR-device.