IP Library Granted Patent US 10,605,601
Granted Patent B2
US 10,605,601 · App. 16/253,522 · Granted Mar 31, 2020

Surveying system

Inventors: Knut Siercks (Mörschwil, CH); Bernhard Metzler (Dornbirn, AT); Elmar Vincent Van Der Zwan (Altstätten, CH); Thomas Fidler (Dornbirn, AT); Roman Parys (Rebstein, CH); Alexander Velizhev (St. Gallen, CH); Jochen Scheja (Heerbrugg, CH)
Assignee: HEXAGON TECHNOLOGY CENTER GMBH
G01C15/006G01C11/02G01C11/04G01C15/002G01S19/13G01S19/14G06T7/0002G06T7/0004G06T7/579G06T7/70G06T7/97H04N5/2251H04N5/2252H04N5/2254H04N5/2257H04N5/23238H04N5/23293H04N5/23296H04N5/247G06T2207/10028G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,605,601
App. No.
16/253,522
Granted
Mar 31, 2020
Kind
B2
Abstract

A system is disclosed that comprises a camera module and a control and evaluation unit. The camera module is designed to be attached to the surveying pole and comprises at least one camera for capturing images. The control and evaluation unit has stored a program with program code so as to control and execute a functionality in which a series of images of the surrounding is captured with the at least one camera; a SLAM-evaluation with a defined algorithm using the series of images is performed, wherein a reference point field is built up and poses for the captured images are determined; and, based on the determined poses, a point cloud comprising 3D-positions of points of the surrounding can be computed by forward intersection using the series of images, particularly by using dense matching algorithm.

Claims (36)

1. A surveying subsystem comprising a camera module and a control and evaluation unit, wherein the surveying subsystem is configured to be used as part of a surveying system adapted to determine positions of a position measuring resource, particularly wherein the position measuring resource is a GNSS-antenna or a retro-reflector,

the camera module comprising at least one camera for capturing images and particularly being designed to be attached to the position measuring resource,

the control and evaluation unit having stored a program with program code so as to control and execute a functionality in which—when moving along a path through a surrounding

a series of images of the surrounding is captured with the at least one camera, the series comprising an amount of images captured with different poses of the camera, the poses representing respective positions and orientations of the camera;

a SLAM-evaluation with a defined algorithm using the series of images is performed, wherein a plurality of respectively corresponding image points are identified in each of several sub-groups of images of the series of images with use of a feature detection process for detecting corresponding features, particularly by means of feature tracking, especially a KLT-algorithm (Kanade-Lucas-Tomasi), and/or by means of feature matching, especially a SIFT-, SURF-, BRISK- or BRIEF-algorithm, and, based on resection and forward intersection using the plurality of respectively corresponding image points,

a reference point field is built up comprising a plurality of reference points of the surrounding, wherein coordinates of the reference points are derived, and

the poses for the images are determined,

wherein the control and evaluation unit comprises several diversified units,

wherein at least a first unit, particularly an FPGA or a GPU (i.e. as abbreviation for graphical processing unit), carries out at least part of the feature detection process for identifying the plurality of respectively corresponding image points, and

wherein at least another, second unit, particularly a CPU, carries out determining of the poses.

2. The subsystem according to claim 1 , wherein the first and second units are built together as one SoC (i.e. as abbreviation for system on a chip).

3. The subsystem according to claim 1 , wherein the first and the second unit are disposed within the camera module.

4. The subsystem according to claim 1 , wherein the first unit is disposed within the camera module and the second unit is a laptop, a tablet-PC, a smartphone, a processing unit of a handheld controller/datalogger of the surveying system, a processing unit of a GNSS-module of the surveying system, a processing unit of a surveying station, particularly total station, of the surveying system or a surveying site server, particularly being installed in a car.

5. The subsystem according to claim 1 , wherein

the camera module is designed to be attached to a hand-carried surveying pole as part of a surveying system that is adapted to determine positions of a position measuring resource, and the position measuring resource also being mountable on the surveying pole.

6. A surveying subsystem comprising a camera module and a control and evaluation unit, wherein the surveying subsystem is configured to be used as part of a surveying system adapted to determine positions of a position measuring resource, particularly wherein the position measuring resource is a GNSS-antenna or a retro-reflector,

the camera module comprising at least one camera for capturing images, wherein the camera module is built as one single integrated physical unit being designed to be attached to the position measuring resource, and

the control and evaluation unit having stored a program with program code so as to control and execute a functionality in which—when moving along a path through a surrounding

a series of images of the surrounding is captured with the at least one camera, the series comprising an amount of images captured with different poses of the camera, the poses representing respective positions and orientations of the camera,

a SLAM-evaluation with a defined algorithm using the series of images is performed, wherein a plurality of respectively corresponding image points are identified in each of several sub-groups of images of the series of images and, based on resection and forward intersection using the plurality of respectively corresponding image points,

a reference point field is built up comprising a plurality of reference points of the surrounding, wherein coordinates of the reference points are derived, and the poses for the images are determined,

a spatial representation, particularly a point cloud, comprising 3d-information about the surrounding is computed by forward intersection using the series of images and the determined poses, particularly by using a dense matching algorithm,

wherein the control and evaluation unit comprises several diversified units, wherein

at least one unit, being integrated in the camera module, carries out at least part of the SLAM-evaluation and

at least one other unit, being disposed externally to the camera module, carries out at least parts of computing of the spatial representation.

7. The subsystem according to claim 6 , wherein the at least one other unit is a cloud server.

8. The subsystem according to claim 1 , wherein

the at least one other unit is a laptop, a tablet-PC, a smartphone, a processing unit of a handheld controller/datalogger of the surveying system, a processing unit of a GNSS-module of the surveying system or a surveying site server, particularly being installed in a car.

9. The subsystem according to claim 1 , wherein

several other units, being disposed externally to the camera module, carry out at least parts of computing of the spatial representation in a decentralised manner, the several other units particularly being several smartphones.

10. The subsystem according to claim 1 , wherein

at least one unit carrying out a part of identifying the plurality of respectively corresponding image points and/or determining the poses is designed so as to be carriable in a backpack of an operator.

11. The subsystem according to claim 1 , wherein

at least one unit carrying out a part of identifying the plurality of respectively corresponding image points and/or determining the poses is a laptop, a tablet-PC, a smartphone, a processing unit of a handheld controller/datalogger of the surveying system, a processing unit of a GNSS-module of the surveying system or a surveying site server, particularly being installed in a car.

12. The subsystem according to claim 1 , wherein

the camera module is designed to be attached to a hand-carried surveying pole as part of a surveying system that is adapted to determine positions of a position measuring resource, and the position measuring resource also being mountable on the surveying pole.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2025
From: HEXAGON TECHNOLOGY CENTER GMBH
To: HEXAGON INNOVATION HUB GMBH
Reel/Frame 073833/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2019
From: SIERCKS, KNUT; METZLER, BERNHARD; VAN DER ZWAN, ELMAR VINCENT; FIDLER, THOMAS; PARYS, ROMAN; VELIZHEV, ALEXANDER; SCHEJA, JOCHEN
To: HEXAGON TECHNOLOGY CENTER GMBH
Reel/Frame 048092/0565 →
Continuity (2)
Division 15308827
Related Publication 20190226846A1 · Jul 25, 2019