IP Library Granted Patent US 12,025,439
Granted Patent B2
US 12,025,439 · App. 16/781,906 · Granted Jul 2, 2024

Surveying apparatus comprising event-based camera

Inventors: Zoltán Török (Berneck, CH); Stefan Martin Benjamin Gächter Toya (St. Gallen, CH); Thomas Mörwald (Bregenz, AT); Ulrich Hornung (St. Gallen, CH)
Assignee: LEICA GEOSYSTEMS AG
G01C1/04G01B11/005G01C3/08G01C11/02G01C15/002G01C15/008G01S17/89G06V20/10G06V20/64H04N7/188G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,025,439
App. No.
16/781,906
Granted
Jul 2, 2024
Kind
B2
Abstract

Surveying apparatus comprising an event-based camera comprising a dynamic vision sensor. The events detected by the camera are used, by means of target radiation, to determine a direction to a target to be surveyed or to determine camera poses of the camera in the context of visual odometry or determining the location of the surveying apparatus

Claims (29)

1. A mobile surveying apparatus comprising:

at least one camera module; and

a computer having visual odometry functionality, upon the implementation of which by means of a stored algorithm for visual odometry camera poses are determined by means of the evaluation of a series of images recorded by the camera module in various camera poses during a movement of the surveying apparatus along a path in a measurement environment,

wherein the camera module comprises a dynamic vision sensor, such that for a respective pixel of a pixel array of the dynamic vision sensor an event is detectable as a change in received light intensity,

wherein in the context of the functionality, during the movement, in addition to the recording of the series of images, events are detected,

wherein by means of the algorithm camera poses are determined using detected events, and

wherein the dynamic vision sensor is configured for an event detection rate of at least 1 kHz,

wherein the surveying apparatus is configured as a laser scanner, a total station, a theodolite or a tachymeter or a laser tracker and comprises:

a base,

a beam directing unit for emitting a measurement radiation and for receiving at least part of the measurement radiation reflected at a target, wherein the beam directing unit is pivotable in a motorized manner about two axes relative to the base;

a fine distance measuring unit for determining the distance to the target by means of the measurement radiation; and

an angle measuring functionality for determining an orientation of the beam directing unit relative to the base,

wherein a target position is ascertainable on the basis of the determined distance and orientation.

2. The mobile surveying apparatus according to claim 1 , wherein the dynamic vision sensor is also configured and provided for recording the images in the context of the functionality, or in the context of the functionality by means of the algorithm based on an SLAM or SfM evaluation on the basis of detected events, identifying a multiplicity of corresponding image points in respective subgroups of the series of images is carried out and, on the basis of backsight and foresight procedures on the basis of the respective corresponding image points, the camera poses are determined, or in the context of the functionality:

a first image of the series of images is recorded as reference image, the pose of which relative to/in relation to the measurement environment is known,

a set of reference image points which occur in the reference image and at least one further image of the series of images is created on the basis of detected events, and

determining camera poses relative to the measurement environment is carried out on the basis of the set of reference image points.

3. The mobile surveying apparatus according to claim 1 , wherein in the context of the functionality:

a bundle adjustment is carried out using detected events, or

tracking of image features in images of the series of images is carried out, wherein the tracking of image features is carried out on the basis of detected events.

4. The mobile surveying apparatus according to claim 1 , wherein in the context of the functionality:

a movement variable of the camera module is ascertained on the basis of detected events, or

determining a position and/or orientation of the surveying apparatus is carried out on the basis of at least one portion of the camera poses, or

in the context of the functionality:

recording a first 3D point cloud, wherein the first 3D point cloud and the first image, at least partly overlapping segments of the measurement environment, and

recording a second 3D point cloud and at least one second image of the series of images at a second path point, wherein the second 3D point cloud and the second image at least partly overlapping segments of the measurement environment, and

registering the first and second 3D point clouds relative to one another on the basis of the determined camera poses of at least the first and second images.

5. The mobile surveying apparatus according to claim 1 , wherein in the context of the functionality, recording the images is carried out at a frame rate and detecting events is carried out at a detection rate that is at least 100 times the magnitude of the frame rate, or the surveying apparatus comprises a thermal image sensor, an inertial measurement unit or an electronic distance measuring device, and camera poses are determined using measurement data of the thermal image sensor, of the inertial measurement unit or of the electronic distance measuring device.

6. A computer program product comprising program code stored on a non-transient machine-readable carrier of a surveying apparatus according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2020
From: TÖRÖK, ZOLTÁN; GÄCHTER TOYA, STEFAN MARTIN BENJAMIN; MÖRWALD, THOMAS; HORNUNG, ULRICH
To: LEICA GEOSYSTEMS AG
Reel/Frame 051848/0863 →
Priority Claims (1)
EP 19155545 · Feb 5, 2019 · regional
Continuity (1)
Related Publication 20200249017A1 · Aug 6, 2020