IP Library › Granted Patent US 12,152,881
Granted Patent B2
US 12,152,881 · App. 17/981,373 · Granted Nov 26, 2024

Total station re-sectioning using two-dimensional targets

Inventors: Matthew Fonken (Federal Heights, CO); Ashish Dhital (Westminster, CO); Scott Graybill (Arvada, CO); Vinod Khare (Westminster, CO)
Assignee: Trimble Inc.
G01C15/002G06T7/70H04N23/61H04N23/695G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,152,881
App. No.
17/981,373
Granted
Nov 26, 2024
Kind
B2
Abstract

Two-dimensional targets, such as AprilTags, are used as control points. AprilTags can be used as cost effective alternatives to traditional prism targets without losing accuracy. AprilTags can be placed precisely around a construction site as “permanent” survey control points, like positioning reflector targets. A robotic total station, equipped with a camera sensor, can image the two-dimensional targets to efficiently resection itself.

Claims (71)

1. A system for positioning and orienting a total station within a construction environment, the system comprising:

a surveying instrument, the surveying instrument comprising a camera, an electronic theodolite, and an electronic distance measurement (EDM) unit;

a first target, wherein the first target is a two-dimensional target;

a second target, wherein:

the second target is a two-dimensional target; and

the second target is visually distinguishable from the first target; and

one or more memory devices comprising instructions that, when executed, cause one or more processors to perform the following steps:

detecting the first target, using the camera of the surveying instrument, wherein a position and orientation of the first target with respect to the construction environment was previously measured;

calculating an orientation of the first target with respect to the surveying instrument, based on an image of the first target acquired by the camera of the surveying instrument;

measuring a distance from the surveying instrument to the first target, using the electronic theodolite and EDM unit of the surveying instrument;

estimating a position and an orientation of the surveying instrument with respect to the construction environment based on:

the orientation of the first target with respect to the surveying instrument;

the distance from the surveying instrument to the first target; and

the position and orientation of the first target with respect to the construction environment;

estimating a position of the second target with respect to the surveying instrument, based on estimating the position and the orientation of the surveying instrument with respect to the construction environment, wherein a position of the second target with respect to the construction environment was previously measured;

orienting the camera of the surveying instrument toward the second target, based on estimating the position of the second target with respect to the surveying instrument;

acquiring an image of the second target, using the camera of the surveying instrument;

identifying the second target, based on the image of the second target acquired by the camera of the surveying instrument;

measuring a distance from the surveying instrument to the second target, using the EDM unit of the surveying instrument;

measuring a change in orientation of the camera from the first target to the second target based on rotation of the surveying instrument; and

revising the position and/or the orientation of the surveying instrument with respect to the construction environment based on:

the distance from the surveying instrument to the second target;

the change in orientation measured for the camera from the first target to the second target; and

the position of the second target with respect to the construction environment.

2. The system of claim 1 , wherein the surveying instrument is a total station or scanner.

3. The system of claim 1 , wherein the two-dimensional target has a width equal to or greater than three inches.

4. The system of claim 1 , wherein no more than six targets are used to position the surveying instrument.

5. The system of claim 1 , wherein the first target is passive, such that the first target does not emit light.

6. A method for positioning and orienting a device within an environment, the method comprising:

detecting a first target, using a camera of the device, wherein:

the first target is a two-dimensional target; and

a position and orientation of the first target with respect to the environment was previously measured;

calculating an orientation of the first target with respect to the device, based on an image of the first target acquired by the camera of the device;

measuring a distance from the device to the first target, wherein the device comprises an electronic theodolite and an electronic distance measurement (EDM) unit for measuring the distance from the device to the first target; and

estimating a position and an orientation of the device with respect to the environment based on:

the orientation of the first target with respect to the device;

the distance from the device to the first target; and

the position and orientation of the first target with respect to the environment.

7. The method of claim 6 , further comprising:

estimating a position of a second target with respect to the device, based on estimating the position and the orientation of the device with respect to the environment, wherein:

the second target is a two-dimensional target;

the second target is visually distinguishable from the first target; and

a position of the second target with respect to the environment was previously measured;

orienting the camera of the device toward the second target, based on estimating the position of the second target with respect to the device;

acquiring an image of the second target, using the camera of the device; and

identifying the second target, based on the image of the second target acquired by the camera of the device.

8. The method of claim 7 , further comprising measuring a distance from the device to the second target.

9. The method of claim 8 , further comprising measuring a change in orientation of the camera from the first target to the second target based on rotation of the device.

10. The method of claim 9 , further comprising revising the position and/or the orientation of the device with respect to the environment based on:

the distance from the device to the second target;

the change in orientation measured for the camera from the first target to the second target; and

the position of the second target with respect to the environment.

11. The method of claim 6 , wherein the device is a total station or scanner.

12. The method of claim 11 , wherein no more than six targets are used to position the device.

13. The method of claim 6 , further comprising surveying target positions before detecting the first target.

14. The method of claim 6 , further comprising changing resolution of the camera after detecting the first target and calculating the orientation of the first target with respect to the device.

15. The method of claim 6 , further comprising decoding information from the first target to verify that the first target is a control point.

16. The method of claim 6 , wherein three corners of the first target are detected to calculate three degrees of rotational freedom and three degrees of positional freedom of the first target.

17. A memory device comprising instructions that, when executed, cause one or more processors to perform the following steps for positioning and orienting a device within an environment:

detecting a first target, using a camera of the device, wherein:

the first target is a two-dimensional target; and

a position and orientation of the first target with respect to the environment was previously measured;

calculating an orientation of the first target with respect to the device, based on an image of the first target acquired by the camera of the device;

measuring a distance from the device to the first target, wherein the device comprises an electronic theodolite and an electronic distance measurement (EDM) unit for measuring the distance from the device to the first target; and

estimating a position and an orientation of the device with respect to the environment based on:

the orientation of the first target with respect to the device;

the distance from the device to the first target; and

the position and orientation of the first target with respect to the environment.

18. The memory device of claim 17 wherein the instructions, when executed, cause the one or more processors to perform the following step: detect the first target in an image based on a machine-learning model.

19. The memory device of claim 17 wherein positions of targets with respect to the environment are saved in a remote library.

20. The memory device of claim 17 wherein the first target comprises a machine-readable code and/or a reflective element.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: FONKEN, MATTHEW; DHITAL, ASHISH; GRAYBILL, SCOTT; KHARE, VINOD
To: TRIMBLE INC.
Reel/Frame 061709/0950 →
Continuity (1)
Related Publication 20240151529A1 · May 9, 2024