IP Library Granted Patent US 12,223,613
Granted Patent B2
US 12,223,613 · App. 18/460,310 · Granted Feb 11, 2025

Tracking an ongoing construction by using fiducial markers

Inventors: Anton Treskunov (Santa Clara, CA); Robin Singh (Sunnyvale, CA)
Assignee: Doxel, Inc.
G06T19/20G01S17/89G05D1/024G06F30/13G06T7/521G06T15/205G06T17/10G06T2207/10028G06T2207/30208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,613
App. No.
18/460,310
Granted
Feb 11, 2025
Kind
B2
Abstract

A method for tracking progression of a construction site at different points in time relative to an expected progression of the construction site as represented by a computer model. The method includes generating an image of the construction site by scanning the construction site with an imaging device and detecting a fiducial marker appearing in the image at a location on the construction site. The fiducial marker is unique among fiducial markers positioned on the construction site. The method further includes identifying the detected fiducial marker in association with a unique identifier among the fiducial markers and aligning a coordinate system of the identified fiducial marker with a coordinate system of the computer model, which represents the construction site at points in time.

Claims (42)

1. A system for tracking progression of a construction site at different points in time relative to an expected progression of the construction site as represented by a computer model, the system comprising:

one or more processor; and

one or more memories including instructions executable by the processors causing the system to:

generate a first plurality of two-dimensional (2D) images of the construction site by scanning the construction site with an imaging device;

detect a first set of fiducial markers appearing in the first plurality of 2D images, each of the first set of fiducial markers being unique among the first set of fiducial markers positioned on the construction site;

generate a second plurality of 2D images of the construction site;

detect a second set of fiducial markers appearing in the second plurality of 2D images, each of the second set of fiducial markers being unique among the second set of fiducial markers;

identify each of the second set of fiducial markers in association with a unique identifier and a unique location relative to the construction site; and

align a coordinate system of the second set of fiducial markers with a coordinate system of the computer model utilizing a transformation function based on the first set of fiducial markers, which represents the construction site at points in time.

2. The system of claim 1 , wherein each of the fiducial markers in the first set of fiducial markers appears in the first plurality of 2D images, and each of the fiducial markers in the second set of fiducial markers appears in the second plurality of 2D images captured of the construction site.

3. The system of claim 1 , wherein the construction site includes a plurality of three-dimensional (3D) physical elements.

4. The system of claim 1 , wherein the construction site is a partially complete construction of a three-dimensional (3D) structure.

5. The system of claim 1 further comprising:

a robotic unmanned vehicle including a light detection and ranging (LIDAR) system of the imaging device, wherein the robotic unmanned vehicle is configured to traverse the construction site to capture the first and second pluralities of 2D images.

6. The system of claim 1 , wherein the first set of fiducial markers is positioned such that the first plurality of 2D images of the construction site includes an image of each of the first set of fiducial markers, and wherein the second set of fiducial markers is positioned such that the second plurality of 2D images of the construction site includes an image of each of the second set of fiducial markers.

7. The system of claim 1 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers is positioned on a surface of a physical element of the construction site.

8. The system of claim 1 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers is a two-dimensional (2D) barcode that is unique relative to every fiducial marker.

9. The system of claim 1 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers has a unique grayscale or binary pattern on a planar surface.

10. A non-transitory computer-readable storage medium that stores instructions to be executed by at least one processor of a system, wherein the instructions cause the system to:

generate a first plurality of two-dimensional (2D) images of a construction site by scanning the construction site with an imaging device;

detect a first set of fiducial markers appearing in the first plurality of 2D images, each of the first set of fiducial markers being unique among the first set of fiducial markers positioned on the construction site;

generate a second plurality of 2D images of the construction site;

detect a second set of fiducial markers appearing in the second plurality of 2D images, each of the second set of fiducial markers being unique among the second set of fiducial markers;

identify each of the second set of fiducial markers in association with a unique identifier and a unique location relative to the construction site; and

align a coordinate system of the second set of fiducial markers with a coordinate system of a computer model utilizing a transformation function based on the first set of fiducial markers, which represents the construction site at points in time.

11. The non-transitory computer-readable storage medium of claim 10 , wherein each of the fiducial markers in the first set of fiducial markers appears in the first plurality of 2D images, and each of the fiducial markers in the second set of fiducial markers appears in the second plurality of 2D images captured of the construction site.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the construction site includes a plurality of three-dimensional (3D) physical elements.

13. The non-transitory computer-readable storage medium of claim 10 , wherein the construction site is a partially complete construction of a three-dimensional (3D) structure.

14. The non-transitory computer-readable storage medium of claim 10 , wherein the system is further caused to:

cause a robotic unmanned vehicle including a light detection and ranging (LIDAR) system of the imaging device, to traverse the construction site to capture the first and second pluralities of 2D images.

15. The non-transitory computer-readable storage medium of claim 10 , wherein the first set of fiducial markers is positioned such that the first plurality of 2D images of the construction site includes an image of each of the first set of fiducial markers, and wherein the second set of fiducial markers is positioned such that the second plurality of 2D images of the construction site includes an image of each for the second set of fiducial markers.

16. A method tracking progression of a construction site at different points in time relative to an expected progression of the construction site as represented by a computer model, the method comprising:

generating a first plurality of two-dimensional (2D) images of the construction site by scanning the construction site with an imaging device;

detecting a first set of fiducial markers appearing in the first plurality of 2D images, each of the first set of fiducial markers being unique among the first set of fiducial markers positioned on the construction site;

generating a second plurality of 2D images of the construction site;

detecting a second set of fiducial markers appearing in the second plurality of 2D images, each of the second set of fiducial markers being unique among the second set of fiducial markers;

identifying each of the second set of fiducial markers in association with a unique identifier and a unique location relative to the construction site; and

aligning a coordinate system of the second set of fiducial markers with a coordinate system of the computer model utilizing a transformation function based on the first set of fiducial markers, which represents the construction site at points in time.

17. The method of claim 16 , wherein the first set of fiducial markers is positioned such that the first plurality of 2D images of the construction site includes an image of each of the first set of fiducial markers, and wherein the second set of fiducial markers is positioned such that the second plurality of 2D images of the construction site includes an image of each of the second set of fiducial markers.

18. The method of claim 16 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers is positioned on a surface of a physical element of the construction site.

19. The method of claim 16 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers is a two-dimensional (2D) barcode that is unique relative to every fiducial marker.

20. The method of claim 16 , wherein each of the first set of fiducial markers and each of the second set of fiducial markers has a unique grayscale or binary pattern on a planar surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2023
From: TRESKUNOV, ANTON; SINGH, ROBIN
To: DOXEL, INC.
Reel/Frame 064779/0779 →
Continuity (4)
Continuation 17661015 · Apr 27, 2022
Continuation 16680377 · Nov 11, 2019
Provisional Application 62758295 · Nov 9, 2018
Related Publication 20240249488A1 · Jul 25, 2024
References Cited (7)
US 9182487B2 · Troy · 2015 [cited by examiner]
US 9275302B1 · Yan · 2016 [cited by examiner]
US 10706321B1 · Chen · 2020 [cited by examiner]
US 20130096873A1 · Rosengaus · 2013 [cited by examiner]
US 20130250042A1 · Raghoebardayal · 2013 [cited by examiner]
US 20180335520A1 · Tofte · 2018 [cited by examiner]
US 20200397537A1 · Raby · 2020 [cited by examiner]