IP Library Granted Patent US 10,319,101
Granted Patent B2
US 10,319,101 · App. 15/193,782 · Granted Jun 11, 2019

Systems and methods for deriving spatial attributes for imaged objects utilizing three-dimensional information

Inventors: David Brandt (Portland, OR); Andrew Wakefield (Portland, OR); Logan McConnell (Portland, OR); Anand Iyer (Flower Mound, TX)
Assignee: Quantum Spatial, Inc.
G06T7/33G06T2207/10028G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,319,101
App. No.
15/193,782
Filed
Jun 27, 2016
Granted
Jun 11, 2019
Kind
B2
Art Unit
2661
USPC
382/154
Abstract

Various embodiments are directed to deriving spatial attributes for imaged objects utilizing three-dimensional (3D) information. A server may obtain 3D survey data about an object from a pre-existing source. The server may then receive image data describing the object from a user device. The server may then utilize range imagery techniques to build a 3D point cloud from imagery in a pixel space. The server may then utilize horizontal positioning to place the 3D point cloud in proximity to the 3D survey data. The server may then fit the 3D survey data to the 3D point cloud. Finally, the server may record measurements and absolute locations of interest from the 3D point cloud and send them to the user device.

Claims (32)

1. A system comprising:

at least one processor; and

at least one memory storing computer-executable instructions that when executed by the at least one processor, cause the system to:

obtain three-dimensional (3D) survey data about an object from a pre-existing source, wherein the source comprises a data center storing previously gathered aerial scanning Light Detection and Ranging (LiDAR) data;

receive image data describing the object from a user device, wherein the image data comprises a plurality of images representing the object received from a user of image capture and global navigation satellite system applications invoked on the user device when the user is positioned in front of the object at an object location to be surveyed, the plurality of images captured from one or more convergent angles of the object;

build a 3D point cloud from the image data in a pixel space;

in response to an input received from the user device, utilize horizontal positioning to place the 3D point cloud in proximity to the 3D survey data;

fit the 3D survey data to the 3D point cloud by exploiting one or more known spatial characteristics of the object within an imaged scene, the known spatial characteristics having a known height and a known width in world coordinates;

generate a refined 3D point cloud by joining the 3D survey data and the 3D point cloud;

record, from the refined 3D point cloud, measurements and locations of interest for the object; and

send the measurements and the locations of interest to the user device.

2. The system of claim 1 , wherein the plurality of images captured from the one or more convergent angles of the object indicate a horizontal position from public map data and one or more object vertices available within the 3D survey data.

3. A method comprising:

obtaining, by a computing device, three-dimensional (3D) survey data about an object from a pre-existing source, wherein the source comprises a data center storing previously gathered aerial scanning Light Detection and Ranging (LiDAR) data;

receiving, by the computing device, image data describing the object from a user device, wherein the image data comprises a plurality of images representing the object received from a user of image capture and global navigation satellite system applications invoked on the user device when the user is positioned in front of the object at an object location to be surveyed, the plurality of images captured from one or more convergent angles of the object;

building, by the computing device, a 3D point cloud from the image data in a pixel space;

in response to an input received from the user device, utilizing, by the computing device, horizontal positioning to place the 3D point cloud in proximity to the 3D survey data;

fitting, by the computing device, the 3D survey data to the 3D point cloud by exploiting one or more known spatial characteristics of the object within an imaged scene, the known spatial characteristics having a known height and a known width in world coordinates;

generating, by the computing device, a refined 3D point cloud by joining the 3D survey data and the 3D point cloud;

recording, by the computing device, from the refined 3D point cloud, measurements and locations of interest for the object; and

sending, by the computing device, the measurements and the locations of interest to the user device.

4. The method of claim 3 , wherein the plurality of images captured from the one or more convergent angles of the object indicate a horizontal position from public map data and one or more object vertices available within the 3D survey data.

5. One or more non-transitory computer-readable media configured to store computer-executable instructions that, when executed by one or more processors, configure the one or more processors to:

obtain three-dimensional (3D) survey data about an object from a pre-existing source, wherein the source comprises a data center storing previously gathered aerial scanning Light Detection and Ranging (LiDAR) data;

receive image data describing the object from a user device, wherein the image data comprises a plurality of images representing the object received from a user of image capture and global navigation satellite system applications invoked on the user device when the user is positioned in front of the object at an object location to be surveyed, the plurality of images captured from one or more convergent angles of the object;

build a 3D point cloud from the image data in a pixel space;

in response to an input received from the user device, utilize horizontal positioning to place the 3D point cloud in proximity to the 3D survey data;

fit the 3D survey data to the 3D point cloud by exploiting one or more known spatial characteristics of the object within an imaged scene, the known spatial characteristics having a known height and a known width in world coordinates;

generate a refined 3D point cloud by joining the 3D survey data and the 3D point cloud;

record, from the refined 3D point cloud, measurements and locations of interest for the object; and

send the measurements and the locations of interest to the user device.

6. The one or more non-transitory computer-readable media of claim 5 , wherein the plurality of images captured from the one or more convergent angles of the object indicate a horizontal position from public map data and one or more object vertices available within the 3D survey data.

Assignments (10)
JOINDER TO PATENT SECURITY AGREEMENT Recorded Nov 5, 2025
From: NV5 GEOSPATIAL, INC.
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 073463/0044 →
RELEASE OF SECURITY INTEREST Recorded Aug 4, 2025
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: NV5 GEOSPATIAL, INC. (FORMERLY NAMED QUANTUM SPATIAL, INC.)
Reel/Frame 071928/0192 →
CHANGE OF NAME Recorded Feb 15, 2023
From: QUANTUM SPATIAL, INC.
To: NV5 GEOSPATIAL, INC.
Reel/Frame 062762/0474 →
RELEASE OF SECURITY INTEREST Recorded Jan 17, 2020
From: TWIN BROOK CAPITAL PARTNERS, LLC
To: QUANTUM SPATIAL, INC.
Reel/Frame 051542/0759 →
SECURITY INTEREST Recorded Dec 23, 2019
From: QUANTUM SPATIAL, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 051352/0311 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPLICATION NUMBER 29/688475 PREVIOUSLY RECORDED ON REEL 050277 FRAME 0594. ASSIGNOR(S) HEREBY CONFIRMS THE PATENT SECURITY AGREEMENT. Recorded Sep 23, 2019
From: QUANTUM SPATIAL, INC.
To: TWIN BROOK CAPITAL PARTNERS, LLC, AS AGENT
Reel/Frame 050461/0974 →
RELEASE OF SECURITY INTEREST Recorded Sep 6, 2019
From: CERBERUS BUSINESS FINANCE, LLC, AS COLLATERAL AGENT
To: QUANTUM SPATIAL, INC.
Reel/Frame 050289/0924 →
SECURITY INTEREST Recorded Sep 5, 2019
From: QUANTUM SPATIAL, INC.
To: TWIN BROOK CAPITAL PARTNERS, LLC, AS AGENT
Reel/Frame 050277/0594 →
SECURITY AGREEMENT - PATENTS Recorded Nov 21, 2017
From: QUANTUM SPATIAL, INC.
To: CERBERUS BUSINESS FINANCE, LLC, AS COLLATERAL AGENT
Reel/Frame 044207/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: BRANDT, DAVID; WAKEFIELD, ANDREW; MCCONNELL, LOGAN; IYER, ANAND
To: QUANTUM SPATIAL, INC.
Reel/Frame 039033/0294 →
Continuity (2)
Provisional Application 62299329 · Feb 24, 2016
Related Publication 20170243405A1 · Aug 24, 2017