IP Library Granted Patent US 11,335,059
Granted Patent B2
US 11,335,059 · App. 14/762,180 · Granted May 17, 2022

Method and arrangement for providing a 3D model

Inventors: Folke Isaksson (Linköping, SE); Johan Bejeryd (Linköping, SE); Per Carlbom (Linköping, SE); Johan Borg (Linköping, SE); Ingmar Andersson (Linköping, SE); Leif Haglund (Brokind, SE)
Assignee: Maxar International Sweden AB
G06T17/05G01C11/06G06T3/40G06T7/44G06T17/20G06T17/205G06T19/20G01C11/025G06T2200/04G06T2207/10032G06T2207/30184G06T2210/36G06T2219/004G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,335,059
App. No.
14/762,180
Granted
May 17, 2022
Kind
B2
Abstract

The present invention relates to a method and an arrangement for providing a 3D model of an environment. The method comprises the step of forming a mesh modelling the environment in three dimensions, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, wherein each node is associated to a 3D coordinate in a geographical coordinate system, determining for a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty and associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge.

Claims (52)

1. A method for providing a 3 D model of an environment comprising the step of

forming a mesh modelling the environment in three dimensions, the 3D model of the environment is based on stereo image processing a plurality of overlapping geo-referenced images of the environment, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, based on geo-referenced image sets,

determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of the mesh in relation to the environment in that node and/or surface and/or edge and

associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge,

wherein each node of the mesh is associated to a 3D coordinate in a geographical coordinate system and

wherein the mesh uncertainty represents a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

2. Method according to claim 1 , wherein the mesh uncertainty is further based on the geometry of the mesh.

3. A method according to claim 2 , wherein the determination of the mesh uncertainty related to the geometry of the mesh is based on the level of detail of the mesh.

4. A method according to claim 3 , wherein the step of forming the mesh comprises forming a hierarchical mesh having a plurality of selectable levels of details, each level associated to an uncertainty and wherein the determination of the mesh uncertainty is based on the level of detail of the selected level of the mesh.

5. A method according to claim 1 , comprising the step of determining the geometry of the mesh locally at the nodes/surfaces/edges, wherein the determination of the mesh uncertainty of a specific node/surface/edge is based on the determined local geometry.

6. A method according to claim 1 , wherein a plurality of the nodes and/or edges and/or surfaces of the mesh are associated to an attribute, said attribute comprising texture information.

7. A method according to claim 6 , wherein the attribute further comprises a texture uncertainty measure.

8. A method according to claim 1 , wherein the mesh uncertainty comprises at least one value related to a distance.

9. A method according to claim 1 , wherein the mesh uncertainty comprises at least one probability value.

10. A method according to claim 1 , comprising the step of visualizing the mesh uncertainty level in the mesh.

11. A method according to claim 1 , comprising the step of determining the number of images available for a certain area or point of the environment and comprising the step of determining the mesh uncertainty based on the number of images available for the certain area or point.

12. A method according to claim 1 , comprising the step of determining the spatial spread of the images available and comprising the step of determining the mesh uncertainty based on the spatial spread of the images available.

13. A method according to claim 1 , wherein the step of determining the mesh uncertainty comprises determining the mesh uncertainty based on a spread in the measurements.

14. A method according to claim 1 , wherein the step of forming the mesh comprises

dividing the environment into a plurality of areas or points,

providing for each area or point a plurality of geo-referenced image sets, wherein each image comprises the area or point,

performing for each area or point image stereo processing on each image set so as to provide a plurality of 3D sub models for that area or point and

providing the 3D model for each area or point based on the plurality of 3D sub-models and forming a composed 3D model of the environment based on the 3D models related to the different areas or points.

15. A method according to claim 14 , comprising the step of determining a measure related to the spread in the sub models related to a plurality of areas or points, wherein the determination of the mesh uncertainty of a specific node/surface/edge is based on the determined value related to the spread in at least one point/area corresponding to that node/surface/edge.

16. A non-transient computer readable medium comprising a program code for providing a 3D model of an environment, the code causing a computer to perform the step of:

forming a mesh modelling the environment in three dimensions, the 3D model of the environment is based on stereo image processing a plurality of overlapping geo-referenced images of the environment, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, based on geo-referenced image sets,

determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of the mesh in relation to the environment in that node and/or surface and/or edge, and

associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge,

wherein each node of the mesh is associated to a 3D coordinate in a geographical coordinate system and

wherein the mesh uncertainty represents a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

17. An arrangement for providing a 3D model of an environment comprising

a memory or having means for access to a mesh modelling the environment in three dimensions, the 3D model of the environment is based on stereo image processing a plurality of overlapping geo-referenced images of the environment, said mesh being based on the geo-referenced image sets, and comprising nodes interconnected by edges and having surfaces boarded by the edges, wherein each node is associated to a 3D coordinate in a geographical coordinate system, and

a processing unit arranged to determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment in that node and/or surface and/or edge and to associate the determined mesh uncertainty to the corresponding node and/or surface and/or edge.

18. An arrangement according to claim 17 , wherein the processing unit further is arranged to form the mesh based on the geo-referenced image sets.

19. An arrangement according to claim 17 , further comprising output means arranged to present selected information related to the mesh and the associated mesh uncertainty representing a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

20. A method for providing a 3D model of an environment comprising the step of

forming a mesh modelling the environment in three dimensions, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, based on a plurality of distance measurements for each area or point in the environment from a plurality of geographically known positions using a position determining device,

determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of the mesh in relation to the environment in that node and/or surface and/or edge and

associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge,

wherein each node of the mesh is associated to a 3D coordinate in a geographical coordinate system and

wherein the mesh uncertainty represents a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

21. A method according to claim 20 , wherein the step of determining the mesh uncertainty comprises determining the mesh uncertainty based on a spread in the measurements.

22. A non-transient computer readable medium comprising a program code for providing a 3D model of an environment, the code causing a computer to perform the steps of:

forming a mesh modelling the environment in three dimensions, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, based on a plurality of distance measurements for each area or point in the environment from a plurality of geographically known positions using a position determining device,

determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of the mesh in relation to the environment in that node and/or surface and/or edge, and

associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge,

wherein each node of the mesh is associated to a 3D coordinate in a geographical coordinate system and

wherein the mesh uncertainty represents a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

23. An arrangement for providing a 3D model of an environment comprising a memory or having means for access to a mesh modelling the environment in three dimensions said mesh being based on a plurality of distance measurements for each area or point in the environment from a plurality of geographically known positions obtained from a position determining device and comprising nodes interconnected by edges and having surfaces boarded by the edges, wherein each node is associated to a 3D coordinate in a geographical coordinate system, and

a processing unit arranged to determining for each of a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty representing a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment in that node and/or surface and/or edge and to associate the determined mesh uncertainty to the corresponding node and/or surface and/or edge.

24. An arrangement according to claim 23 , wherein the processing unit further is arranged to form the mesh based on the plurality of distance measurements for each area or point in the environment from a plurality of geographically known positions obtained from a position determining device.

25. An arrangement according to claim 23 further comprising output means arranged to present selected information related to the mesh and the associated mesh uncertainty representing a measure of the reliability of 3D coordinate in the geographical coordinate system in relation to the environment.

Assignments (5)
CHANGE IN PRINCIPAL BUSINESS ADDRESS Recorded Feb 2, 2026
From: VANTOR SWEDEN AB
To: VANTOR SWEDEN AB
Reel/Frame 074753/0201 →
CHANGE OF NAME Recorded Nov 18, 2025
From: MAXAR INTERNATIONAL SWEDEN AB
To: VANTOR SWEDEN AB
Reel/Frame 073612/0482 →
CHANGE OF NAME Recorded Feb 15, 2022
From: VRICON SYSTEMS AKTIEBOLAG
To: MAXAR INTERNATIONAL SWEDEN AB
Reel/Frame 059113/0169 →
CHANGE OF NAME Recorded May 10, 2016
From: SAAB VRICON SYSTEMS AB
To: VRICON SYSTEMS AKTIEBOLAG
Reel/Frame 038542/0150 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2016
From: ISAKSSON, FOLKE; BEJERYD, JOHAN; CARLBOM, PER; BORG, JOHAN; ANDERSSON, INGMAR; HAGLUND, LEIF
To: SAAB VRICON SYSTEMS AB
Reel/Frame 037779/0012 →
Continuity (1)
Related Publication 20150363972A1 · Dec 17, 2015