IP Library Granted Patent US 11,164,392
Granted Patent B2
US 11,164,392 · App. 15/699,266 · Granted Nov 2, 2021

Infrastructure design using 3D reality data

Inventors: Elenie Godzaridis (Quebec, CA); Mathieu St-Pierre (Ste-Brigitte de Laval, CA)
Assignee: Bentley Systems, Incorporated
G06T19/20G06F30/13G06F30/20G06T15/04G06T15/30G06T17/05G06T17/20G06F3/04845G06K9/0063G06T7/11G06T2200/24G06T2207/20104G06T2207/30184G06T2210/36
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,164,392
App. No.
15/699,266
Granted
Nov 2, 2021
Kind
B2
Abstract

In an example embodiment, a design application receives in its graphical user interface (GUI) user input specifying a boundary of a design region of a 3-D reality model of a site. A ground detection process detects a plurality of ground points within the design region that represent ground. A terrain creation process generates a 2.5D terrain mesh for the design region. A clipping process clips around the design region to show the 2.5D terrain mesh within the design region. A CAD modeling process is then used to place one or more 3-D CAD objects that represent planned infrastructure upon the 2.5D terrain mesh within the design region. The design application displays in the GUI the created combined view including the 3-D CAD objects placed upon the 2.5D terrain mesh within the design region, surrounded by a remaining part of the 3-D reality model that provides context.

Claims (52)

1. A method for infrastructure design using three dimensional (3-D) reality data, comprising:

determining, by an electronic device, a boundary of a design region in a three dimensional (3-D) reality model, the 3-D reality model to represent existing conditions at a site including ground and non-terrain features, wherein non-terrain features are features that are not substantially at ground level including man-made 3-D structures and natural 3-D structures, the boundary of the design region formed as a polygon that extends over at least representations of the ground;

detecting, by a ground detection process executing on the electronic device or another electronic device, a plurality of ground points of the 3-D reality model for ground within the design region;

based at least on the boundary of the design region and the detected ground points of the 3-D reality model, generating a two-and-a-half (2.5D) terrain mesh that represents ground within the design region, the generating the 2.5D terrain mesh to flatten any non-terrain features within the design region;

clipping around the design region, the clipping to apply a clip mask to the 3-D reality model to show the 2.5D terrain mesh that represents ground within the design region and a remaining part of the 3-D reality model that represents ground and non-terrain features external to the design region;

placing one or more 3-D computer aided design (CAD) objects that represent planned infrastructure upon the 2.5D terrain mesh that represents ground within the design region; and

displaying, in the GUI shown by the electronic device, a combined view including the 3-D CAD objects that represent planned infrastructure placed upon the 2.5D terrain mesh that represents ground within the design region, and the 2.5D terrain mesh that represents ground within the design region surrounded by the remaining part of the 3-D reality model that represents ground and non-terrain features external to the design region.

2. The method of claim 1 , further comprising:

obtaining textures for the design region from the 3-D reality model or another data source; and

applying the textures to the 2.5D terrain mesh.

3. The method of claim 2 , wherein the obtaining textures further comprises:

creating a series of texture bitmaps for grid cells of the design region.

4. The method of claim 1 , wherein the determining comprises receiving, in a graphical user interface (GUI) shown by the electronic device, user input specifying the boundary of the design region, wherein the user input specifying the boundary of the design region comprises a drawing of the polygon on a view of the 3-D reality model shown in the GUI.

5. The method of claim 4 , wherein the user input indicates portions of the boundary also extend over non-terrain features.

6. The method of claim 1 , wherein the ground detection process utilizes an iterative ground detection algorithm, and the method further comprises:

displaying in the GUI a preview of partial results while the ground detection process is executing;

receiving, in the GUI shown by an electronic device, user input requesting that the ground detection process early terminate; and

in response to the user input requesting that the ground detection process early terminate, either returning detected ground points of the 3-D reality model of the partial results or discarding the ground points of the 3-D reality model of the partial results.

7. The method of claim 1 , wherein the 2.5D terrain mesh is a 2.5D multi-resolution terrain mesh, and the generating generates a plurality of levels of detail (LOD).

8. The method of claim 1 , wherein the clipping further comprises:

applying a clip boundary coinciding with the design region to the 2.5D terrain mesh.

9. An electronic device comprising:

a display screen;

a processor; and

a memory coupled to the processor and configured to store a three dimensional (3-D) reality model, the 3-D reality model to represent existing conditions including ground and non-terrain features existing structure, at a site and a library of computer aided design (CAD) objects, and instructions for a design application executable on the processor, the design application having a plurality of software processes including:

a design region definition process configured to determine a boundary of a design region of the 3-D reality model, the boundary of the design region formed as a polygon that extends over at least representations of ground,

a ground detection process configured to detect a plurality of ground points of the 3-D reality model for ground within the design region,

a terrain creation process configured to generate a two-and-a-half (2.5D) terrain mesh that represents ground within the design region, based at least on the user-specific boundary of the design region and the detected ground points of the 3-D reality model, the terrain creation process to flatten any non-terrain features within the design region,

a clipping process configured to apply a clip mask to the 3-D reality model to show the 2.5D terrain mesh that represents ground within the design region and a remaining part of the 3-D reality model that represents ground and non-terrain features external to the design region, and

a CAD modeling process configured to place one or more 3-D computer aided design (CAD) objects that represent planned infrastructure upon the 2.5D terrain mesh that represents ground within the design region, and display in a graphical user interface (GUI) on the display screen a combined view including the 3-D CAD objects that represent planned infrastructure placed upon the 2.5D terrain mesh that represents ground within the design region, and the 2.5D terrain mesh that represents ground within the design region surrounded by the remaining part of the 3-D reality model that represents ground and non-terrain features external to the design region,

wherein non-terrain features are features that are not substantially at ground level including man-made 3-D structures and natural 3-D structures.

10. The electronic device of claim 9 , wherein the software processes further include:

a process configured to obtain textures from the design region from the 3-D reality model or another data source,

wherein the terrain creation process is further configured to apply the textures to the 2.5D terrain mesh.

11. The electronic device of claim 10 , wherein the process is further configured to create a series of texture bitmaps for grid cells of the design region.

12. The electronic device of claim 9 , wherein the design region definition process is further configured to receive user input that specifies the boundary of the design region, wherein the user input specifying the boundary of the design region comprises drawing of the polygon on a view of the 3-D reality model shown in the GUI.

13. The electronic device of claim 9 , wherein the design region definition process is further configured to receive user input that specifies the boundary of the design region, wherein the user input indicates portions of the boundary also extend over non-terrain features.

14. The electronic device of claim 9 , wherein the ground detection process utilizes an iterative ground detection algorithm, and is further configured to display in the GUI a preview of partial results while the ground detection process is executing, receive user input requesting that the ground detection process early terminate, and in response to the user input requesting that the ground detection process early terminate, either return detected ground points of the 3-D reality model of the partial results or discard the ground points of the 3-D reality model of the partial results.

15. The electronic device of claim 9 , wherein the 2.5D terrain mesh is a 2.5D multi-resolution terrain mesh.

16. The electronic device of claim 9 , wherein the clipping process is further configured to apply a clip boundary coinciding with the design region to the 2.5D terrain mesh.

17. A method for infrastructure design using three dimensional (3-D) reality data, comprising:

determining a design region of a three dimensional (3-D) reality model, the 3-D reality model to represent existing conditions including ground and non-terrain features at a site, wherein non-terrain features are features that are not substantially at ground level including man-made 3-D structures and natural 3-D structures;

reducing the design region to be a two-and-a-half (2.5D) terrain mesh that represents ground, the reducing to flatten any non-terrain features that may be within the design region;

apply a clip mask to the 3-D reality model to show the 2.5D terrain mesh that represents ground within the design region and a remaining part of the 3-D reality model that represents ground and non-terrain features external to the design region;

placing one or more 3-D computer aided design (CAD) objects that represent planned infrastructure upon the 2.5D terrain mesh that represents ground within the design region; and

displaying, in a graphical user interface (GUI) shown by the electronic device, a combined view including the 3-D CAD objects that represent planned infrastructure placed upon the 2.5D terrain mesh that represents ground within the design region, and the 2.5D terrain mesh that represents ground within the design region in turn surrounded by the remaining part of the 3-D reality model that represents ground and non-terrain features existing structures external to the design region.

18. The method of claim 17 , further comprising:

obtaining textures for the design region from the 3-D reality model; and

applying the textures to the 2.5D terrain mesh.

19. The method of claim 17 , wherein the 2.5D terrain mesh is a 2.5D multi-resolution terrain mesh, and the reducing generates a plurality of levels of detail (LOD).

20. The method of claim 17 , wherein the clipping further comprises:

applying a clip boundary coinciding with the design region to the 2.5D terrain mesh.

Assignments (8)
SECURITY INTEREST Recorded Oct 25, 2024
From: BENTLEY SYSTEMS, INCORPORATED
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 069268/0042 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (043775/0082) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060958/0468 →
RELEASE OF SECURITY INTEREST AT REEL 043772 FRAME 0750 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0606 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY INTEREST Recorded Dec 21, 2017
From: BENTLEY SYSTEMS INCORPORATED
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 044938/0083 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2017
From: GODZARIDIS, ELENIE; ST-PIERRE, MATHIEU
To: BENTLEY SYSTEMS, INCORPORATED
Reel/Frame 043535/0371 →