IP Library Granted Patent US 11,270,514
Granted Patent B2
US 11,270,514 · App. 16/903,212 · Granted Mar 8, 2022

Mixed-reality and CAD architectural design environment

Inventors: Barrie A. Loberg (Millarville, CA); Joseph Howell (Uintah, UT); Robert Blodgett (Salt Lake City, UT); Simon Francis Stannus (Millcreek, UT); Matthew Hibberd (Sheffield, GB); Tyler West (Calgary, CA)
Assignee: DIRTT ENVIRONMENTAL SOLUTIONS LTD.
G06T19/006G06F3/04815G06F3/04845G06F30/00G06F30/13G06T7/60G06T19/00G06T19/20G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,270,514
App. No.
16/903,212
Granted
Mar 8, 2022
Kind
B2
Abstract

A computer system for creating architectural schematics within a mixed-reality environment generates, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment. The computer system transmits, to a mixed-reality device, the mixed-reality rendering data, wherein the mixed-reality device renders the mixed-reality rendering data within the real-world environment. The computer system also receives a command from a user directed towards a particular virtual architectural element. Additionally, the computer system constrains a scope of the command based upon an interaction between the virtual architectural element and the real-world environment.

Claims (50)

1. A computer system for creating architectural schematics within a mixed-reality environment, comprising:

one or more processors; and

one or more computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following:

generate, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmit, to a mixed-reality display device, the mixed-reality rendering data, wherein the mixed-reality display device renders the mixed-reality rendering data within the real-world environment;

receive, from a camera associated with the mixed-reality display device, an image of a physical measuring tape measuring a virtual architectural element;

identify a physically measured attribute of the virtual architectural element by processing the image of the physical measuring tape with an optical character recognition algorithm to read the physically measured attribute from the physical measuring tape with respect to the virtual architectural element;

determine, based at least in part on the physically measured attribute, that a height, width, or depth of the virtual architectural element or a position of the virtual architectural element in relation to the real-world environment is different from a value defined by the architectural design application; and

adjust the height, width, or depth of the virtual architectural element or the position of the virtual architectural element in relation to the real-world environment to match the value defined by the architectural design application based at least in part on the physically measured attribute.

2. The computer system as recited in claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to adjust other aspects of the mixed-reality environment based upon the adjusted the height, width, or depth of the virtual architectural element.

3. The computer system as recited in claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to receive a command from a user to adjust the height, width, or depth of the virtual architectural element to a particular measurement based upon the physical measuring tape.

4. The computer system as recited in claim 3 , wherein the executable instructions include instructions that are executable to configure the computer system to:

adjust a height, width, or depth of the virtual architectural element to the particular measurement as indicated by the physical measuring tape.

5. The computer system as recited in claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to:

receive a command from a user to create a particular virtual architectural element, wherein identifying an environment-defined attribute of the particular virtual architectural element comprises identifying wiring requirements associated with an electrical outlet;

retrieve a physical environment attribute that corresponds with the environment-defined attribute of the particular virtual architectural element; and

constrain a scope of the command based upon the physical environment attribute.

6. The computer system as recited in claim 5 , wherein the physical environment attribute comprises a location of physical electrical wiring within the real-world environment that is configurable for connecting to the electrical outlet.

7. The computer system as recited in claim 6 , wherein the physical environment attribute further comprises an indication that the physical electrical wiring is moveable.

8. The computer system as recited in claim 7 , wherein the executable instructions include instructions that are executable to configure the computer system to:

generate a rendering of the physical electrical wiring that depicts a pathway of at least a portion of the physical electrical wiring as extending towards a location of the electrical outlet, wherein the rendering of the physical electrical wiring does not correspond with a location of the physical electrical wiring; and

constrain the scope of the command based upon the physical environment attribute, by placing the electrical outlet in a location that intersects with the rendering of the physical electrical wiring.

9. A method for creating architectural schematics within a mixed-reality environment, comprising:

generating, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmitting, to a mixed-reality display device, the mixed-reality rendering data, wherein the mixed-reality display device renders the mixed-reality rendering data within the real-world environment;

receiving, from a camera associated with the mixed-reality display device, an image of a physical measuring tape measuring a virtual architectural element;

identifying a physically measured attribute of the virtual architectural element by processing the image of the physical measuring tape with an optical character recognition algorithm to read the physically measured attribute from the physical measuring tape with respect to the virtual architectural element;

based upon the physically measured attribute, determining, based at least in part on the physically measured attribute, that a height, width, or depth of the virtual architectural element or a position of the virtual architectural element in relation to the real-world environment is different from a value defined by the architectural design application is different from a value defined by the architectural design application; and

adjusting the height, width, or depth of the virtual architectural element or the position of the virtual architectural element in relation to the real-world environment to match the value defined by the architectural design application based at least in part on the physically measured attribute.

10. The method as recited in claim 9 , further comprising adjusting other aspects of the mixed-reality environment based upon the adjusted the height, width, or depth of the virtual architectural element.

11. The method as recited in claim 9 , further comprising receiving a command from a user to adjust the height, width, or depth of the virtual architectural element to a particular measurement based upon the physical measuring tape.

12. The method as recited in claim 11 , further comprising adjusting a height, width, or depth of the virtual architectural element to the particular measurement as indicated by the physical measuring tape.

13. The method as recited in claim 9 , further comprising:

receiving a command from a user to create a particular virtual architectural element, wherein identifying an environment-defined attribute of the particular virtual architectural element comprises identifying wiring requirements associated with an electrical outlet;

retrieving a physical environment attribute that corresponds with the environment-defined attribute of the particular virtual architectural element; and

constraining a scope of the command based upon the physical environment attribute.

14. The method as recited in claim 13 , wherein the physical environment attribute comprises a location of physical electrical wiring within the real-world environment that is configurable for connecting to the electrical outlet.

15. The method as recited in claim 14 , wherein the physical environment attribute further comprises an indication that the physical electrical wiring is moveable.

16. The method as recited in claim 15 , further comprising:

generating a rendering of the physical electrical wiring that depicts a pathway of at least a portion of the physical electrical wiring as extending towards a location of the electrical outlet, wherein the rendering of the physical electrical wiring does not correspond with a location of the physical electrical wiring; and

constraining the scope of the command based upon the physical environment attribute, by placing the electrical outlet in a location that intersects with the rendering of the physical electrical wiring.

17. A computer program product comprising one or more non-transitory computer storage media having stored thereon computer-executable instructions that, when executed at a processor, cause a computer system to perform a method for creating architectural schematics within a mixed-reality environment, the computer-executable instructions configuring the processor to:

generate, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmit, to a mixed-reality display device, the mixed-reality rendering data, wherein the mixed-reality display device renders the mixed-reality rendering data within the real-world environment;

receive, from a camera associated with the mixed-reality display device, an image of a physical measuring tape measuring a virtual architectural element;

identify a physically measured attribute of the virtual architectural element by processing the image of the physical measuring tape with an optical character recognition algorithm to read the physically measured attribute from the physical measuring tape with respect to the virtual architectural element;

determine, based at least in part on the physically measured attribute, that a height, width, or depth of the virtual architectural element or a position of the virtual architectural element in relation to the real-world environment is different from a value defined by the architectural design application is different from a value defined by the architectural design application; and

adjust the height, width, or depth of the virtual architectural element or the position of the virtual architectural element in relation to the real-world environment to match the value defined by the architectural design application based at least in part on the physically measured attribute.

18. The computer program product as recited in claim 17 , further comprising computer-executable instructions that configure the processor to receive a command from a user to adjust the height, width, or depth of the virtual architectural element to a particular measurement based upon the physical measuring tape.

19. The computer program product as recited in claim 18 , further comprising computer-executable instructions that configure the processor to adjust a height, width, or depth of the virtual architectural element to the particular measurement as indicated by the physical measuring tape.

Assignments (7)
DISCLAIMER OF INTEREST Recorded Jun 22, 2023
From: FIRTST AMERICAN COMMERCIAL BANCORP, INC.
To: ARMSTRONG WORD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0257 →
LETTER OF CONSENT TO ASSIGNMENT Recorded Jun 22, 2023
From: ROYAL BANK OF CANADA
To: ARMSTRONG WORLD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0386 →
NO INTEREST LETTER Recorded Jun 22, 2023
From: UPPER CANADA FOREST PRODUCTS LTD.
To: ARMSTRONG WORLD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0271 →
PARTIAL ASSIGNMENT Recorded Jun 20, 2023
From: DIRTT ENVIRONMENTAL SOLUTIONS LTD.
To: ARMSTRONG WORLD INDUSTRIES, INC.
Reel/Frame 064040/0503 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR'S NAME ON THE COVER SHEET AND THE ASSIGNEE'S NAME INSIDE THE ASSIGNMENT DOCUMENT AND ON THE COVER SHEET, PREVIOUSLY RECORDED AT REEL: 052961 FRAME: 0743. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 14, 2021
From: DIRTT ENVIRONMENTAL SOLUTIONS INC.
To: DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 058521/0405 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2020
From: DIRTT ENVIRONMENTAL SOLUTIONS, INC.
To: DIRTT ENVIRONMENTAL SOLUTIONS, LTD
Reel/Frame 052961/0743 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2020
From: LOBERG, BARRIE A.; HOWELL, JOSEPH S.; BLODGETT, ROBERT W.; STANNUS, SIMON FRANCIS; HIBBERD, MATTHEW STEPHEN; WEST, TYLER JOHN EDWARD
To: DIRTT ENVIRONMENTAL SOLUTIONS, INC.
Reel/Frame 052961/0657 →
Continuity (4)
Continuation 15741487
Provisional Application 62378592 · Aug 23, 2016
Provisional Application 62348721 · Jun 10, 2016
Related Publication 20200312039A1 · Oct 1, 2020