IP Library Granted Patent US 10,699,484
Granted Patent B2
US 10,699,484 · App. 15/741,487 · Granted Jun 30, 2020

Mixed-reality and CAD architectural design environment

Inventors: Barrie A. Loberg (Millarville, CA); Joseph Howell (Uintah, UT); Robert Blodgett (Salt Lake City, UT); Simon Francis Stannus (Millcreek, UT); Matthew Hibberd (Sheffield, GB); Tyler West (Calgary, CA)
Assignee: DIRTT Environmental Solutions, Ltd.
G06T19/006G06F3/04815G06F3/04845G06F30/00G06F30/13G06T7/60G06T19/00G06T19/20G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,699,484
App. No.
15/741,487
Granted
Jun 30, 2020
Kind
B2
Abstract

A computer system for creating architectural schematics within a mixed-reality environment generates, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment. The computer system transmits, to a mixed-reality device, the mixed-reality rendering data, wherein the mixed-reality device renders the mixed-reality rendering data within the real-world environment. The computer system also receives a command from a user directed towards a particular virtual architectural element. Additionally, the computer system constrains a scope of the command based upon an interaction between the virtual architectural element and the real-world environment.

Claims (48)

1. A computer system for creating architectural schematics within a mixed-reality environment, comprising:

one or more processors; and

one or more computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following:

generate, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmit, to a mixed-reality device, the mixed-reality rendering data, wherein the mixed-reality device renders the mixed-reality rendering data within the real-world environment;

receive a command from a user directed towards a virtual architectural element, wherein the command comprises:

instructions to adjust an attribute of the virtual architectural element based upon a physical tool that comprises a physically visible measurement of the virtual architectural element displayed on the physical tool, and

instructions to change a slope of a surface of the virtual architectural element to conform with a particular measurement on a leveling device; and

constrain a scope of the command based upon an interaction between the virtual architectural element and the real-world environment.

2. The computer system as recited in claim 1 , wherein the command comprises instructions to enlarge dimensions of the virtual architectural element to a predetermined larger dimension.

3. The computer system as recited in claim 2 , wherein the executable instructions include instructions that are executable to configure the computer system to:

identify physical dimensions of a portion of the real-world environment, wherein the virtual architectural element is renderable within the portion of the real-world environment;

determine that the command to enlarge dimensions of the virtual architectural element would cause the virtual architectural element to encroach upon a physical architectural element within the real-world environment; and

constrain the scope of the command by reducing the predetermined larger dimension such that the virtual architectural element does not encroach upon the physical architectural element within the real-world environment.

4. The computer system as recited in claim 3 , wherein identifying physical dimensions of the portion of the real-world environment comprises accessing dimensional information from a three-dimensional schematic of the portion of the real-world environment.

5. The computer system as recited in claim 3 , wherein identifying physical dimensions of the portion of the real-world environment comprises receiving dimensional information from one or more sensors associated with the mixed-reality device.

6. The computer system as recited in claim 1 , wherein the command comprises instructions to change dimensions of the virtual architectural element to conform with a particular measurement on a physical measuring tape.

7. The computer system as recited in claim 6 , wherein the executable instructions include instructions that are executable to configure the computer system to:

acquire image data from the mixed-reality device, wherein the image data comprises an image of the physical measuring tape;

identify from the image of the physical measuring tape a particular measurement; and

constrain the scope of the command by changing a dimension of the virtual architectural element to conform with the particular measurement.

8. The computer system as recited in claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to:

generate a digital schematic of the one or more virtual architectural elements in relation within the real-world environment, wherein the digital schematic comprises results of the command.

9. A method for creating architectural schematics within a mixed-reality environment, comprising:

generating, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmitting, to a mixed-reality device, the mixed-reality rendering data, wherein the mixed-reality device renders the mixed-reality rendering data within the real-world environment;

receiving a command from a user to create a particular virtual architectural element, wherein the particular virtual architectural element comprises an electrical outlet on a virtual wall;

identifying an environment-defined attribute of the particular virtual architectural element, wherein identifying the environment-defined attribute of the particular virtual architectural element comprises identifying wiring requirements associated with the electrical outlet;

retrieving a physical environment attribute that corresponds with the environment-defined attribute of the particular virtual architectural element; and

constraining a scope of the command based upon the physical environment attribute.

10. The method as recited in claim 9 , wherein the physical environment attribute comprises a location of electrical wiring within the real-world environment that is configurable for connecting to the electrical outlet.

11. The method as recited in claim 10 , wherein the physical environment attribute further comprises an indication that the electrical wiring is moveable.

12. The method as recited in claim 11 , further comprising:

generating a rendering of the electrical wiring that depicts a pathway of at least a portion of the electrical wiring as extending towards a location of the electrical outlet, wherein the rendering of the electrical wiring does not correspond with a location of physical electrical wiring; and

constraining the scope of the command based upon the physical environment attribute, by placing the electrical outlet in a location that intersects with the rendering of the electrical wiring.

13. The method as recited in claim 9 , wherein the command comprises instructions to create a virtual wall.

14. The method as recited in claim 13 , wherein the environment-defined attribute of the particular virtual architectural element comprises a color of the virtual wall.

15. The method as recited in claim 14 , wherein retrieving the physical environment attribute that corresponds with the environment-defined attribute of the particular virtual architectural element comprises:

receiving an image of the real-world environment from the mixed-reality device; and

identifying a physical color of a wall adjacent to the virtual wall.

16. The method as recited in claim 15 , wherein constraining the scope of the command based upon the physical environment attribute comprises applying a virtual paint color that matches the physical color to the virtual wall.

17. A method for creating architectural schematics within a mixed-reality environment, comprising:

generating, within an architectural design application, mixed-reality rendering data that visually describes one or more virtual architectural elements in relation to a real-world environment;

transmitting, to a mixed-reality device, the mixed-reality rendering data, wherein the mixed-reality device renders the mixed-reality rendering data within the real-world environment;

receiving a command from a user directed towards a virtual architectural element, wherein the command comprises:

instructions to adjust an attribute of the virtual architectural element based upon a physical tool that comprises a physically visible measurement of the virtual architectural element displayed on the physical tool, and

instructions to change a slope of a surface of the virtual architectural element to conform with a particular measurement on a leveling device; and

constrain a scope of the command based upon an interaction between the virtual architectural element and the real-world environment.

Assignments (7)
DISCLAIMER OF INTEREST Recorded Jun 22, 2023
From: FIRTST AMERICAN COMMERCIAL BANCORP, INC.
To: ARMSTRONG WORD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0257 →
NO INTEREST LETTER Recorded Jun 22, 2023
From: UPPER CANADA FOREST PRODUCTS LTD.
To: ARMSTRONG WORLD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0271 →
LETTER OF CONSENT TO ASSIGNMENT Recorded Jun 22, 2023
From: ROYAL BANK OF CANADA
To: ARMSTRONG WORLD INDUSTRIES, INC.; DIRTT ENVIRONMENTAL SOLUTIONS LTD.
Reel/Frame 064065/0386 →
PARTIAL ASSIGNMENT Recorded Jun 20, 2023
From: DIRTT ENVIRONMENTAL SOLUTIONS LTD.
To: ARMSTRONG WORLD INDUSTRIES, INC.
Reel/Frame 064040/0503 →
SECURITY INTEREST Recorded Jul 24, 2019
From: DIRTT ENVIRONMENTAL SOLUTIONS LTD
To: ROYAL BANK OF CANADA
Reel/Frame 049855/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2019
From: DIRTT ENVIRONMENTAL SOLUTIONS INC.
To: DIRTT ENVIRONMENTAL SOLUTIONS, LTD.
Reel/Frame 048486/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2018
From: LOBERG, BARRIE A.; HOWELL, JOSEPH; BLODGETT, ROBERT; STANNUS, SIMON FRANCIS; HIBBERD, MATTHEW; WEST, TYLER
To: DIRTT ENVIRONMENTAL SOLUTIONS, INC.
Reel/Frame 045926/0277 →
Continuity (3)
Provisional Application 62348721 · Jun 10, 2016
Provisional Application 62378592 · Aug 23, 2016
Related Publication 20180197340A1 · Jul 12, 2018