IP Library › Granted Patent US 11,727,624
Granted Patent B2
US 11,727,624 · App. 17/323,710 · Granted Aug 15, 2023

Construction visualization systems and methods

Inventors: Jay Cady (San Francisco, CA); Kenneth Sobel (San Francisco, CA)
Assignee: HYPERFRAME, INC.
G06T15/20G06T7/70G06T19/003G06T2200/24G06T2207/30204G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,624
App. No.
17/323,710
Granted
Aug 15, 2023
Kind
B2
Abstract

A construction visualization device generates a digital model of a structure for construction in a physical space. Notably, the digital model includes at least one model marker and the physical space includes at least one physical marker. The device also determines a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker. In addition, the device identifies a model position of a model part that corresponds to a physical position of a physical part of the structure, and displays at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part.

Claims (82)

1. A method, comprising:

generating a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determining a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

identifying a model position of a model part that corresponds to a physical position of a physical part of the structure;

displaying at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part relative to the physical space; and

displaying one or more graphical elements that represent at least one of an installation instruction of the physical part relative to the structure in the physical space, or a navigation instruction to move to a location in the physical space that corresponds to the physical part.

2. The method of claim 1 , wherein determining the viewing orientation further comprises:

aligning the viewing orientation of the digital model relative to the physical space based on at least one of a position of a device relative to the at least one physical marker or an orientation of the device relative to the at least one physical marker.

3. The method of claim 1 , wherein determining the viewing orientation further comprises determining the viewing orientation of the digital model based on at least one of an orientation of a device relative to the at least one physical marker, a position of the device relative to the at least one physical marker, an acceleration of the device relative to the at least one physical marker, or a velocity of the device relative to the at least one physical marker.

4. The method of claim 1 , wherein displaying the at least the portion of the digital model further comprises:

displaying an overlay view of the at least the portion of the digital model relative to a real-time view of the physical space.

5. The method of claim 1 , further comprising:

detecting the physical part in the physical space based on a unique identifier associated with the physical part, wherein the unique identifier includes at least one of a 2D code, a Quick Response (QR) code, a bar code, an identification number, or a physical characteristic of the physical part.

6. The method of claim 1 , further comprising:

generating a bounding element for display by a device;

detecting a unique identifier associated with the physical part within the bounding element; and

selecting the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier detected within the bounding element.

7. The method of claim 1 , wherein the at least one model marker comprises two or more model markers, and wherein the at least one physical marker comprises two or more physical markers.

8. An apparatus, comprising:

a processor configured to execute one or more processes; and

memory configured to store a process executable by the processor, the process, when executed, is operable to:

generate a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determine a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

identify a model position of a model part that corresponds to a physical position of a physical part of the structure;

display at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part; and

display one or more graphical elements that represent at least one of an installation instruction of the physical part relative to the structure in the physical space, or a navigation instruction to move to a location in the physical space that corresponds to the physical part.

9. The apparatus of claim 8 , wherein the process to determine the viewing orientation of the digital model is further operable to:

align the viewing orientation of the digital model relative to the physical space based on at least one of a position of a device relative to the at least one physical marker or an orientation of the device relative to the at least one physical marker.

10. The apparatus of claim 8 , wherein the process to determine the viewing orientation of the digital model is further operable to determine the viewing orientation of the digital model based on at least one of an orientation of a device relative to the at least one physical marker, a position of the device relative to the at least one physical marker, an acceleration of the device relative to the at least one physical marker, or a velocity of the device relative to the at least one physical marker.

11. The apparatus of claim 8 , wherein the process to display at least the portion of the digital model is further operable to:

display an overlay view of the at least the portion of the digital model relative to a real-time view of the physical space.

12. The apparatus of claim 8 , wherein the process is further operable to:

detect the physical part in the physical space based on a unique identifier, wherein the unique identifier includes at least one of a 2D code, a Quick Response (QR) code, a bar code, an identification number, a size of the physical part, or a shape of the physical part.

13. The apparatus of claim 8 , wherein the process is further operable to:

generate a bounding element for display by a device;

detect a unique identifier associated with the physical part within the bounding element; and

select the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier detected within the bounding element.

14. A tangible, non-transitory, computer-readable medium having instructions encoded thereon, the instructions, when executed by a processor, are operable to:

generate a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determine a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

identify a model position of a model part that corresponds to a physical position of a physical part of the structure;

display at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part relative to the physical space; and

display one or more graphical elements that represent at least one of an installation instruction of the physical part relative to the structure in the physical space, or a navigation instruction to move to a location in the physical space for installation of the physical part.

15. The tangible, non-transitory, computer-readable medium of claim 14 , wherein the instructions to determine the viewing orientation are further operable to:

align the viewing orientation of the digital model relative to the physical space based on at least one of a position of a device relative to the at least one physical marker or an orientation of the device relative to the at least one physical marker.

16. The tangible, non-transitory, computer-readable medium of claim 14 , wherein the instructions are further operable to:

detect the physical part in the physical space based on a unique identifier, wherein the unique identifier includes at least one of a 2D code, a Quick Response (QR) code, a bar code, an identification number, a size of the physical part, or a shape of the physical part.

17. The tangible, non-transitory, computer-readable medium of claim 14 , wherein the instructions are further operable to:

generate a bounding element for display by a device;

detect a unique identifier associated with the physical part within the bounding element; and

select the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier detected within the bounding element.

18. A method, comprising:

generating a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determining a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

generating a bounding element for display by a device;

detecting a unique identifier associated with a physical part of the structure within the bounding element;

selecting the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier;

identifying a model position of a model part that corresponds to a physical position of the physical part; and

displaying at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part relative to the physical space.

19. A method, comprising:

generating a digital model of a structure for construction in a physical space, the digital model including two or more model markers, the physical space including two or more physical markers;

determining a viewing orientation of the digital model for display relative to the physical space based on the two or more model markers and the two or more physical markers;

identifying a model position of a model part that corresponds to a physical position of a physical part of the structure; and

displaying at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part relative to the physical space.

20. An apparatus, comprising:

a processor configured to execute one or more processes; and

memory configured to store a process executable by the processor, the process, when executed, is operable to:

generate a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determine a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

generate a bounding element for display by a device;

detect a unique identifier associated with a physical part of the structure within the bounding element;

select the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier;

identify a model position of a model part that corresponds to a physical position of the physical part; and

display at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part.

21. A tangible, non-transitory, computer-readable medium having instructions encoded thereon, the instructions, when executed by a processor, are operable to:

generate a digital model of a structure for construction in a physical space, the digital model including at least one model marker, the physical space including at least one physical marker;

determine a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker;

generate a bounding element for display by a device;

detect a unique identifier associated with a physical part of the structure within the bounding element;

select the physical part from a plurality of physical parts in a field of view of the device based on the unique identifier;

identify a model position of a model part that corresponds to a physical position of a physical part of the structure; and

display at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part relative to the physical space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2021
From: CADY, JAY; SOBEL, KENNETH
To: HYPERFRAME, INC.
Reel/Frame 056278/0503 →
Continuity (2)
Provisional Application 63026542 · May 18, 2020
Related Publication 20210358201A1 · Nov 18, 2021
Cited By (1)
US 12,591,299