IP Library Granted Patent US 12,032,875
Granted Patent B2
US 12,032,875 · App. 18/123,727 · Granted Jul 9, 2024

Methods of presenting as built data relative to an agent position in an augmented virtual model

Inventors: Jason E. Duff (Jacksonville, FL); Michael S. Santarone (Jacksonville, FL); Michael A. Wodrich (Jacksonville, FL); Randall Pugh (Jacksonville, FL)
Assignee: Middle Chart, LLC
G06F30/13G02B27/0093G02B27/0172G06Q10/06G06T19/006G02B27/017G06T7/00G06T2210/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,032,875
App. No.
18/123,727
Filed
Mar 20, 2023
Granted
Jul 9, 2024
Kind
B2
Examiner
SUN, HAI TAO
Art Unit
2616
USPC
345/633
Abstract

Methods for presenting an augmented virtual model of a physical building. A headgear on an Agent is used to scan a physical building and capture aspects of the building at respective locations. The aspects are stored a As Built Data. A portion of the As Built Data is associated with a location in the physical building. A user interface includes a representation of an agent position and presents the portion of the As Built Data in a position relative to the agent location.

Claims (27)

1. A method for presenting an augmented virtual model of a physical building, the method comprising the steps of:

a) supporting a headgear worn on a head of an agent, the headgear comprising a scanning device;

b) with the scanning device, scanning a physical building site to capture respective locations of aspects of the physical building site as image data thereby creating As Built Data while the headgear is supported on the head of the agent;

c) associating a portion of the As Built Data with an As Built Data location in the physical building;

d) generating the augmented virtual model in parallel to the physical building, the augmented virtual model comprising the As Built data representative of aspects of the physical building;

e) generating a user interface, in the headgear, comprising a human readable representation of a location of the agent wearing the headgear within the augmented virtual model;

f) presenting in the user interface a relative position of the portion of the As Built Data relative to the human readable representation of the location of the agent wearing the headgear within the augmented virtual model, wherein the relative position representing a directional indication from the human readable representation of the location of the agent wearing the headgear to the portion of the As Built Data;

g) comparing the As Built Data with a database or a technical library; and

h) presenting in the user interface, based on the comparison in step g, at least one of: an additional information and a predictive information related to the portion of the As Built Data.

2. The method of claim 1 , wherein the augmented virtual model comprises a two-dimensional representation of the physical building.

3. The method of claim 1 , wherein the augmented virtual model comprises a three-dimensional representation of the physical building.

4. The method of claim 2 , additionally comprising the step of making a technical library specific to the As built Data location accessible via the user interface comprising the human readable representation of the location within the augmented virtual model, the technical library comprising information specific to the physical building and the As Built Data location within the physical building.

5. The method of claim 4 , additionally comprising including in the technical library an equipment manual or machinery manual.

6. The method of claim 4 , additionally comprising including in the technical library a part to be ordered.

7. The method of claim 4 , additionally comprising including in the technical library a virtual demonstration of a part ordered in use.

8. The method of claim 4 , additionally comprising including in the technical library a virtual demonstration of procedures for replacing a part of a machine.

9. The method of claim 2 , additionally comprising linking a unique identifier to a location in the augmented virtual model and linking the As Built Data with date and time designation.

10. The method of claim 9 , additionally comprising the step of providing onsite guidance during a service call.

11. The method of claim 9 , additionally comprising the step of providing access to remote experts that guide onsite technicians.

12. The method of claim 9 , additionally comprising the step of providing a correct consumable for a machine included in the As Built Data.

13. The method of claim 9 , additionally comprising the step of providing a replacement part for a machine included in the As Built Data.

14. The method of claim 9 , wherein the user interface is presented on a virtual reality environment via a virtual reality headset.

15. The method of claim 9 , wherein the user interface is presented on a virtual reality environment of a tablet device.

16. The method of claim 9 , wherein the As Built Data comprises a structural component including one or more of a: beams, headers, doorways, windows, and rafter.

17. The method of claim 9 , wherein the As Built Data comprises a structural component including heating ventilation air conditioning components.

18. The method of claim 9 , wherein the As Built Data comprises a structural component including plumbing.

19. The method of claim 9 , wherein the As Built Data comprises a structural component including electrical aspects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2023
From: SANTARONE, MICHAEL S.; PUGH, RANDALL; DUFF, JASON E.; WODRICH, MICHAEL
To: MIDDLE CHART, LLC
Reel/Frame 063036/0703 →
Continuity (23)
Continuation 17398259 · Aug 10, 2021
Continuation 16918115 · Jul 1, 2020
Continuation 16504919 · Jul 8, 2019
Continuation In Part 16503878 · Jul 5, 2019
Continuation In Part 16297383 · Mar 8, 2019
Continuation In Part 16249574 · Jan 16, 2019
Continuation In Part 16176002 · Oct 31, 2018
Continuation In Part 16176002 · Oct 31, 2018
Continuation In Part 16171593 · Oct 26, 2018
Continuation In Part 16165517 · Oct 19, 2018
Continuation In Part 16161823 · Oct 16, 2018
Continuation In Part 16142275 · Sep 26, 2018
Continuation In Part 15887637 · Feb 2, 2018
Continuation In Part 15716133 · Sep 26, 2017
Continuation In Part 15716133 · Sep 26, 2017
Continuation In Part 15703310 · Sep 13, 2017
Continuation In Part 15703310 · Sep 13, 2017
Provisional Application 62793714 · Jan 17, 2019
Provisional Application 62712714 · Jul 31, 2018
Provisional Application 62531955 · Jul 13, 2017
Provisional Application 62531975 · Jul 13, 2017
Provisional Application 62462347 · Feb 22, 2017
Related Publication 20230229822A1 · Jul 20, 2023