IP Library Granted Patent US 12,214,283
Granted Patent B2
US 12,214,283 · App. 18/508,409 · Granted Feb 4, 2025

Systems and methods for machine learning-based emergency egress and advisement

Inventors: Bill Delmonico (Burnsville, MN); Joseph Schmitt (Princeton, MN)
Assignee: Tabor Mountain LLC
A63F13/5378A63F13/65G06F3/0482G06F16/2379G06F16/245H04L67/52G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,214,283
App. No.
18/508,409
Granted
Feb 4, 2025
Kind
B2
Abstract

The disclosed systems and methods provide for generating real-time egress plans for users in a building, based on the users' current locations. As the users' current locations change, egress plans associated with the users can be dynamically modified in real-time. The egress plans can also be generated, modified, and/or trained based on inputted information about the user. The disclosed technology can include a mobile application for presenting, in a centralized interface, information about user-specific egress plans, training the user for different emergency scenarios, improving or changing features in the building to improve safety, and user profiles. The mobile application can include training simulation games to help prepare the users to safely egress during an emergency. The disclosed technology can also predict building component and structure emergency risk levels. The disclosed technology can also designate zones in the building based on possible egress routes.

Claims (34)

1. A system for egress advisement, the system comprising:

a computer system configured to generate egress advisement in a building, the computer system performing operations that comprise:

receiving, from a plurality of sensors positioned throughout the building, signals indicative of an emergency in the building;

generating, based on the signals, an egress plan, wherein the egress plan comprises instructions for displaying augmented reality (AR) guidance to a user in the building to guide the user from their current location to a second location; and

transmitting, to an egress device, the egress plan, wherein the egress device is configured to display the AR guidance to appear to be projected according to the egress plan, wherein displaying the AR guidance comprises displaying the AR guidance to appear to be projected on a physical surface in the building that is proximate the user such that as the user moves in a direction corresponding to the egress plan, the egress device is configured to enlarge the displayed AR guidance on the physical surface in the building.

2. The system of claim 1 , wherein displaying the AR guidance according to the egress plan comprises projecting instructions for guiding the user on other surfaces proximate the user as the user moves to different locations in the building.

3. The system of claim 1 , wherein displaying the AR guidance according to the egress plan comprises projecting guidance arrows over surfaces proximate the user as the user moves to the second location.

4. The system of claim 3 , wherein displaying the AR guidance according to the egress plan further comprises enlarging the projected guidance arrows as the user moves closer to the second location.

5. The system of claim 3 , wherein displaying the AR guidance according to the egress plan further comprises enlarging the projected guidance arrows as the user moves in a direction corresponding to the egress plan.

6. The system of claim 1 , wherein displaying the AR guidance according to the egress plan comprises projecting a guidance prompt to appear on surfaces proximate the user as the user moves to the second location.

7. The system of claim 6 , wherein displaying the AR guidance according to the egress plan further comprises automatically updating the projected guidance prompt as the user completes each instruction of the egress plan for guiding the user to the second location.

8. The system of claim 6 , wherein the guidance prompt comprises text indicating a step amongst the instructions of the egress plan to be performed by the user to reach the second location.

9. The system of claim 1 , wherein displaying the AR guidance according to the egress plan comprises projecting guidance arrows and guidance text to appear over surfaces proximate the user as the user moves to the second location.

10. The system of claim 1 , wherein the egress device is a sensor device positioned proximate the user at their current location in the building.

11. The system of claim 1 , wherein the operations further comprise transmitting the egress plan to a mobile device of the user.

12. The system of claim 1 , wherein the operations further comprise transmitting the egress plan to at least one of a headset, glasses, goggles, or a dongle.

13. The system of claim 1 , wherein the operations further comprise transmitting the egress plan to is an AR device.

14. The system of claim 1 , wherein the user in the building is an occupant of the building.

15. The system of claim 1 , wherein the user is an emergency personnel and wherein displaying the AR guidance, by the egress device, comprises presenting instructions for guiding the emergency personnel to a building occupant in need of assistance to egress the building.

16. The system of claim 12 , wherein:

the at least one of the headset, the glasses, the goggles, or the dongle comprises lens, and

displaying the AR guidance at the at least one of the headset, the glasses, the goggles, or the dongle comprises displaying the egress plan on a portion of the lens without obstructing a view of an environment surrounding the user.

17. The system of claim 1 , wherein the operations further comprise: iteratively updating and transmitting, to the egress device, the egress plan as the user moves in real-time to the second location.

18. The system of claim 1 , wherein the operations further comprise identifying information about the emergency in the building, wherein the identifying comprises:

identifying one or more emergency zones in the building;

identifying non-emergency zones in the building;

selecting, based on the non-emergency zones, at least one egress plan from a plurality of candidate egress plans for the building, wherein the plurality of candidate egress plans were previously determined by the computer system and before the emergency; and

generating instructions for presenting the selected at least one egress plan at the egress device.

19. The system of claim 18 , wherein the operations further comprise:

predicting a spread of the emergency in the building;

updating at least one of the emergency zones and the non-emergency zones in the building based on the predicted spread of the emergency;

selecting an updated at least one egress plan based on the updated emergency zones and non-emergency zones; and

generating instructions for presenting the selected at least one egress plan at the egress device.

20. The system of claim 1 , wherein generating the egress plan is further based on user information, the user information indicating, for the user, at least one of age, gender, disabilities, or performance metrics for one or more previously-simulated emergencies.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2023
From: DELMONICO, BILL; SCHMITT, JOSEPH
To: LGHORIZON, LLC
Reel/Frame 065795/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2023
From: LGHORIZON, LLC
To: TABOR MOUNTAIN LLC
Reel/Frame 065795/0680 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2023
From: DELMONICO, BILL; SCHMITT, JOSEPH
To: TABOR MOUNTAIN LLC
Reel/Frame 065795/0754 →
Continuity (4)
Continuation 17877072 · Jul 29, 2022
Continuation 17352968 · Jun 21, 2021
Provisional Application 63155219 · Mar 1, 2021
Related Publication 20240082720A1 · Mar 14, 2024
References Cited (175)
US 4171944A · Hirschmann · 1979 [cited by applicant]
US 5032989A · Tornetta · 1991 [cited by applicant]
US 5568825A · Faulk · 1996 [cited by applicant]
US 5697450A · Stehling et al. · 1997 [cited by applicant]
US 5794653A · DeSmet et al. · 1998 [cited by applicant]
US 5881115A · Lipner et al. · 1999 [cited by applicant]
US 6006016A · Faigon et al. · 1999 [cited by applicant]
US 6029751A · Ford et al. · 2000 [cited by applicant]
US 6195002B1 · Evans, Jr. et al. · 2001 [cited by applicant]
US 6281790B1 · Kimmel · 2001 [cited by applicant]
US 6505145B1 · Bjornson · 2003 [cited by applicant]
US 6648077B2 · Hoffman · 2003 [cited by applicant]
US 6691064B2 · Vroman · 2004 [cited by applicant]
US 6728660B2 · Bjornson · 2004 [cited by applicant]
US 6763148B1 · Sternberg et al. · 2004 [cited by applicant]
US 6947797B2 · Dean et al. · 2005 [cited by applicant]
US 6957110B2 · Wewalaarachchi et al. · 2005 [cited by applicant]
US 6989745B1 · Milinusic et al. · 2006 [cited by applicant]
US 7032435B2 · Hassenflug · 2006 [cited by applicant]
US 7185711B2 · Jackson · 2007 [cited by applicant]
US 7209817B2 · Abdel-Malek et al. · 2007 [cited by applicant]
US 7340649B2 · Angamuthu et al. · 2008 [cited by applicant]
US 7541938B1 · Engelhaupt · 2009 [cited by applicant]
US 7579945B1 · Richter et al. · 2009 [cited by applicant]
US 7581188B2 · Hiles · 2009 [cited by applicant]
US 7818265B2 · Loveland · 2010 [cited by applicant]
US 7882026B1 · Zettner · 2011 [cited by applicant]
US 7882028B1 · Devine et al. · 2011 [cited by applicant]
US 7970674B2 · Cheng et al. · 2011 [cited by applicant]
US 8063764B1 · Mihailidis et al. · 2011 [cited by applicant]
US 8078531B2 · Mcelroy et al. · 2011 [cited by applicant]
US 8378817B2 · Fox · 2013 [cited by applicant]
US 8418773B2 · Cerrano · 2013 [cited by applicant]
US 8473917B2 · Weatherhead et al. · 2013 [cited by applicant]
US 8567757B2 · Pitchford et al. · 2013 [cited by applicant]
US 8577131B1 · Li et al. · 2013 [cited by applicant]
US 8779921B1 · Curtiss · 2014 [cited by applicant]
US 8832115B2 · Smintina · 2014 [cited by applicant]
US 8973670B2 · Enk · 2015 [cited by applicant]
US 9202362B2 · Hyland et al. · 2015 [cited by applicant]
US 9242130B2 · Hennegan · 2016 [cited by applicant]
US 9403046B2 · Schmitt et al. · 2016 [cited by applicant]
US 9536231B2 · Lerick et al. · 2017 [cited by applicant]
US 9665798B2 · Watanabe et al. · 2017 [cited by applicant]
US 10304319B2 · Sager et al. · 2019 [cited by applicant]
US 10553085B1 · Derickson · 2020 [cited by applicant]
US 10872510B2 · Derickson · 2020 [cited by applicant]
US 11043095B1 · Derickson · 2021 [cited by examiner]
US 20020095269A1 · Natalini et al. · 2002 [cited by applicant]
US 20020116202A1 · Bantz et al. · 2002 [cited by applicant]
US 20020128728A1 · Murakami et al. · 2002 [cited by applicant]
US 20020130784A1 · Suzuki et al. · 2002 [cited by applicant]
US 20020166986A1 · Remby et al. · 2002 [cited by applicant]
US 20030038846A1 · Hori · 2003 [cited by applicant]
US 20030230415A1 · Wilson · 2003 [cited by applicant]
US 20040064477A1 · Swauger · 2004 [cited by applicant]
US 20040098279A1 · Frazier · 2004 [cited by applicant]
US 20040247177A1 · Rowe et al. · 2004 [cited by applicant]
US 20060044133A1 · Lou · 2006 [cited by applicant]
US 20060069578A1 · Borkowski et al. · 2006 [cited by applicant]
US 20060125632A1 · Luebke · 2006 [cited by applicant]
US 20060184383A1 · Davis et al. · 2006 [cited by applicant]
US 20060267788A1 · Delany · 2006 [cited by applicant]
US 20060272830A1 · Fima · 2006 [cited by applicant]
US 20060278410A1 · Reilly et al. · 2006 [cited by applicant]
US 20070005159A1 · Borah · 2007 [cited by applicant]
US 20070008099A1 · Kimmel et al. · 2007 [cited by applicant]
US 20070033108A1 · Luhr · 2007 [cited by applicant]
US 20070053614A1 · Mori et al. · 2007 [cited by applicant]
US 20070067412A1 · Inui et al. · 2007 [cited by applicant]
US 20080000649A1 · Guirguis et al. · 2008 [cited by applicant]
US 20080059082A1 · Morrison · 2008 [cited by applicant]
US 20080062167A1 · Boggs · 2008 [cited by applicant]
US 20080114874A1 · Meir et al. · 2008 [cited by applicant]
US 20080183704A1 · Miller et al. · 2008 [cited by applicant]
US 20080215700A1 · Pillar et al. · 2008 [cited by applicant]
US 20080255862A1 · Bailey · 2008 [cited by applicant]
US 20090009353A1 · Schoettle · 2009 [cited by applicant]
US 20090089209A1 · Bixler et al. · 2009 [cited by applicant]
US 20090121860A1 · Kimmel et al. · 2009 [cited by applicant]
US 20090138353A1 · Mendelson · 2009 [cited by applicant]
US 20090219655A1 · Korolyov et al. · 2009 [cited by applicant]
US 20090327024A1 · Nielsen et al. · 2009 [cited by applicant]
US 20100059236A1 · Yee · 2010 [cited by applicant]
US 20100070097A1 · Morgenstern · 2010 [cited by applicant]
US 20100274397A1 · Lozier et al. · 2010 [cited by applicant]
US 20100312604A1 · Mitchell et al. · 2010 [cited by applicant]
US 20110035693A1 · Ueno · 2011 [cited by applicant]
US 20110066374A1 · Hartman · 2011 [cited by applicant]
US 20110157486A1 · Murata · 2011 [cited by applicant]
US 20110200461A1 · Christensen et al. · 2011 [cited by applicant]
US 20110312354A1 · Nakamura · 2011 [cited by applicant]
US 20120047083A1 · Qiao et al. · 2012 [cited by applicant]
US 20120056711A1 · Hanrahan et al. · 2012 [cited by applicant]
US 20120229283A1 · McKenna · 2012 [cited by applicant]
US 20120325502A1 · Hennegan · 2012 [cited by applicant]
US 20130063241A1 · Simon · 2013 [cited by applicant]
US 20130157610A1 · Vainik et al. · 2013 [cited by applicant]
US 20130170417A1 · Thomas et al. · 2013 [cited by applicant]
US 20130180139A1 · Underwood · 2013 [cited by applicant]
US 20130180737A1 · Tsuji et al. · 2013 [cited by applicant]
US 20130201018A1 · Horstemeyer et al. · 2013 [cited by applicant]
US 20130218864A1 · Hong · 2013 [cited by applicant]
US 20130342361A1 · Greene et al. · 2013 [cited by applicant]
US 20140114621A1 · Brigandi et al. · 2014 [cited by applicant]
US 20140244329A1 · Urban · 2014 [cited by applicant]
US 20140267776A1 · Duthu · 2014 [cited by applicant]
US 20140338927A1 · Palle · 2014 [cited by applicant]
US 20140340223A1 · Ilyin et al. · 2014 [cited by applicant]
US 20150070192A1 · Kates · 2015 [cited by applicant]
US 20150117701A1 · Ross et al. · 2015 [cited by applicant]
US 20150137967A1 · Wedig et al. · 2015 [cited by applicant]
US 20150165467A1 · Muff et al. · 2015 [cited by applicant]
US 20150256355A1 · Pear et al. · 2015 [cited by applicant]
US 20150371518A1 · Mittal et al. · 2015 [cited by applicant]
US 20160117646A1 · Lerick · 2016 [cited by applicant]
US 20160117785A1 · Lerick · 2016 [cited by applicant]
US 20160121151A1 · Schmitt · 2016 [cited by applicant]
US 20160180663A1 · McMahan et al. · 2016 [cited by applicant]
US 20160247369A1 · Simmons · 2016 [cited by applicant]
US 20160303412A1 · Schmitt · 2016 [cited by applicant]
US 20170076409A1 · Lerick et al. · 2017 [cited by applicant]
US 20170234562A1 · Ribbich et al. · 2017 [cited by applicant]
US 20170309142A1 · Phillips · 2017 [cited by applicant]
US 20170372568A1 · Wedig et al. · 2017 [cited by applicant]
US 20190086071A1 · O'Reilly et al. · 2019 [cited by applicant]
US 20190171780A1 · Santarone et al. · 2019 [cited by applicant]
US 20190237083A1 · Allen · 2019 [cited by applicant]
US 20190385342A1 · Freeman · 2019 [cited by examiner]
US 20200005540A1 · Challagolla et al. · 2020 [cited by applicant]
US 20200242902A1 · Derickson · 2020 [cited by applicant]
US 20200309557A1 · Efland · 2020 [cited by applicant]
US 20200334784A1 · Borsos et al. · 2020 [cited by applicant]
US 20210056820A1 · Derickson · 2021 [cited by applicant]
US 20210166533A1 · Derickson · 2021 [cited by applicant]
US 20210166534A1 · Derickson · 2021 [cited by applicant]
US 20210201635A1 · Fernandez-Orellana · 2021 [cited by applicant]
US 20220274019A1 · Delmonico et al. · 2022 [cited by applicant]
WO WO2010054794 · 2010 [cited by applicant]
WO WO2011130723 · 2011 [cited by applicant]
WO WO2014051456 · 2014 [cited by applicant]
“Secure Online Scheduling for Appliance Repair & Maintenance,” CenterPoint Energy, publically available before Oct. 28, 2015 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.centerpointenergy.com… [cited by applicant]
“Zestimate,” Zillow.com, publically available before Oct. 28, 2015 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.zillow.com/zestimate/>, 9 pages. [cited by applicant]
Actsoft, “Solutions for Today's Mobile Resources” Aug. 2012 available at http://www.actsoft.com/wp-content/Actsoft-Corporate-2012_v2. pdf uploads/2012/08/. [cited by applicant]
Artim, “An Introduction to Automatic Fire Sprinklers Part II,” Waac Newsletter, vol. 17, No. 2. Retrieved from the Internet: <URL: http://cool.conservation-us.org/waac/wn/wn17/wn17-2/wn17-206.html>, 9 pages, May 1995. [cited by applicant]
Canadian Office Action in CA Appln. No 3127796, dated Oct. 19, 2021, 8 pages. [cited by applicant]
Clicksoftware, “Field Service Management, Employee Location Tracking, Xora” 2016 available at http://smart.clicksoftware.com/products/overview/products-features/. [cited by applicant]
Cook, “Redfin buys Walk Score, marking first acquisition in company history,” GeekWire, Oct. 22, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.geekwire.com/2014/redfin-buys-walk-score-mar… [cited by applicant]
Cook, “Redfin unveils new search feature: Find your dream home in the top school zone,” GeekWire, Oct. 30, 2012 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.geekwire.com/2012/redfin-rolls-out… [cited by applicant]
Cook, “Zillow makes real estate ‘sexy,’ revamps Zestimate algorithm,” GeekWire, Jun. 14, 2011 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.geekwire.com/2011/zillow-real-estate-sexy-revamps-ze… [cited by applicant]
Duryee, “Amazon plans local services marketplace launch, challenging Yelp, Angie's List,” GeekWire, Jun. 10, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.geekwire.com/2014/amazon-plans-l… [cited by applicant]
Esser by Honeywell, “ES Detect—TM, TME, TD, O, Ot [cited by applicant]
Esser by Honeywell, “Fire Alarm Systems,” Product Catalog Jun. 2013, 364 pages, specifically p. 238. [cited by applicant]
FAA aircraft handbook, “Fire Protection Systems,” Ch. 17, 22 pages, May 7, 2013. [cited by applicant]
Fenwal, “Continuous Fire and Overheat Detection Systems for Industry,” 4 pages, Oct. 4, 2004. [cited by applicant]
GreCon, “Spark Detection and Extinguishment Systems Offer Safety for Your Production,” Jan. 12, 2010, 16 pages. [cited by applicant]
Harper, “Best Real Estate Sites to Help With Your House Hunt,” Techlicious, Jul. 24, 2013 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.techlicious.com/guide/best-real-estate-sites-to-help-wit… [cited by applicant]
Jarvis et al., “Outsourcing Your Errands: TaskRabbit Allows People to Rent Themselves Out for Odd Jobs,” ABC News, Jun. 20, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://abcnews.go.com/Busine… [cited by applicant]
Kakade and Wakdikar, “Fire Extinguisher Robot,” International Journal of Innovative Research & Development, 3 pages, Jun. 2014. [cited by applicant]
Liu, “Building Tomography: Automatic Floor Plan Generation for Indoor Localization,” A Thesis Submitted to The Hong Kong University of Science and Technology in Partial Fulfillment of the Requirements for the Degree of … [cited by applicant]
Mastin, “Scheduling Services Showdown: Schedulicity vs. Genbook vs. Appointy,” PCWorld, publically available before Oct. 28, 2015 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.pcworld.com/arti… [cited by applicant]
Mears, “The Best Online Tools for Your Housing Search,” U.S. News: Money, Jan. 3, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://money.usnews.com/money/personal-finance/articles/2014/01/03/the… [cited by applicant]
Miles, “6 On-Demand Home Service Marketplaces,” Street Fight Mag, Oct. 29, 2013 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://streetfightmag.com/2013/10/29/6-on-demand-home-service- marketplaces/>… [cited by applicant]
Newton, “TaskRabbit is blowing up its business model and becoming the Uber for everything,” The Verge, Jun. 17, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.theverge.com/2014/6/17/581625… [cited by applicant]
PCT International Preliminary Report on Patentability in International Appln. No. PCT/US2020/014971, dated Aug. 6, 2021, 10 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Application No. PCT/US2022/017849, mailed on Aug. 19, 2022, 22 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Application No. PCT/US2020/014971 dated May 12, 2020, 16 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2021/053103, dated Jan. 25, 2022, 14 pages. [cited by applicant]
PCT Invitation to Pay Additional Fees and, Where Applicable, Protest Fee in International Application No. PCT/US2022/017849, dated Jun. 14, 2022, 16 pages. [cited by applicant]
PRNewswire, “Zillow Launches Zestimate Forecast Predicting Future Value of Homes,” PRNewswire, May 8, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.prnewswire.com/news-releases/zillow-lau… [cited by applicant]
Slaton and Xiang, “Fire Away! A Smart, Servo-Controled Fire Extinguisher,” Retrieved from the Internet: < URL: http://people.ece.cornell.edu/land/courses/ece4760/FinalProjects/f2013/tms245_dzx3/tms245_dzx3/>, 18 pages, … [cited by applicant]
Tam, “Order a plumber like you would an Uber car with ClubLocal,” CNET, Jun. 6, 2013 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.cnet.com/news/order-a-plumber-like-you-would-an-uber-car-with… [cited by applicant]
Tedeschi, “For Home Buyers, an App to Assess a House's Attributes,” NY Times, Apr. 4, 2012 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.nytimes.com/2012/04/05/technology/personaltech/for-home… [cited by applicant]
Thompson, “Understanding Zestimates and Making Them Work for You,” RISMedia, publically available before Oct. 28, 2015 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://rismedia.com/2014-03-02/underst… [cited by applicant]
White, “Angie's List app makes finding service a snap,” Angie's List, Mar. 10, 2014 [retrieved on Jan. 4, 2016]. Retrieved from the Internet: URL<http://www.angieslist.com/articles/angie-s-list-app-makes-finding-service… [cited by applicant]
Cited By (2)
US 12,488,406 US 12,620,042