IP Library › Granted Patent US 12,450,665
Granted Patent B2
US 12,450,665 · App. 18/472,944 · Granted Oct 21, 2025

Systems and methods for enhanced situation visualization

Inventors: Timothy Joel Davis (Chicago, IL); Amy Engelhorn (Normal, IL)
Assignee: State Farm Mutual Automobile Insurance Company
G06Q40/08G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,665
App. No.
18/472,944
Filed
Sep 22, 2023
Granted
Oct 21, 2025
Kind
B2
Art Unit
3694
USPC
705/4
Abstract

An augmented reality (AR) system for generating and displaying an enhanced situation visualization (ESV) is provided. The AR system may include an ESV computing device, a user computing device operated by a user and a reference database. The user computing device may transmit a reference request message to the ESV device, the reference request message including an image representative of a current view of a user. The ESV computing device may determine a subject of the image, retrieve reference information associated with the subject from the reference database, and determine situation information specific to the subject. The reference and situation information may be displayed on the user computing device to provide an ESV of the subject. The ESV may be used for insurance-related activities, such as handling, adjusting, and/or generating homeowner's insurance claims, and/or for instructional guidance.

Claims (35)

1. An enhanced situation visualization (ESV) computing device comprising a memory and at least one processor communicatively coupled to the memory, wherein the at least one processor is configured to:

receive a current view of a property;

determine at least one change in the property by electronically comparing the current view of the property to a prior view of the property stored in the memory; and

cause to be displayed, on a user device, the at least one change in the property overlaid against the current view of the property and situation information overlaid against the current view of the property, the situation information including estimated damages to the property.

2. The ESV computing device of claim 1 , wherein the user device includes one of a plurality of augmented reality systems, the plurality of augmented reality systems including a plurality of personal digital projection apparatuses.

3. The ESV computing device of claim 1 , wherein the at least one processor is further configured to:

generate a virtual grid representing the at least one change in the property; and

cause to be displayed, on the user device, the virtual grid.

4. The ESV computing device of claim 3 , wherein the virtual grid is overlaid against the current view of the property and positioned relative to the current view of the property such that the virtual grid indicates the at least one change in the property relative to the current view of the property.

5. The ESV computing device of claim 1 , wherein the situation information includes estimated costs to repair the property.

6. The ESV computing device of claim 1 , wherein the estimated damages include at least one of a nature of materials damaged in the property or an approximate size of the estimated damages.

7. The ESV computing device of claim 1 , wherein the user device includes one of a personal digital projection apparatus, a smartphone, a tablet, and a computer including a camera and screen technology.

8. A computer-based method implemented by an enhanced situation visualization (ESV) computing device including a memory and at least one processor communicatively coupled to the memory, the method comprising:

receiving a current view of a property;

determining at least one change in the property by electronically comparing the current view of the property to a prior view of the property stored in the memory; and

causing to be displayed, on a user device, the at least one change in the property overlaid against the current view of the property and situation information overlaid against the current view of the property, the situation information including estimated damages to the property.

9. The computer-based method of claim 8 , wherein the user device includes one of a plurality of augmented reality systems, the plurality of augmented reality systems including a plurality of personal digital projection apparatuses.

10. The computer-based method of claim 8 further comprising:

generating a virtual grid representing the at least one change in the property; and

causing to be displayed, on the user device, the virtual grid.

11. The computer-based method of claim 10 , wherein the virtual grid is overlaid against the current view of the property and positioned relative to the current view of the property such that the virtual grid indicates the at least one change in the property relative to the current view of the property.

12. The computer-based method of claim 8 , wherein the situation information includes estimated costs to repair the property.

13. The computer-based method of claim 8 , wherein the estimated damages include at least one of a nature of materials damaged in the property or an approximate size of the estimated damages.

14. The computer-based method of claim 8 , wherein the user device includes one of a personal digital projection apparatus, a smartphone, a tablet, and a computer including a camera and screen technology.

15. At least one non-transitory computer-readable storage medium having computer-executable instructions embodied thereon, wherein when executed by at least one processor communicatively coupled to a memory, the computer-executable instructions cause the at least one processor to:

receive a current view of a property;

determine at least one change in the property by electronically comparing the current view of the property to a prior view of the property stored in the memory; and

cause to be displayed, on a user device, the at least one change in the property overlaid against the current view of the property and situation information overlaid against the current view of the property, the situation information including estimated damages to the property.

16. The least one non-transitory computer-readable storage medium of claim 15 , wherein the user device includes one of a plurality of augmented reality systems, the plurality of augmented reality systems including a plurality of personal digital projection apparatuses.

17. The least one non-transitory computer-readable storage medium of claim 15 , wherein the computer-executable instructions further cause the at least one processor to:

generate a virtual grid representing the at least one change in the property; and

cause to be displayed, on the user device, the virtual grid.

18. The least one non-transitory computer-readable storage medium of claim 17 , wherein the virtual grid is overlaid against the current view of the property and positioned relative to the current view of the property such that the virtual grid indicates the at least one change in the property relative to the current view of the property.

19. The least one non-transitory computer-readable storage medium of claim 15 , wherein the situation information includes estimated costs to repair the property.

20. The least one non-transitory computer-readable storage medium of claim 15 , wherein the estimated damages include at least one of a nature of materials damaged in the property or an approximate size of the estimated damages.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: DAVIS, TIMOTHY JOEL
To: STA GROUP, LLC
Reel/Frame 065000/0255 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: ENGELHORN, AMY
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 065000/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: STA GROUP, LLC
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 065000/0366 →
Continuity (7)
Continuation 17401042 · Aug 12, 2021
Continuation 16687059 · Nov 18, 2019
Continuation 16457026 · Jun 28, 2019
Continuation 15184916 · Jun 16, 2016
Provisional Application 62194027 · Jul 17, 2015
Provisional Application 62185359 · Jun 26, 2015
Related Publication 20240013316A1 · Jan 11, 2024
References Cited (39)
US 7809587B2 · Dorai et al. · 2010 [cited by applicant]
US 8760285B2 · Billman et al. · 2014 [cited by applicant]
US 8805707B2 · Schumann, Jr. et al. · 2014 [cited by applicant]
US 9053516B2 · Stempora · 2015 [cited by applicant]
US 9082015B2 · Christopulos et al. · 2015 [cited by applicant]
US 9654679B1 · Veliche · 2017 [cited by applicant]
US 10032225B1 · Fox et al. · 2018 [cited by applicant]
US 10529028B1 · Davis et al. · 2020 [cited by applicant]
US 10579749B1 · Davis et al. · 2020 [cited by applicant]
US 20020055861A1 · King et al. · 2002 [cited by applicant]
US 20110137685A1 · Tracy et al. · 2011 [cited by applicant]
US 20110153368A1 · Pierre et al. · 2011 [cited by applicant]
US 20110213628A1 · Peak et al. · 2011 [cited by applicant]
US 20120059676A1 · King · 2012 [cited by applicant]
US 20120065944A1 · Nielsen et al. · 2012 [cited by applicant]
US 20120076437A1 · King · 2012 [cited by applicant]
US 20120253852A1 · Pourfallah et al. · 2012 [cited by applicant]
US 20140244318A1 · Drake et al. · 2014 [cited by applicant]
US 20140257862A1 · Billman et al. · 2014 [cited by applicant]
US 20140257864A1 · Billman · 2014 [cited by applicant]
US 20140270492A1 · Christopulos et al. · 2014 [cited by applicant]
US 20140278585A1 · Zerbib · 2014 [cited by applicant]
US 20140350970A1 · Schumann, Jr. et al. · 2014 [cited by applicant]
US 20150046194A1 · Waddell et al. · 2015 [cited by applicant]
US 20150073834A1 · Gurenko et al. · 2015 [cited by applicant]
US 20150106133A1 · Smith, Jr. · 2015 [cited by applicant]
US 20150343947A1 · Bernico et al. · 2015 [cited by applicant]
US 20160063635A1 · Collazo et al. · 2016 [cited by applicant]
US 20160093000A1 · Pevzner et al. · 2016 [cited by applicant]
US 20160171622A1 · Perkins et al. · 2016 [cited by applicant]
Abolfazli et al., “Cloud-Based Augmentation for Mobile Devices: Motivation, Taxonomies, and Open Challenges,” in IEEE Communications Surveys Tutorials, vol. 16., No. 1, pp. 337-368, First Quarter 2014, doi: 10.1109/SURV… [cited by applicant]
“GlassUp,” Home and Features, accessed Jun. 23, 2016 at: http://www.glassup.net/en/. [cited by applicant]
“Google Glass may help firms Save $1bn by making Employees More Efficient.” South Asian Media Lahore: HT Digital Streams Limited. Nov. 14, 2013 (Year: 2013). [cited by applicant]
“Google Glass,” accessed Jun. 23, 2016 at: https://en.wikipedia.org/wiki/Google_Glass. [cited by applicant]
“Magic Leap,” accessed Jun. 23, 2016 at: https://en.wikipedia.org/wiki/Magic_Leap. [cited by applicant]
“Meta,” Home, accessed Jun. 23, 2016 at: https://www.metavision.com/. [cited by applicant]
“Optinvent: ORA Data Sheet,” accessed Jun. 23, 2016 at http://www.optinvent.com/wp-content/uploads/2016/06/Flyer-ORA-2-0616.pdf. [cited by applicant]
“Vuzix M100 Smart Glasses,” Overview, Features, and Specifications, accessed Jun. 23, 2016 at: https://www.vuzix.com/Products/m100-smart-glasses. [cited by applicant]
Leskens, Johannes G., et al. “An interactive simulation and Visualization Tool for Flood Analysis Usable for Practitioners,” Mitigation and Adaptation Strategies for Global Change, 22(2), 307-324; May 29, 2015. (Year: 2… [cited by applicant]