IP Library Granted Patent US 12,346,972
Granted Patent B2
US 12,346,972 · App. 18/307,209 · Granted Jul 1, 2025

Method and system for identifying conditions of features represented in a virtual model

Inventors: Rebecca A. Little (Mesa, AZ); Bryan R. Nussbaum (Bloomington, IL); Deanna L. Stockweather (Normal, IL); Nathan C. Summers (Mesa, AZ); An Ho (Phoenix, AZ); Vicki King (Bloomington, IL)
Assignee: State Farm Mutual Automobile Insurance Company
G06Q40/08G06T17/05G06Q50/163
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,346,972
App. No.
18/307,209
Granted
Jul 1, 2025
Kind
B2
Abstract

Methods and systems for developing virtual models and assessing a condition of a feature of a modeled property within a virtual environment are described herein. A server may receive a data request from a user electronic device. The data request may comprise a property of interest located in an overall region. The server may then dynamically acquire a virtual model for rendering the property within a virtual environment at the user electronic device based on the data request. The server may then determine to assess a condition of the feature associated with the property represented in the virtual model in accordance with rules. The condition of the feature is relevant to assessing risks associated with the one or more properties. The server may subsequently obtain an assessment of the condition associated with the feature of the property based on a representation of the condition within the virtual environment.

Claims (63)

1. A computer-implemented method, comprising:

generating, by a processor, based at least in part on one or more images of a physical object and within a virtual environment, a first virtual model of the physical object, wherein the first virtual model is comprised of a first plurality of features;

displaying, by the processor, the first virtual model on a display of a user electronic device;

receiving, by the processor, and in the virtual environment, an annotation at a virtual coordinate of a feature of the first plurality of features;

translating, by the processor, the received virtual coordinate into Global Positioning System (GPS) coordinates corresponding to a real-world location of the feature;

generating, by the processor, a notification comprising the GPS coordinates and transmitting, by the processor, the notification to a remote imaging vehicle,

capturing, by the processor via the remote imaging vehicle, at least one image of the feature at the real-world location and receiving, by the processor, the at least one captured image from the remote imaging vehicle;

generating, by the processor, a second virtual model of the physical object by updating the first virtual model using the at least one captured image, wherein the second virtual model comprises a second plurality of features; and

displaying, by the processor, the second virtual model on the display.

2. The computer-implemented method of claim 1 , wherein updating the first virtual model comprises replacing, an image of the one or more images with the at least one captured image.

3. The computer-implemented method of claim 2 , wherein replacing the image of the one or more images with the captured image is based at least in part on determining, by the processor, that the at least one captured image meets or exceeds an image resolution threshold.

4. The computer-implemented method of claim 1 , wherein the notification comprises a threshold image resolution.

5. The computer-implemented method of claim 1 , further comprising:

receiving, by the processor, and in the virtual environment, an input associated with a feature of the second plurality of features; and

generating, by the processor, based on the received input associated with the condition of the feature, an assessment of a condition of the feature of the second plurality of features.

6. The computer-implemented method of claim 1 , further comprising: associating, by the processor, a data object associated with one or more data records in a database with a representation of the feature in the second virtual model.

7. The computer-implemented method of claim 6 , further comprising: populating, by the processor, a data records overlay of the second virtual model with records data included in the one or more data records.

8. A system, comprising:

a processor; and

a memory, storing computer executable instructions, that when executed by the

processor, causes the processor to perform operations comprising:

generating, based at least in part on one or more images of a physical object and within a virtual environment, a first virtual model of the physical object, wherein the first virtual model is comprised of a first plurality of features;

displaying the first virtual model on a display of a user electronic device;

receiving, and in the virtual environment, an annotation, at a virtual coordinate of a feature of the first plurality of features;

translating the received virtual coordinate into Global Positioning System (GPS) coordinates corresponding to a real-world location of the feature;

generating a notification comprising the GPS coordinates and transmitting the notification to a remote imaging vehicle;

capturing via the remote imaging vehicle, at least one image of the feature at the real-world location and receiving the at least one captured image from the remote imaging vehicle;

generating a second virtual model of the physical object by updating the first virtual model with the at least one captured image, wherein the second virtual model comprises a second plurality of features; and

displaying the second virtual model on the display.

9. The system of claim 8 , wherein the operations further comprise:

receiving, and in the virtual environment, an input associated with a feature of the second plurality of features;

generating, based on the received input, an assessment of a condition of the feature of the second plurality of features; and

calculating a risk score based at least in part on the generated assessment.

10. The system of claim 9 , wherein the operations further comprise updating one or more terms of a user policy associated with the physical object based at least in part on the risk score.

11. The system of claim 9 , wherein the operations further comprise determining whether to approve insuring the physical object based at least in part on the risk score.

12. The system of claim 8 , wherein the second virtual model further comprises a data records overlay, and the operations further comprise:

determining records information associated with the feature of the second plurality of features; and

populating the data records overlay of the second virtual model with the records information.

13. The system of claim 12 , wherein the records information comprises one or more of:

an object age;

an address;

a market value;

a business name;

an owner name;

an agent affiliation;

zoning information; or

historical claims data.

14. A non-transitory computer-readable storage medium storing instructions, that when executed by a processor causes the processor to perform operations comprising:

generating, based at least in part on one or more images of a physical object and within a virtual environment, a first virtual model of the physical object, wherein the first virtual model is comprised of a first plurality of features;

displaying the first virtual model on a display of a user electronic device;

receiving, and in the virtual environment, an annotation, at a virtual coordinate of a feature of the first plurality of features;

receiving an annotation at a virtual coordinate in the virtual environment of a feature of the first plurality of features;

translating the received virtual coordinate into Global Positioning System (GPS) coordinates corresponding to a real-world location of the feature;

generating a notification comprising the GPS coordinates and transmitting the notification to a remote imaging vehicle;

capturing via the remote imaging vehicle, at least one image of the feature at the real-world location and receiving the at least one captured image from the remote imaging vehicle;

generating a second virtual model of the physical object by updating the first virtual model with the at least one captured image, wherein the second virtual model comprises a second plurality of features; and

displaying the second virtual model on the display.

15. The non-transitory computer-readable storage medium of claim 14 , the operations further comprising: generating a visual overlay on the second virtual model and creating a visual emphasis of the feature of the second plurality of features utilizing the generated visual overlay.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the visual emphasis includes a condition of the feature of the second plurality of features.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the annotation comprises an indication to assess a condition of the feature of the first plurality of features.

18. The non-transitory computer-readable storage medium of claim 17 , wherein

the operations further comprise; determining, based at least in part on the indication, that an image of the one or more images has an image resolution less than an image resolution threshold.

19. The non-transitory computer-readable storage medium of claim 14 , wherein updating the first virtual model comprises replacing, an image of the one or more images with the at least one captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2024
From: LITTLE, REBECCA A.; NUSSBAUM, BRYAN A.; STOCKWEATHER, DEANNA L.; SUMMERS, NATHAN C.; HO, AN; KING, VICKI
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 066636/0056 →
Continuity (2)
Continuation 16163146 · Oct 17, 2018
Related Publication 20230260052A1 · Aug 17, 2023
References Cited (152)
US 6807367B1 · Durlach · 2004 [cited by applicant]
US 6836270B2 · Du · 2004 [cited by applicant]
US 7027054B1 · Cheiky et al. · 2006 [cited by applicant]
US 8718612B2 · Calman et al. · 2014 [cited by applicant]
US 8761811B2 · Alonzo · 2014 [cited by applicant]
US 8902288B1 · Fan et al. · 2014 [cited by applicant]
US 9082015B2 · Christopulos et al. · 2015 [cited by applicant]
US 9160993B1 · Lish et al. · 2015 [cited by applicant]
US 9736308B1 · Wu et al. · 2017 [cited by applicant]
US 9875509B1 · Harvey et al. · 2018 [cited by applicant]
US 9959581B2 · Pershing · 2018 [cited by applicant]
US 10157502B2 · Montgomerie et al. · 2018 [cited by applicant]
US 10163271B1 · Powers et al. · 2018 [cited by applicant]
US 10242400B1 · Eraker et al. · 2019 [cited by applicant]
US 10242501B1 · Pusch et al. · 2019 [cited by applicant]
US 10346924B1 · Engelhorn et al. · 2019 [cited by applicant]
US 10373387B1 · Fields et al. · 2019 [cited by applicant]
US 10395173B1 · Heidenreich et al. · 2019 [cited by applicant]
US 10521865B1 · Spader et al. · 2019 [cited by applicant]
US 10656720B1 · Holz · 2020 [cited by applicant]
US 10721280B1 · Heppner et al. · 2020 [cited by applicant]
US 10824867B1 · Assam · 2020 [cited by applicant]
US 10873724B1 · Little et al. · 2020 [cited by applicant]
US 11049072B1 · Little et al. · 2021 [cited by applicant]
US 11086315B2 · Dundorf et al. · 2021 [cited by applicant]
US 11651555B2 · Semih et al. · 2023 [cited by applicant]
US 20020196202A1 · Bastian et al. · 2002 [cited by applicant]
US 20050251427A1 · Dorai et al. · 2005 [cited by applicant]
US 20070067104A1 · Mays · 2007 [cited by applicant]
US 20070260401A1 · Sydor et al. · 2007 [cited by applicant]
US 20090222742A1 · Pelton et al. · 2009 [cited by applicant]
US 20120156668A1 · Zelin · 2012 [cited by applicant]
US 20120231814A1 · Calman et al. · 2012 [cited by applicant]
US 20120232787A1 · Kunath et al. · 2012 [cited by applicant]
US 20130215116A1 · Siddique et al. · 2013 [cited by applicant]
US 20140267410A1 · Fein et al. · 2014 [cited by applicant]
US 20140279572A1 · Coats et al. · 2014 [cited by applicant]
US 20140279573A1 · Coats et al. · 2014 [cited by applicant]
US 20140280269A1 · Schultz et al. · 2014 [cited by applicant]
US 20140280644A1 · Cronin · 2014 [cited by applicant]
US 20140370958A1 · Lutnick · 2014 [cited by applicant]
US 20150020003A1 · Karam · 2015 [cited by applicant]
US 20150025915A1 · Lekas · 2015 [cited by applicant]
US 20150206218A1 · Banerjee et al. · 2015 [cited by applicant]
US 20150350604A1 · Roy et al. · 2015 [cited by applicant]
US 20160035140A1 · Bickerstaff et al. · 2016 [cited by applicant]
US 20160048934A1 · Gross · 2016 [cited by examiner]
US 20160092959A1 · Gross · 2016 [cited by applicant]
US 20160148285A1 · Kalata · 2016 [cited by applicant]
US 20160267610A1 · Corbett et al. · 2016 [cited by applicant]
US 20160313736A1 · Schultz et al. · 2016 [cited by applicant]
US 20160314545A1 · Jessen · 2016 [cited by examiner]
US 20170032466A1 · Feldman et al. · 2017 [cited by applicant]
US 20170032574A1 · Sugaya · 2017 [cited by applicant]
US 20170053455A1 · Chen et al. · 2017 [cited by applicant]
US 20170076408A1 · D'Souza et al. · 2017 [cited by applicant]
US 20170098309A1 · Michel · 2017 [cited by applicant]
US 20170108922A1 · Terahata · 2017 [cited by applicant]
US 20170124396A1 · Todeschini et al. · 2017 [cited by applicant]
US 20170173466A1 · Fahmie · 2017 [cited by applicant]
US 20170199855A1 · Fishbeck · 2017 [cited by applicant]
US 20170205885A1 · Schpok · 2017 [cited by applicant]
US 20170256096A1 · Faaborg et al. · 2017 [cited by applicant]
US 20170278289A1 · Marino et al. · 2017 [cited by applicant]
US 20170280188A1 · Mullins · 2017 [cited by applicant]
US 20170329329A1 · Kamhi et al. · 2017 [cited by applicant]
US 20180005161A1 · Cong et al. · 2018 [cited by applicant]
US 20180017791A1 · Beckman · 2018 [cited by applicant]
US 20180046062A1 · Fisher et al. · 2018 [cited by applicant]
US 20180089763A1 · Okazaki · 2018 [cited by examiner]
US 20180143023A1 · Bjorke et al. · 2018 [cited by applicant]
US 20180144558A1 · Priest · 2018 [cited by applicant]
US 20180158156A1 · Dintenfass · 2018 [cited by examiner]
US 20180322702A1 · Djajadiningrat · 2018 [cited by applicant]
US 20180336373A1 · Deenadayal · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20180367869A1 · Gray · 2018 [cited by applicant]
US 20180374276A1 · Powers et al. · 2018 [cited by applicant]
US 20190004639A1 · Faulkner · 2019 [cited by applicant]
US 20190096217A1 · Pourmohammad et al. · 2019 [cited by applicant]
US 20190098255A1 · Bergmann et al. · 2019 [cited by applicant]
US 20190108578A1 · Spivack et al. · 2019 [cited by applicant]
US 20190130656A1 · Gebbie et al. · 2019 [cited by applicant]
US 20190146577A1 · Rokade et al. · 2019 [cited by applicant]
US 20190171944A1 · Lu · 2019 [cited by applicant]
US 20190171986A1 · Beznos · 2019 [cited by examiner]
US 20190180506A1 · Gebbie et al. · 2019 [cited by applicant]
US 20190270015A1 · Li et al. · 2019 [cited by applicant]
US 20200005538A1 · Neeter · 2020 [cited by applicant]
US 20230031290A1 · Little et al. · 2023 [cited by applicant]
US 20230153916A1 · Little · 2023 [cited by applicant]
US 20230237432A1 · Little · 2023 [cited by applicant]
US 20230245412A1 · Little · 2023 [cited by applicant]
US 20230421725A1 · Little · 2023 [cited by applicant]
AU 2008335471 · 2009 [cited by applicant]
AU 2010229096 · 2011 [cited by applicant]
AU 2013401486A1 · 2016 [cited by applicant]
AU 2016100270 · 2016 [cited by applicant]
CA 2796065 · 2011 [cited by applicant]
CA 2770933 · 2012 [cited by applicant]
CA 2809696 · 2014 [cited by applicant]
CA 3022235 · 2019 [cited by applicant]
CA 3000452 · 2019 [cited by applicant]
CA 3078530 · 2019 [cited by applicant]
CA 3089307A1 · 2019 [cited by applicant]
CA 3033605 · 2019 [cited by applicant]
CA 2669409A1 · 2019 [cited by applicant]
CA 3104549 · 2019 [cited by applicant]
CA 3114190A1 · 2020 [cited by applicant]
CA 2930412A1 · 2021 [cited by applicant]
EP 0930755A1 · 1999 [cited by applicant]
EP 3978874A1 · 2022 [cited by applicant]
JP 4479052 · 2010 [cited by applicant]
WO WO2016040376A1 · 2016 [cited by applicant]
WO WO2016148753A1 · 2016 [cited by applicant]
Final Office Action dated Jul. 31, 2024 for related U.S. Appl. No. 18/188,193, (39 pages). [cited by applicant]
Final Office Action for related U.S. Appl. No. 18/188,193 mailed Jul. 31, 2024, Little, et al, “Method and System for Curating a Virtual Model for Feature Identification” (39 pages). [cited by applicant]
Office Action for related U.S. Appl. No. 18/244,507, mailed Aug. 27, 2024, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 13 Pages. [cited by applicant]
Final Office Action for related U.S. Appl. No. 18/244,507, dated Feb. 5, 2025 (13 Pages). [cited by applicant]
Non-Final Office Action for related U.S. Appl. No. 18/188,193, dated Jan. 17, 2025 (42 pages). [cited by applicant]
A New Approach to Real Estate Risk, 2005, 29 pgs. [cited by applicant]
Advisory Action and AFCP Decision for U.S. Appl. No. 16/395,932, mailed on Jan. 12, 2021, Little, “Asynchronous Virtual Collaboration Environments”, 7 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,099, mailed on Jan. 15, 2020, Little, “Method and System for Curating a Virtual Model for Feature Identification”, 22 pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/955,007 mailed on Mar. 24, 2023, Little, “Asymmetric Collaborative Virtual Environments”, 23 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,146, mailed on Jul. 9, 2021, Little, “Method and System for Identifying Conditions of Features Represented in a Virtual Model”, 20 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/242,206, mailed on Jan. 27, 2020, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 9 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/397,407, mailed on Oct. 5, 2020, Little, “Asymmetric Collaborative Virtual Environments”, 12 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/395,932, mailed on Nov. 2, 2020, Little, “Asynchronous Virtual Collaboration Environments”, 13 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,146, mailed on Nov. 24, 2021, Little, “Method and System for Identifying Conditions of Features Represented in a Virtual Model”, 19 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,146, mailed on Dec. 19, 2019, Little, “Method and System for Identifying Conditions of Features Represented in a Virtual Model”, 24 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,200, mailed on Dec. 30, 2019, Little, “Predictive Analytics for Assessing Property Using External Data”, 21 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/949,543, mailed on Feb. 17, 2023, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 8 Pages. [cited by applicant]
Office Action dated Feb. 22, 2021 for U.S. Appl. No. 16/163,146 “Method and System for Identifying Conditions of Features Represented in a Virtual Model” Little, 36 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,200, mailed on Mar. 1, 2021, Little, “Predictive Analytics for Assessing Property Using External Data”, 28 pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/308,757, mailed on Mar. 10, 2022, Little, “Asymmetric Collaborative Virtual Environments”, 35 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,200, mailed on Mar. 11, 2022, Little, “Predictive Analytics for Assessing Property Using External Data”, 24 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,146, mailed on Mar. 17, 2022, Little, “Method and System for Identifying Conditions of Features Represented in a Virtual Model”, 19 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/395,932, mailed on Apr. 17, 2020, Little, “Asynchronous Virtual Collaboration Environments”, 10 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,099, mailed on Apr. 29, 2020, Little, “Method and System for Curating a Virtual Model for Feature Identification”, 27 pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/308,891, mailed on Apr. 7, 2022, Little, “Method and System for Curating a Virtual Model for Feature Identification”, 29 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/242,206, mailed on May 19, 2020, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 9 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,200, mailed on Jul. 10, 2020, Little, “Predictive Analytics for Assessing Property Using External Data”, 26 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/242,206, mailed on Jul. 18, 2019, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 9 pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/308,891, mailed on Jul. 18, 2022, Little, “Method and System for Curating a Virtual Model for Feature Identification”, 35 Pages. [cited by applicant]
Final Office Action dated Jul. 2, 2020 for U.S. Appl. No. 16/163,146 “Method and System for Identifying Conditions of Features Represented in a Virtual Model” Little, 32 pages. [cited by applicant]
OA for U.S. Appl. No. 16/163,200, mailed on Jul. 26, 2021, Little, “Predictive Analytics for Assessing Property Using External Data”, 10 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/949,543, mailed on Sep. 22, 2022, Little, “Virtual Environment Generation for Collaborative Building Assessment”, 13 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/163,099, mailed on Sep. 28, 2020, Little, “Method and System for Curating a Virtual Model for Feature Identification”, 31 pages. [cited by applicant]
Porter, eat al., “Harvard Business Review Why Every Organization Needs an Augmented Reality Strategy”, 2017, 28 pages. [cited by applicant]
Property Data Assessment—Real Estate Assessment API, retrieved at << https://batchleads.io/batchdata-api>>, 2017, 9 pages. [cited by applicant]
Virtual Technology: The Future is now for the Commercial Real Estate Industry, 2017, 17 pgs. [cited by applicant]
Office Action for U.S. Appl. No. 18/154,215, dated Sep. 30, 2024, to Little, entitled “Predictive Analytics for Assessing Property Using External Data” (14 pages). [cited by applicant]