IP Library Granted Patent US 12,705,673
Granted Patent B2
US 12,705,673 · App. 18/156,261 · Granted Aug 11, 2026

Systems and method for using object recognition to facilitate the collection of insurance information

Inventors: Amy Engelhorn (Normal, IL); Kathryn E. Knarr (Bloomington, IL)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G06Q40/08G06F18/22G06V20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,705,673
App. No.
18/156,261
Filed
Jan 18, 2023
Granted
Aug 11, 2026
Kind
B2
Art Unit
3693
USPC
705/4
Abstract

A computer-implemented method includes providing a user an electronic form with a field associated, processing an image of the object that the user submitted via a user-interactive control of the form to identify physical features of the object, using the identified physical features to determine two or more possible types of the object, determining confidence levels associated with the possible type(s), providing to the user indications of the possible type(s) and a request for confirmation of a determined type of the object, and, in response to receiving confirmation of the determined type from the user, causing the client device to automatically populate the field of the electronic form in accordance with the determined type.

Claims (46)

1 . A computer-implemented method for facilitating response accuracy via user interface functionality of an electronic form that includes one or more fields, the computer-implemented method comprising:

providing, by one or more processors and via a network, the electronic form to a user, wherein the electronic form includes a request for an insurance quote, wherein providing the electronic form to the user includes causing a client device of the user to (i) render the electronic form for display to the user in a user interface provided by a software application executing on the client device and (ii) display, in the user interface, a user-interactive control that is associated with a particular field of the one or more fields, wherein the particular field is associated with a query for which an accurate response depends upon a type of an object associated with a structure, and wherein determining the insurance quote depends upon the type of the object;

receiving an image of the object that the user submitted via the user-interactive control and the network;

processing, by one or more processors, the image of the object according to an object recognition technique to identify physical features of the object;

using, by one or more processors, the identified physical features to determine two or more possible types of the object, at least by comparing the physical features to physical features known to correspond to the two or more possible types of the object;

determining, by one or more processors, correlation metrics associated with the two or more possible types of the object;

determining, by one or more processors, that the correlation metrics exceed a threshold correlation metric;

providing to the user indications of the two or more possible types of the object, and a request for confirmation of a determined type of the object; and

in response to receiving confirmation of the determined type of the object from the user, causing the client device to automatically populate the particular field of the electronic form in the user interface in accordance with the determined type.

2 . The computer-implemented method of claim 1 , wherein causing the client device to automatically populate the first field includes causing the client device to automatically populate the first field with a text indication of the determined type.

3 . The computer-implemented method of claim 1 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is a particular type of object.

4 . The computer-implemented method of claim 1 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is not a particular type of object.

5 . The computer-implemented method of claim 1 , wherein the software application is a web browser application, and wherein providing the electronic form to the user includes providing, to the client device, software instructions to be interpreted by the web browser application.

6 . The computer-implemented method of claim 5 , wherein providing the software instructions includes providing scripting language instructions to be interpreted by the web browser application.

7 . The computer-implemented method of claim 1 , wherein the user is a policyholder or potential policyholder.

8 . A tangible, non-transitory computer-readable medium for facilitating response accuracy via user interface functionality of an electronic form that includes one or more fields, the tangible, non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

provide a user, via a network, the electronic form to a user, wherein the electronic form includes a request for an insurance quote, wherein providing the electronic form to the user includes causing a client device of the user to (i) render the electronic form for display to the user in a user interface provided by a software application executing on the client device and (ii) display, in the user interface, a user-interactive control that is associated with a particular field of the one or more fields, wherein the particular field is associated with a query for which an accurate response depends upon a type of an object associated with a structure, and wherein determining the insurance quote depends upon the type of the object;

receive an image of the object that the user submitted via the user-interactive control and the network;

process the image of the object according to an object recognition technique to identify physical features of the object;

use the identified physical features to determine two or more possible types of the object, at least by comparing the physical features to physical features known to correspond to the two or more possible types of the object;

determine correlation metrics associated with the two or more possible types of the object;

determine that the correlation metrics exceed a threshold correlation metric;

provide to the user indications of the two or more possible types of the object, and a request for confirmation of a determined type of the object; and

in response to receiving confirmation of the determined type of the object from the user, cause the client device to automatically populate the particular field of the electronic form in the user interface in accordance with the determined type.

9 . The tangible, non-transitory computer-readable medium of claim 8 , wherein causing the client device to automatically populate the first field includes causing the client device to automatically populate the first field with a text indication of the determined type.

10 . The tangible, non-transitory computer-readable medium of claim 8 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is a particular type of object.

11 . The tangible, non-transitory computer-readable medium of claim 8 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is not a particular type of object.

12 . The tangible, non-transitory computer-readable medium of claim 8 , wherein the software application is a web browser application, and wherein providing the electronic form to the user includes providing, to the client device, software instructions to be interpreted by the web browser application.

13 . The tangible, non-transitory computer-readable medium of claim 12 , wherein providing the software instructions includes providing scripting language instructions to be interpreted by the web browser application.

14 . The tangible, non-transitory computer-readable medium of claim 8 , wherein the user is a policyholder or potential policyholder.

15 . A system for facilitating response accuracy via user interface functionality of an electronic form that includes one or more fields, the system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the one or more processors to:

provide, via a network, the electronic form to a user, wherein the electronic form includes a request for an insurance quote, wherein providing the electronic form to the user includes causing a client device of the user to (i) render the electronic form for display to the user in a user interface provided by a software application executing on the client device and (ii) display, in the user interface, a user-interactive control that is associated with a particular field of the one or more fields, wherein the particular field is associated with a query for which an accurate response depends upon a type of an object associated with a structure, and wherein determining the insurance quote depends upon the type of the object;

receive an image of the object that the user submitted via the user-interactive control and the network;

process the image of the object according to an object recognition technique to identify physical features of the object;

use the identified physical features to determine two or more possible types of the object, at least by comparing the physical features to physical features known to correspond to the two or more possible types of the object;

determine correlation metrics associated with the two or more possible types of the object;

determine that the correlation metrics exceed a threshold correlation metric;

provide to the user indications of the two or more possible types of the object, and a request for confirmation of a determined type of the object; and

in response to receiving confirmation of the determined type of the object from the user, cause the client device to automatically populate the particular field of the electronic form in the user interface in accordance with the determined type.

16 . The system of claim 15 , wherein causing the client device to automatically populate the first field includes causing the client device to automatically populate the first field with a text indication of the determined type.

17 . The system of claim 15 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is a particular type of object.

18 . The system of claim 15 , wherein using the identified physical features to determine the two or more possible types of the object includes determining that the object is not a particular type of object.

19 . The system of claim 15 , wherein the software application is a web browser application, and wherein providing the electronic form to the user includes providing, to the client device, software instructions to be interpreted by the web browser application.

20 . The system of claim 19 , wherein providing the software instructions includes providing scripting language instructions to be interpreted by the web browser application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2023
From: ENGELHORN, AMY; KNARR, KATHRYN E.
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 062545/0526 →
Continuity (5)
Continuation 17066841 · Oct 9, 2020
Continuation 15686339 · Aug 25, 2017
Continuation 14560411 · Dec 4, 2014
Provisional Application 62044607 · Sep 2, 2014
Related Publication 20230162290A1 · May 25, 2023
References Cited (48)
US 5223844A · Mansell · 1993 [cited by examiner]
US 5408411A · Nakamura · 1995 [cited by examiner]
US 7899591B2 · Shah · 2011 [cited by examiner]
US 8401878B2 · Stender et al. · 2013 [cited by applicant]
US 8494227B2 · Prokoski · 2013 [cited by examiner]
US 8527357B1 · Ganesan · 2013 [cited by examiner]
US 8712893B1 · Brandmaier · 2014 [cited by examiner]
US 9495659B2 · Shanken · 2016 [cited by examiner]
US 9842310B2 · Lekas · 2017 [cited by examiner]
US 10163162B1 · Devereaux · 2018 [cited by examiner]
US 10311302B2 · Kottenstette et al. · 2019 [cited by applicant]
US 10366288B1 · Kottenstette et al. · 2019 [cited by applicant]
US 10528925B2 · Roach · 2020 [cited by examiner]
US 10572944B1 · Brandmaier · 2020 [cited by examiner]
US 10580075B1 · Brandmaier · 2020 [cited by examiner]
US 10643072B2 · Kottenstette et al. · 2020 [cited by applicant]
US 11151378B2 · Kottenstette et al. · 2021 [cited by applicant]
US 11210552B2 · Kossyk et al. · 2021 [cited by applicant]
US 11222426B2 · Richter et al. · 2022 [cited by applicant]
US 11232150B2 · Vianello et al. · 2022 [cited by applicant]
US 11367265B2 · Vianello et al. · 2022 [cited by applicant]
US 11556996B1 · Davis · 2023 [cited by examiner]
US 20040233461A1 · Armstrong · 2004 [cited by examiner]
US 20060075330A1 · Guido · 2006 [cited by examiner]
US 20070127816A1 · Balslev · 2007 [cited by examiner]
US 20090193055A1 · Kuberka · 2009 [cited by examiner]
US 20100174564A1 · Stender · 2010 [cited by examiner]
US 20110090075A1 · Armitage · 2011 [cited by examiner]
US 20120231424A1 · Calman · 2012 [cited by examiner]
US 20130073387A1 · Heath · 2013 [cited by examiner]
US 20130096938A1 · Stueckemann · 2013 [cited by examiner]
US 20130290036A1 · Strange · 2013 [cited by examiner]
US 20130297353A1 · Strange · 2013 [cited by examiner]
US 20140114691A1 · Pearce · 2014 [cited by examiner]
US 20140129261A1 · Bothwell · 2014 [cited by examiner]
US 20140201126A1 · Zadeh · 2014 [cited by examiner]
US 20140222444A1 · Cerello · 2014 [cited by examiner]
US 20140244317A1 · Roberts · 2014 [cited by examiner]
US 20140314276A1 · Wexler · 2014 [cited by examiner]
US 20150016712A1 · Rhoads · 2015 [cited by examiner]
US 20150025914A1 · Lekas · 2015 [cited by examiner]
Intelligent Transportation System Performance Analysis of Indoor and Outdoor Internet of Vehicle (IoV) Applications Towards 5G, IEEE (Year: 2024). [cited by examiner]
Manipulating decision making of typical agents, IEEE (Year: 2014). [cited by examiner]
McKinsey Global Initiative on AI (Year 2017). [cited by applicant]
Roof Report from Automatically Generated 3D Building Models by straight skeleton computation (Year: 2018). [cited by applicant]
Information Extraction From Remote Sensing Images for Flood Monitoring and Damage Evaluation (Year: 2012). [cited by applicant]
“A storage subsystem for image and records management” (Year: 1993). [cited by applicant]
“Enhancing Workflow Automation in Insurance Underwriting Processes with Web Services and Alerts” (Year: 2007). [cited by applicant]