IP Library › Granted Patent US 12,315,316
Granted Patent B2
US 12,315,316 · App. 18/409,437 · Granted May 27, 2025

Systems and methods for modeling and simulation in vehicle forensics

Inventors: Alexander Cardona (Gilbert, AZ); Jerome Scott Trayer (Mesa, AZ); An Ho (Watertown, MA)
Assignee: State Farm Mutual Automobile Insurance Company
G07C5/0841G06F30/20G06F40/205G07C5/008G08G1/0137G08G1/205G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,316
App. No.
18/409,437
Granted
May 27, 2025
Kind
B2
Abstract

An autonomous vehicle (AV) including a vehicle body, and a vehicle computing device is provided. The vehicle computing device includes a processor in communication with a memory device. The processor is configured to identify a time and a geographic location of a traffic collision involving the AV, retrieve map data and contextual data associated with the time and the geographic location of the traffic collision, retrieve vehicle telematics data collected by sensors coupled to the vehicle body, determine for each of a plurality of moments in time during the traffic collision a position and an orientation of the AV during the traffic collision, generate a simulation of the traffic collision including a representation of the AV based upon the map data, the contextual data, and the vehicle telematics data, and provide content to enable display of the simulation on a display device.

Claims (46)

1. A computing device comprising at least one processor and at least one memory device in communication therewith, the at least one processor configured to:

receive audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;

retrieve vehicle telematics data collected by sensors of the AV;

verify a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;

determine, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and

generate a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and

provide content to enable display of the simulation on a display device.

2. The computing device of claim 1 , wherein the at least one processor is further configured to:

retrieve map data and contextual data associated with the time and the geographic location of the traffic collision; and

generate the simulation further based upon the retrieved map data and contextual data.

3. The computing device of claim 1 , wherein the at least one processor is further configured to generate the simulation of the traffic collision based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by one or more of the sensors or from third-party providers, or physics data.

4. The computing device of claim 1 , wherein the at least one processor is further configured to:

receive the audio data via a microphone in communication with the at least one processor; and

parse the audio data for phrases describing the traffic collision.

5. The computing device of claim 4 , wherein the received audio data is received as an audio signal, and the at least one processor is further configured to convert the audio signal into text.

6. The computing device of claim 5 , wherein the at least one processor is further configured to cause the text to be displayed on the display device.

7. The computing device of claim 4 , wherein the at least one processor is further configured to analyze the parsed audio data, and identify inconsistent phrases by comparing the inconsistent phrases to the vehicle telematics data or other phrases obtained from the parsed audio data to determine that the inconsistent phrases are not consistent with the telematics data or other phrases obtained from the parsed audio data.

8. The computing device of claim 7 , wherein the at least one processor is further configured to determine whether to use a phrase to generate the simulation based upon whether the phrase is identified as an inconsistent phrase.

9. At least one non-transitory computer-readable media having computer-executable instructions embodied thereon, wherein when executed by at least one processor in communication with at least one memory device, the computer-executable instructions cause the at least one processor to:

receive audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;

retrieve vehicle telematics data collected by sensors of the AV;

verify a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;

determine, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and

generate a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and

provide content to enable display of the simulation on a display device.

10. The at least one non-transitory computer-readable of claim 9 , wherein the instructions further cause the at least one processor to:

retrieve map data and contextual data associated with the time and the geographic location of the traffic collision; and

generate the simulation further based upon the retrieved map data and contextual data.

11. A computer-implemented method for collecting vehicle forensics implemented using at least one processor in communication with at least one memory device, the computer-implemented method comprising:

receiving audio data relating to a traffic collision involving an autonomous vehicle (AV), the audio data identifying a time and geographic location of the AV;

retrieving vehicle telematics data collected by sensors of the AV;

verifying a time of the traffic collision provided in the audio data based upon the vehicle telematics data, the time of the traffic collision including a time period starting before a collision event of the traffic collision and ending after the collision event;

determining, based upon the retrieved vehicle telematics data and the received audio data, for each of a plurality of moments in time during the traffic collision, a position and an orientation of the AV during the traffic collision; and

generating a simulation of the traffic collision including a representation of the AV based upon the determined position and orientation of the AV for each of the plurality of moments in time; and

providing content to enable display of the simulation on a display device.

12. The computer-implemented method of claim 11 , further comprising:

retrieving map data and contextual data associated with the time and the geographic location of the traffic collision; and

generating the simulation further based upon the retrieved map data and contextual data.

13. The computer-implemented method of claim 11 , further comprising:

receiving the audio data via a microphone in communication with the at least one processor; and

parsing the audio data for phrases describing the traffic collision.

14. The computer-implemented method of claim 13 , wherein the received audio data is received as an audio signal, and the computer-implemented further comprises converting the audio signal into text.

15. The computer-implemented method of claim 14 , further comprising causing the text to be displayed on the display device.

16. The computer-implemented method of claim 13 , further comprising analyzing the parsed audio data, and identify inconsistent phrases by comparing the inconsistent phrases to the vehicle telematics data or other phrases obtained from the parsed audio data to determine that the inconsistent phrases are not consistent with the telematics data or other phrases obtained from the parsed audio data.

17. The computer-implemented method of claim 16 , further comprising determining whether to use a phrase to generate the simulation based upon whether the phrase is identified as an inconsistent phrase.

18. The computer-implemented method of claim 11 , further comprising generating the simulation of the traffic collision based further upon one or more of vehicle specification data stored in the memory device, photographic data collected by one or more of the sensors or from third-party providers, or physics data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2024
From: CARDONA, ALEXANDER; TRAYER, JEROME SCOTT; HO, AN
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 066145/0814 →
Continuity (4)
Continuation 17723124 · Apr 18, 2022
Continuation 16579045 · Sep 23, 2019
Provisional Application 62854779 · May 30, 2019
Related Publication 20240144749A1 · May 2, 2024
References Cited (53)
US 6246933B1 · Vaeza · 2001 [cited by applicant]
US 8260639B1 · Medina, III et al. · 2012 [cited by applicant]
US 8954226B1 · Binion et al. · 2015 [cited by applicant]
US 9691189B1 · Creath · 2017 [cited by applicant]
US 9830748B2 · Rosenbaum · 2017 [cited by applicant]
US 9934625B1 · Wahba et al. · 2018 [cited by applicant]
US 9990782B2 · Rosenbaum · 2018 [cited by applicant]
US 10223753B1 · Marlow et al. · 2019 [cited by applicant]
US 10246037B1 · Shea et al. · 2019 [cited by applicant]
US 10269190B2 · Rosenbaum · 2019 [cited by applicant]
US 10360601B1 · Adegan · 2019 [cited by applicant]
US 10467824B2 · Rosenbaum · 2019 [cited by applicant]
US 11094318B1 · Erickson et al. · 2021 [cited by applicant]
US 11157973B2 · Fuchs · 2021 [cited by applicant]
US 11227452B2 · Rosenbaum · 2022 [cited by applicant]
US 11407410B2 · Rosenbaum · 2022 [cited by applicant]
US 11524707B2 · Rosenbaum · 2022 [cited by applicant]
US 11594083B1 · Rosenbaum · 2023 [cited by applicant]
US 20030154009A1 · Basir et al. · 2003 [cited by applicant]
US 20040111301A1 · Wahlbin et al. · 2004 [cited by applicant]
US 20050278082A1 · Weekes · 2005 [cited by examiner]
US 20060092043A1 · Lagassey · 2006 [cited by applicant]
US 20080161996A1 · Chang et al. · 2008 [cited by applicant]
US 20080252485A1 · Lagassey · 2008 [cited by applicant]
US 20100030540A1 · Choi · 2010 [cited by examiner]
US 20150029308A1 · Han et al. · 2015 [cited by applicant]
US 20150149218A1 · Bayley et al. · 2015 [cited by applicant]
US 20150373308A1 · Chen · 2015 [cited by applicant]
US 20160358467A1 · Jeong · 2016 [cited by examiner]
US 20170017734A1 · Groh et al. · 2017 [cited by applicant]
US 20170053461A1 · Pal et al. · 2017 [cited by applicant]
US 20170372431A1 · Perl et al. · 2017 [cited by applicant]
US 20180316901A1 · Carrier · 2018 [cited by examiner]
US 20190050520A1 · Alvarez et al. · 2019 [cited by applicant]
US 20190072968A1 · Will, IV · 2019 [cited by examiner]
US 20190164229A1 · Sbianchi et al. · 2019 [cited by applicant]
US 20190232954A1 · Cinpinski et al. · 2019 [cited by applicant]
US 20200175861A1 · Wansa et al. · 2020 [cited by applicant]
US 20220092893A1 · Rosenbaum · 2022 [cited by applicant]
US 20220340148A1 · Rosenbaum · 2022 [cited by applicant]
US 20230060300A1 · Rosenbaum · 2023 [cited by applicant]
EP 3239686A1 · 2017 [cited by applicant]
EP 3578433B1 · 2020 [cited by applicant]
EP 3730375B1 · 2021 [cited by applicant]
EP 3960576A1 · 2022 [cited by applicant]
EP 4190659A1 · 2023 [cited by applicant]
EP 4190660A1 · 2023 [cited by applicant]
KR 2015059013A · 2015 [cited by examiner]
KR 101665553B1 · 2016 [cited by applicant]
KR 101689805B1 · 2016 [cited by applicant]
Dupuy et al., Generating a 3D Simulation of a Car Accident form a Written Description in Natural Language: the CarSim System, 2001, in Proceedings of the ACL 2001 Workshop on Temporal and Spatial Information Processing … [cited by examiner]
Dupuy et al., Generating a 3D Simulation of a Car Accident from a Written Description in Natural Language: the CarSim System, 2001, in Proceedings of the ACL 2001 Workshop on Temporal and Spatial Information Processing … [cited by applicant]
“Bringing vision context to insurance—Nexar's innovative AI dash cam app is a claims processing game-changer.” (2019). Nexar. Retrieved from https://www.getnexar.com/insurance/. [cited by applicant]