IP Library › Granted Patent US 12,645,763
Granted Patent B2
US 12,645,763 · App. 19/055,684 · Granted Jun 2, 2026

Synchronizing image data with either vehicle telematics data or infrastructure data pertaining to a road segment

Inventors: Alexander Cardona (Gilbert, AZ); Kip Wilson (Cave Creek, AZ); David Frank (Tempe, AZ); Phillip Michael Wilkowski (Gilbert, AZ); Nolan White (Chandler, AZ)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE
G06F18/251B60W30/08B60W30/182B60W40/06B60W40/105G01C21/3461G01C21/3484G01C21/3602G05D1/0088G05D1/43G06F3/0484G06F16/29G06F16/54G06F16/5866G06F16/587G06N20/00G06Q10/20G06Q50/26G06T7/20G06T7/292G06T7/70G06V20/52G06V20/54G06V20/56G06V20/58G06V20/584G06V20/588G07C5/008G08G1/0112G08G1/052G11B27/34H04N7/18H04W4/44B60W2030/082B60W2420/403B60W2420/408B60W2520/10B60W2552/20B60W2552/53B60W2556/50B60W2556/55G01C21/3815G01C21/3848G06Q10/10G06Q40/08G06T2207/30252H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,645,763
App. No.
19/055,684
Granted
Jun 2, 2026
Kind
B2
Abstract

Techniques for collecting, synchronizing, and displaying various types of data relating to a road segment enable, via one or more local or remote processors, servers, transceivers, and/or sensors, (i) enhanced and contextualized analysis of vehicle events by way of synchronizing different data types, relating to a monitored road segment, collected via various different types of data sources; (ii) enhanced and contextualized analysis of filed insurance claims pertaining to a vehicle incident at a road segment; (iii) advantageous machine learning techniques for predicting a level of risk assumed for a given vehicle event or a given road segment; (iv) techniques for accounting for region-specific driver profiles when controlling autonomous vehicles; and/or (v) improved techniques for providing a GUI to display collected data in a meaningful and contextualized manner.

Claims (44)

1 . A computer-implemented method for synchronizing road segment parameters with images of a road segment to facilitate improved analysis of information about the road segment, the computer-implemented method comprising:

time-synchronizing, by one or more processors, a set of images and a plurality of road segment parameters according to a common clock based upon an occurrence of a common event represented in the set of images and the plurality of road segment parameters;

storing, by the one or more processors, the set of images and the plurality of road segment parameters to be referenceable by a set of timestamps; and

analyzing, by the one or more processors, the set of images and the plurality of road segment parameters to identify one or more vehicle events, each vehicle event characterized by a subset of the set of images and a subset of the plurality of road segment parameters.

2 . The computer-implemented method of claim 1 , further comprising:

timestamping, by the one or more processors, the set of images according to a first clock associated with an image sensor and the plurality of road segment parameters according to a second clock associated with one or more vehicle sensors or one or more infrastructure devices disposed proximate to the road segment.

3 . The computer-implemented method of claim 1 , wherein detecting the plurality of road segment parameters comprises detecting both a first set of road segment parameters collected via one or more vehicle sensors and detecting a second set of road segment parameters collected via one or more infrastructure devices disposed proximate to the road segment.

4 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters comprises a parameter representing a position, a heading, or a speed of a vehicle in which one or more vehicle sensors are disposed.

5 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters includes a first position for a first vehicle and a second position for a second vehicle, and

wherein the computer-implemented method further comprises calculating a distance between the first vehicle and the second vehicle based upon the first position and the second position.

6 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters comprises a health status parameter representing a degree of health for an infrastructure component.

7 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters comprises an operational status of an infrastructure component.

8 . The computer-implemented method of claim 7 , wherein the infrastructure component is a traffic signal and wherein the operational status indicates that a streetlight was green, yellow, or red at a given time.

9 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters is collected by a radar device or a motion sensing device.

10 . The computer-implemented method of claim 1 , wherein the plurality of road segment parameters includes one or more parameters indicating an atmospheric condition at the road segment.

11 . The computer-implemented method of claim 1 , further comprising:

capturing, via an image sensor, the set of images of a road segment during a time-period; and

detecting, by one or more processors, the plurality of road segment parameters associated with the road segment during the time-period.

12 . The computer-implemented method of claim 2 , wherein time-synchronizing the set of images and the plurality of road segment parameters comprises:

analyzing the set of images to identify: (i) at least one image corresponding to the occurrence of the common event, and (ii) a first time period, according to the first clock associated with an image sensor, during which the common event took place;

analyzing the plurality of road segment parameters to identify: (i) at least one road segment parameter in the plurality of road segment parameters corresponding to the occurrence of the common event, and (ii) a second time period, according to the second clock associated with the one or more vehicle sensors or the one or more infrastructure devices, during which the common event took place; and

setting the set of timestamps for the plurality of road segment parameters according to the common clock such that a first subset of the set of timestamps for the at least one image matches a subset of the set of timestamps for the plurality of road segment parameters with respect to a time at which the common event took place.

13 . A system for synchronizing road segment parameters with images of a road segment to facilitate improved analysis or display of information about the road segment, the system comprising:

an image sensor configured to capture images of a road segment; and

a computer system coupled to the image sensor and a set of sensing devices, the computer system including one or more processors and computer-readable instructions that, when executed by the one or more processors, cause the computer system to:

time-synchronize a set of images and a plurality of road segment parameters according to a common clock based upon an occurrence of a common event represented in the set of images and the plurality of road segment parameters,

store the set of images and the plurality of road segment parameters to be referenceable by a set of timestamps, and

analyze the set of images and the plurality of road segment parameters to identify one or more vehicle events, each vehicle event characterized by a subset of the set of images and a subset of the plurality of road segment parameters.

14 . The system of claim 13 , wherein the computer-readable instructions, when executed, further cause the computer system to:

timestamp the set of images according to a first clock associated with the image sensor and the plurality of road segment parameters according to a second clock associated with one or more vehicle sensors or one or more infrastructure devices disposed proximate to the road segment.

15 . The system of claim 13 , wherein the plurality of road segment parameters comprises both a first set of parameters collected by one or more vehicle sensors and a second set of parameters collected by one or more infrastructure devices disposed proximate to the road segment.

16 . The system of claim 13 , wherein the plurality of road segment parameters comprises a parameter representing a position, a heading, or a speed of a vehicle in which one or more vehicle sensors of the set of sensing devices are disposed.

17 . The system of claim 13 , wherein the plurality of road segment parameters includes a first position for a first vehicle and a second position for a second vehicle, and

wherein the computer system further includes computer-readable instructions to cause the computer system to calculate a distance between the first vehicle and the second vehicle based upon the first position and the second position.

18 . The system of claim 13 , wherein the plurality of road segment parameters comprises: (i) a health status parameter representing a degree of health for an infrastructure component or (ii) an operational status of the infrastructure component, and

wherein the infrastructure component is a radar device or a motion sensing device.

19 . The system of claim 13 , wherein causing the computer system to time-synchronize the set of images and the plurality of road segment parameters comprises causing the computer system to:

analyze the set of images to identify: (i) at least one image corresponding to the occurrence of the common event, and (ii) a first time period, according to a first clock associated with the image sensor, during which the common event took place;

analyze the plurality of road segment parameters to identify: (i) at least one road segment parameter in the plurality of road segment parameters corresponding to the occurrence of the common event, and (ii) a second time period, according to a second clock associated with one or more vehicle sensors of the set of sensing devices or one or more infrastructure devices, during which the common event took place; and

set the set of timestamps for the plurality of road segment parameters according to the common clock such that a first subset of the set of timestamps for the at least one image matches a subset of the set of timestamps for the plurality of road segment parameters with respect to a time at which the common event took place.

20 . A tangible non-transitory machine-readable medium comprising instructions for synchronizing road segment parameters with images of a road segment to facilitate improved analysis or display of information about the road segment that, when executed, cause a machine to at least:

time-synchronize a set of images and a plurality of road segment parameters according to a common clock based upon an occurrence of a common event represented in the set of images and the plurality of road segment parameters;

store the set of images and the plurality of road segment parameters to be referenceable by a set of timestamps; and

analyze the set of images and the plurality of road segment parameters to identify one or more vehicle events, each vehicle event characterized by a subset of the set of images and a subset of the plurality of road segment parameters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2025
From: CARDONA, ALEXANDER; WILSON, KIP; FRANK, DAVID; WILKOWSKI, PHILLIP MICHAEL; WHITE, NOLAN
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 070248/0205 →
Continuity (6)
Continuation 18530550 · Dec 6, 2023
Continuation 17980788 · Nov 4, 2022
Continuation 17088402 · Nov 3, 2020
Provisional Application 63028732 · May 22, 2020
Provisional Application 63027628 · May 20, 2020
Related Publication 20250200146A1 · Jun 19, 2025
References Cited (131)
US 7389178B2 · Raz et al. · 2008 [cited by applicant]
US 7692724B2 · Arora et al. · 2010 [cited by applicant]
US 7792328B2 · Albertson et al. · 2010 [cited by applicant]
US 7843974B2 · Hannuksela · 2010 [cited by applicant]
US 8189679B2 · Tsukagoshi et al. · 2012 [cited by applicant]
US 8238726B2 · Takatsuji et al. · 2012 [cited by applicant]
US 8301007B2 · Ichimura · 2012 [cited by applicant]
US 8577703B2 · McClellan et al. · 2013 [cited by applicant]
US 8630768B2 · McClellan et al. · 2014 [cited by applicant]
US 8700255B2 · Joseph · 2014 [cited by applicant]
US 8729446B2 · Verfuerth · 2014 [cited by applicant]
US 9311271B2 · Wright · 2016 [cited by applicant]
US 9371099B2 · Lagassey · 2016 [cited by applicant]
US 9450632B1 · McElroy · 2016 [cited by examiner]
US 9633487B2 · Wright · 2017 [cited by applicant]
US 9633560B1 · Gao et al. · 2017 [cited by applicant]
US 9639804B1 · Palmer et al. · 2017 [cited by applicant]
US 9667693B2 · Schramm et al. · 2017 [cited by applicant]
US 9773281B1 · Hanson · 2017 [cited by applicant]
US 9830748B2 · Rosenbaum · 2017 [cited by applicant]
US 9881340B2 · Kenefick et al. · 2018 [cited by applicant]
US 9886841B1 · Nave et al. · 2018 [cited by applicant]
US 9910443B1 · Lee et al. · 2018 [cited by applicant]
US 9990782B2 · Rosenbaum · 2018 [cited by applicant]
US 10106156B1 · Nave et al. · 2018 [cited by applicant]
US 10178427B2 · Huang · 2019 [cited by applicant]
US 10192369B2 · Wright · 2019 [cited by applicant]
US 10198879B2 · Wright · 2019 [cited by applicant]
US 10269075B2 · Hsu-Hoffman et al. · 2019 [cited by applicant]
US 10269190B2 · Rosenbaum · 2019 [cited by applicant]
US 10354230B1 · Hanson et al. · 2019 [cited by applicant]
US 10467824B2 · Rosenbaum · 2019 [cited by applicant]
US 10719966B1 · Davis et al. · 2020 [cited by applicant]
US 10761542B1 · Fairfield et al. · 2020 [cited by applicant]
US 10789840B2 · Boykin et al. · 2020 [cited by applicant]
US 10977939B2 · Zhang et al. · 2021 [cited by applicant]
US 11062341B2 · Ramirez et al. · 2021 [cited by applicant]
US 11151870B2 · Xu · 2021 [cited by applicant]
US 11227452B2 · Rosenbaum · 2022 [cited by applicant]
US 11270583B2 · Kumar · 2022 [cited by applicant]
US 11407410B2 · Rosenbaum · 2022 [cited by applicant]
US 11524707B2 · Rosenbaum · 2022 [cited by applicant]
US 11526711B1 · Cardona · 2022 [cited by examiner]
US 11594083B1 · Rosenbaum · 2023 [cited by applicant]
US 20030093187A1 · Walker · 2003 [cited by applicant]
US 20040021669A1 · Fredlund · 2004 [cited by examiner]
US 20040233282A1 · Stavely · 2004 [cited by examiner]
US 20050100329A1 · Lao · 2005 [cited by examiner]
US 20060095199A1 · Lagassey · 2006 [cited by applicant]
US 20060119734A1 · Neel · 2006 [cited by examiner]
US 20060161713A1 · Belady · 2006 [cited by examiner]
US 20090009608A1 · Ohmura · 2009 [cited by examiner]
US 20100077109A1 · Yan · 2010 [cited by examiner]
US 20100174449A1 · Kim · 2010 [cited by applicant]
US 20100295960A1 · Furlan · 2010 [cited by examiner]
US 20110015971A1 · Hembury · 2011 [cited by applicant]
US 20110161116A1 · Peak et al. · 2011 [cited by applicant]
US 20110173015A1 · Chapman et al. · 2011 [cited by applicant]
US 20110218827A1 · Kenefick et al. · 2011 [cited by applicant]
US 20110320492A1 · Inghelbrecht · 2011 [cited by applicant]
US 20120123806A1 · Schumann, Jr. et al. · 2012 [cited by applicant]
US 20140025225A1 · Armitage et al. · 2014 [cited by applicant]
US 20140046701A1 · Steinberg et al. · 2014 [cited by applicant]
US 20140058761A1 · Freiberger et al. · 2014 [cited by applicant]
US 20140136414A1 · Abhyanker · 2014 [cited by applicant]
US 20140222321A1 · Petty et al. · 2014 [cited by applicant]
US 20140257637A1 · Sangameswaran et al. · 2014 [cited by applicant]
US 20150086175A1 · Lorenzetti · 2015 [cited by examiner]
US 20150309512A1 · Cudak et al. · 2015 [cited by applicant]
US 20160062992A1 · Chen · 2016 [cited by examiner]
US 20160065908A1 · Chang · 2016 [cited by examiner]
US 20160189305A1 · Bogovich et al. · 2016 [cited by applicant]
US 20170069001A1 · Scofield et al. · 2017 [cited by applicant]
US 20170116498A1 · Raveane · 2017 [cited by examiner]
US 20170191847A1 · Chintakindi et al. · 2017 [cited by applicant]
US 20170221149A1 · Hsu-Hoffman et al. · 2017 [cited by applicant]
US 20170267238A1 · Mimura et al. · 2017 [cited by applicant]
US 20170270612A1 · Howe et al. · 2017 [cited by applicant]
US 20180122234A1 · Nascimento et al. · 2018 [cited by applicant]
US 20180208195A1 · Hutcheson et al. · 2018 [cited by applicant]
US 20180285456A1 · Nichkawde · 2018 [cited by examiner]
US 20180339653A1 · Adams et al. · 2018 [cited by applicant]
US 20180359416A1 · Hold-Geoffroy · 2018 [cited by examiner]
US 20180365772A1 · Thompson et al. · 2018 [cited by applicant]
US 20190043273A1 · Cordova et al. · 2019 [cited by applicant]
US 20190164419A1 · Kumar · 2019 [cited by applicant]
US 20190197354A1 · Law · 2019 [cited by examiner]
US 20190362198A1 · Averbuch et al. · 2019 [cited by applicant]
US 20200148200A1 · Lerner · 2020 [cited by applicant]
US 20200160704A1 · Choi et al. · 2020 [cited by applicant]
US 20200168084A1 · Yang · 2020 [cited by examiner]
US 20200210336A1 · Bräutigam et al. · 2020 [cited by applicant]
US 20200226922A1 · Hahn · 2020 [cited by examiner]
US 20200312134A1 · Zhang et al. · 2020 [cited by applicant]
US 20200334762A1 · Carver et al. · 2020 [cited by applicant]
US 20210082054A1 · Rodriguez Bravo et al. · 2021 [cited by applicant]
US 20210142664A1 · Xu · 2021 [cited by applicant]
US 20210239478A1 · Mathai et al. · 2021 [cited by applicant]
US 20210312561A1 · Speasl et al. · 2021 [cited by applicant]
US 20220092893A1 · Rosenbaum · 2022 [cited by applicant]
US 20220126863A1 · Moustafa et al. · 2022 [cited by applicant]
US 20220340148A1 · Rosenbaum · 2022 [cited by applicant]
US 20230060300A1 · Rosenbaum · 2023 [cited by applicant]
US 20230113815A1 · Patt et al. · 2023 [cited by applicant]
US 20240104171A1 · Cardona · 2024 [cited by examiner]
CA 2567074C · 2013 [cited by applicant]
EP 2866230A1 · 2015 [cited by applicant]
EP 3239686A1 · 2017 [cited by applicant]
EP 3578433B1 · 2020 [cited by applicant]
EP 3730375B1 · 2021 [cited by applicant]
EP 3960576A1 · 2022 [cited by applicant]
EP 4190659A1 · 2023 [cited by applicant]
EP 4190660A1 · 2023 [cited by applicant]
JP 2004280348A · 2004 [cited by applicant]
WO WO2015058610A1 · 2015 [cited by applicant]
Google Inc., “Temporal Synchronization of Multiple Audio Signals”. Retrieved from the Internet at: <https://research.google.com/pubs/archive/42193.pdf> on Jan. 26, 2021. [cited by applicant]
Center for Computer Research in Music and Acoustics, Stanford University, “Clustering and Synchronizing Multi-Camera Video Via Landmark Cross-Correlation”. Retrieved from the Internet at: <https://ccrma.stanford.edu/˜nj… [cited by applicant]
ACM DL Digital Library, “Making a scene: alignment of complete sets of clips based on pairwise audio match”. Retrieved from the Internet at: <https://dl.acm.org/doi/10.1145/2324796.2324829> on Jan. 26, 2021. [cited by applicant]
U.S. Appl. No. 17/088,402, Synchronizing Image Data With Either Vehicle Telematics Data or Infrastructure Data Pertaining To a Road Segment, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,412, Analyzing Insurance Claims in Light of Detected Conditions Pertaining To a Road Segment, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,417, Risk Analysis for Vehicle Events and Road Segments Based on Detected Conditions Pertaining To the Road, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,424, Training a Machine-Learning Model Using Detected Conditions At a Road Segment, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,430, Providing a Gui to Enable Analysis of Time-Synchronized Data Sets Pertaining To a Road Segment, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,434, Accounting for Region-Specific Driver Profiles When Controlling Autonomous Vehicles, filed Nov. 3, 2020. [cited by applicant]
U.S. Appl. No. 17/088,393, Synchronizing Vehicle Telematics Data With Infrastructure Data Pertaining To a Road Segment, filed Nov. 3, 2020. [cited by applicant]
School of Computer Science, Carnegie Mellon University, “Synchronization for Multi-Perspective Videos in the Wild” Retrieved from the Internet at: <http://www.cs.cmu.edu/˜poyaoh/data/ICASSP_2017.pdf> on Oct. 6, 2020. [cited by applicant]
Google Inc., “Temporal Synchronization of Multiple Audio Signals”. Retrieved from the Internet at: <https://research.google.com/pubs/archive/42193.pdf> dated Jan. 26, 2021. [cited by applicant]
Center for Computer Research in Music and Acoustics, Stanford University, “Clustering and Synchronizing Multi-Camera Video Via Landmark Cross-Correlation”. Retrieved from the Internet at: <https://ccrma.stanford.edu/˜nj… [cited by applicant]
School of Computer Science, Carnegie Mellon University, “Synchronization for Multi-Perspective Videos in the Wild” Retrieved from the Internet: <http://www.cs.cmu.edu/˜poyaoh/data/ICASSP_2017.pdf> on Oct. 6, 2020. [cited by applicant]
ACM DL Digital Library, “Making a scene: alignment of complete sets of clips based on pairwise audio match”. Retrieved from the Internet at: <https://dl.acm.org/doi/10.1145/2324796.2324829> dated Jan. 26, 2021. [cited by applicant]
English Translation of “JP2004280348 A, Kurata et al., 2004” (Year: 2004). [cited by applicant]