IP Library Granted Patent US 10,019,858
Granted Patent B2
US 10,019,858 · App. 15/357,897 · Granted Jul 10, 2018

Vehicle event playback apparatus and methods

Inventors: Jason Palmer (Carlsbad, CA); Slaven Sljivar (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G07C5/12B60R1/00G07C5/0816G07C5/0841G11B27/10H04N5/935B60R2300/105B60R2300/301B60R2300/80G07C5/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,858
App. No.
15/357,897
Granted
Jul 10, 2018
Kind
B2
Abstract

Vehicle event data playback systems described herein may provide users means for reviewing events recorded by a vehicle event recorder. Circumstances relating to vehicle operation may be visually presented in these playback systems. Video playback from multiple recording devices may be synchronized with each other and/or with information related to the operation of the vehicle during the recorded events to affect a presentation of information related to operation of the vehicle. A user may be presented with many data types in graphical and/or intuitive arrangements.

Claims (29)

1. A method to synchronize vehicle operation information comprising:

receiving the vehicle operation information via output signals generated by a plurality of sensors, wherein the plurality of sensors is coupled with a vehicle, wherein the plurality of sensors includes a first sensor that generates a first output signal conveying a first operating parameter and a second sensor that generates a second output signal conveying a second operating parameter, wherein the first output signal is associated with first timing information, and wherein the second output signal is associated with second timing information;

detecting a first vehicle event based on the first output signal and the second output signal, the first vehicle event having a start time and an end time; and

responsive to detecting the first vehicle event, associating information from the first output signal and the second output signal generated during the first vehicle event to create a first event record, wherein the first timing information includes a first time-stamp that indicates the start time of the first vehicle event, wherein the second timing information includes a second time-stamp that indicates the start time of the first vehicle event, and wherein the first time-stamp does not coincide with the second time-stamp; and

synchronizing the information from the first output signal and the second output signal generated during the first vehicle event based on analysis of the first time-stamp and the second time-stamp, wherein synchronizing includes identifying and correlating corresponding information associated with one or more physical phenomena in the first output signal and the second output signal during the first vehicle event.

2. The method of claim 1 , wherein synchronizing the information includes searching for expected phenomena in the second output signal that indicate the start time of the first vehicle event, wherein the first timing information indicates one or more of a time of day the information was generated, an order in which the information was generated, a periodic timing of the generated information, and a continuous timing of the generated information.

3. The method of claim 1 , wherein the vehicle operation information includes one or more of vehicle safety information, vehicle event information, vehicle environment information, or vehicle subsystem information.

4. The method of claim 1 , wherein the first operating parameter is related to vehicle safety, and wherein vehicle safety information is received via output signals generated by one or more sensors included in an active safety system coupled with the vehicle.

5. The method of claim 4 , wherein the first vehicle event is detected based on the vehicle safety information received from the active safety system.

6. The method of claim 1 , further comprising causing a graphical user interface to present the synchronized vehicle operation information to a user.

7. The method of claim 6 , wherein a view of the graphical user interface includes one or more active safety system fields, the method further comprising causing the one or more active safety system fields to present information related to at least one of detections and alerts by an active safety system coupled with the vehicle, the active safety system fields presenting one or more of a textual, a numeric, or a graphical indication of information the active safety system communicates to a driver of the vehicle.

8. The method of claim 1 , wherein the first operating parameter is related to at least one of vehicle event information and vehicle environment information, the method further comprising receiving the at least one of vehicle event information and the vehicle environment information via output signals generated by one or more sensors included in a vehicle event recorder coupled with the vehicle.

9. The method of claim 1 , further comprising causing a graphical user interface to present the synchronized vehicle operation information to a user in real time during operation of the vehicle.

10. The method of claim 1 , wherein receiving includes receiving information from one or more sensors included in an active safety system sensor, a video camera, an accelerometer, a gyroscope, a geolocation sensor, a radar detector, an engine RPM sensor, a vehicle speedometer, a tilt sensor, or a braking sensor.

11. A vehicle event data playback apparatus for synchronizing vehicle operation information comprising:

one or more processors configured to synchronize vehicle operation information, wherein synchronizing the vehicle operation information comprises:

receive the vehicle operation information via output signals generated by a plurality of sensors, wherein the plurality of sensors is coupled with a vehicle, wherein the plurality of sensors includes a first sensor that generates a first output signal conveying a first operating parameter and a second sensor that generates a second output signal conveying a second operating parameter, wherein the first output signal is associated with first timing information, and wherein the second output signal is associated with second timing information;

detect a first vehicle event based on the first output signal and the second output signal, the first vehicle event having a start time and an end time; and

responsive to detecting the first vehicle event, associate information from the first output signal and the second output signal generated during the first vehicle event to create a first event record, wherein the first timing information includes a first time-stamp that indicates the start time of the first vehicle event, wherein the second timing information includes a second time-stamp that indicates the start time of the first vehicle event, and wherein the first time-stamp does not coincide with the second time-stamp; and

synchronize the information from the first output signal and the second output signal generated during the first vehicle event based on analysis of the first time-stamp and the second time-stamp, wherein synchronizing includes identifying and correlating corresponding information associated with one or more physical phenomena in the first output signal and the second output signal during the first vehicle event.

12. The vehicle event data playback apparatus of claim 11 , wherein the one or more processors are configured such that synchronizing includes searching for expected phenomena in the second output signal that indicate the start time of the first vehicle event, wherein the first timing information indicates one or more of a time of day the information was generated, an order in which the information was generated, a periodic timing of the generated information, and a continuous timing of the generated information.

13. The vehicle data playback apparatus of claim 11 , wherein the one or more processors are configured such that the vehicle operation information includes one or more of vehicle safety information, vehicle event information, vehicle environment information, or vehicle subsystem information.

14. The vehicle event data playback apparatus of claim 11 , wherein the processors are configured such that the first operating parameter is related to vehicle safety, and wherein the processors receive vehicle safety information via output signals generated by one or more sensors included in an active safety system coupled with the vehicle.

15. The vehicle event data playback apparatus of claim 14 , wherein the processors are configured such that the first vehicle event is detected based on the vehicle safety information received from the active safety system.

16. The vehicle event data playback apparatus of claim 11 , further comprising a graphical user interface configured to present the synchronized vehicle operation information to a user, wherein the processors cause the graphical user interface to present the synchronized vehicle operation information to the user.

17. The vehicle data playback apparatus of claim 16 , wherein a view of the graphical user interface includes one or more active safety system fields, the one or more active safety system fields configured to present information related to at least one of detections and alerts by an active safety system coupled with the vehicle, the active safety system fields presenting one or more of a textual, a numeric, or a graphical indication of information the active safety system communicates to a driver of the vehicle.

18. The vehicle data playback apparatus of claim 11 , wherein the processors are configured such that the first operating parameter is related to at least one of vehicle event information and vehicle environment information, and wherein the processors receive the at least one of vehicle event information and vehicle environment information via output signals generated by one or more sensors associated with an engine control module installed in the vehicle at manufacture.

19. The vehicle event data playback apparatus of claim 11 , further comprising a graphical user interface configured to present the synchronized vehicle operation information to a user in real time during operation of the vehicle.

20. The vehicle event data playback apparatus of claim 11 , wherein the processors receive information from one or more sensors included in an active safety system sensor, a video camera, an accelerometer, a gyroscope, a geolocation sensor, a radar detector, an engine RPM sensor, a vehicle speedometer, a tilt sensor, or a braking sensor.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Sep 23, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050460/0598 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0893 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Feb 11, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 048302/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: PALMER, JASON; SLJIVAR, SLAVEN
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 040395/0259 →
Continuity (2)
Continuation 14055833 · Oct 16, 2013
Related Publication 20170069147A1 · Mar 9, 2017