IP Library Granted Patent US 9,728,228
Granted Patent B2
US 9,728,228 · App. 13/571,416 · Granted Aug 8, 2017

Vehicle event playback apparatus and methods

Inventors: Jason Palmer (San Diego, CA); Steven Sljivar (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G11B27/105G08G1/167G11B27/34G09B29/007G09B29/10H04N21/41422H04N21/4325
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,728,228
App. No.
13/571,416
Granted
Aug 8, 2017
Kind
B2
Abstract

Vehicle event data playback systems have been devised and invented to provide authorized users means for advanced visual review. Detailed circumstances relating to vehicle operation are visually presented in these unique playback systems. In particular, a group of cooperating visual display devices operate in conjunction with each other to effect a detailed visual presentation of a vehicle's operational states. An interested party is afforded a high level of access to many data types in highly graphical and intuitive arrangements. Further, data replay access is enhanced by slow motion, fast forward, loop repeat, among others which have never before been associated with these data types nor with the compound visual presentations first taught in the accompanying disclosure.

Claims (25)

1. A vehicle event data playback apparatus comprising:

a logic processor configured to facilitate display of information stored electronically in a vehicle event record that corresponds to a vehicle event, the information stored in the vehicle event record being received from a vehicle event recorder mounted in a vehicle, the information stored in the vehicle event record received responsive to detection of the vehicle event by the vehicle event recorder, the vehicle event comprising a vehicle operation anomaly detected during operation of the vehicle by a vehicle operator, the vehicle event record including visual information and vehicle operation information for a period of time that includes the vehicle event, wherein the vehicle event is associated with excess fuel consumption;

a graphical display device configured to display vehicle event record information via a graphical user interface system; and

the graphical user interface system,

a view of said graphical user interface system comprising:

a plurality of control objects, the plurality of control objects comprising two or more of an engine load control object, a power take-off control object, a traction control object, an electronic stability control object, or an excess fuel consumption control object, the plurality of control objects corresponding to data values of the vehicle event record and configured such that a visual appearance of the plurality of control objects changes based on changes in the data values in said vehicle event record over time during the vehicle event, wherein the plurality of control objects further includes one or more video player control objects and a notations field object configured to receive notations from a reviewer through entry and/or selection of information from the reviewer, wherein the notations include a first notation that is associated with an indicator related to a severity of an infraction by the vehicle operator during the vehicle event, and wherein the logic processor is further configured to associate the first notation with a corresponding point in time such that the first notation is displayed at the corresponding point in time during subsequent playback using the vehicle event data playback apparatus, wherein the excess fuel consumption control object reflects instant feedback that has been provided to the vehicle operator in response to the vehicle event;

a line graph representation of the data values in the vehicle event record over time that corresponds to the plurality of control objects; and

a video player configured to display video data of the vehicle event record that is synchronized in time with the plurality of control objects and the line graph representation, wherein the video player is further configured to display information that reflects a response by the vehicle operator to the instant feedback.

2. The vehicle event data playback apparatus of claim 1 , wherein the notations further include a second notation, wherein the logic processor is further configured to associate the second notation with a corresponding period of time that includes time prior to the corresponding point in time and that further includes time subsequent to the corresponding point in time, and wherein the second notation is displayed throughout the corresponding period of time during subsequent playback.

3. The vehicle event data playback apparatus of claim 1 , wherein the graphical user interface system is configured such that the view of the graphical user interface system further comprises a timeline control object, said timeline control object having a start time, an end time, and a discrete number of time instants therebetween.

4. The vehicle event data playback apparatus of claim 3 , wherein the logic processor is configured such that the timeline control object is coupled to the plurality of control objects of the graphical user interface to effect time synchronization between coupled control objects.

5. The vehicle event data playback apparatus of claim 4 , wherein the graphical user interface system is configured such that the plurality of control objects provide visual expressions of data related to vehicle operation.

6. The vehicle event data playback apparatus of claim 4 , wherein the graphical user interface system is configured such that the plurality of control objects include four or more of a g-force control object; an engine speed control object; a vehicle speed control object; a throttle position control object; the engine load control object; the power take-off control object; a malfunction indicator light control object; a brake system control object; an anti-lock brake system control object; the traction control object; the electronic stability control object; the excess fuel consumption control object; a notation control object; or an environment state control object.

7. The vehicle event data playback apparatus of claim 3 , wherein at least one of the video player control objects is arranged for playing data files comprising an image series via the video player.

8. The vehicle event data playback apparatus of claim 3 , wherein the graphical user interface system further comprises at least two of the video player control objects, wherein video images presented via the individual video player control objects are synchronized in time such that images simultaneously displayed have a frame capture time instant which is substantially the same.

9. The vehicle event data playback apparatus of claim 1 , wherein the graphical user interface system is configured such that the one or more video player control objects include a first virtual video player and a second virtual video player, the first virtual video player characterized as a streetview video player and configured to play one or more streetview image series derived from sources other than the vehicle event recorder, the one or more streetview image series including images captured at a time independent and different from an event period during which the vehicle event occurred, the images captured from a plurality of discrete street locations, the second virtual video player characterized as a mapview video player and configured to play one or more map image series including images characterized as map images, wherein the video player is configured to display video data of the vehicle event record that is synchronized in time with the first virtual video player and the second virtual video player.

10. The vehicle event data playback apparatus of claim 9 , wherein the one or more streetview image series is comprised of images made from locations that substantially correspond to locations recorded by the vehicle event recorder in the event record.

11. The vehicle event data playback apparatus of claim 10 , wherein the graphical user interface system is configured such that the one or more streetview image series further includes icons and augmentations determined based on data captured in the vehicle event record.

12. The vehicle event data playback apparatus of claim 11 , wherein the graphical user interface system is configured such that said icons or augmentations are characterized as those from the group including: those which indicate a location of the vehicle event; those which indicate a direction of travel; those which indicate a street name; and those which identify landmarks.

13. The vehicle event data playback apparatus of claim 9 , wherein the graphical user interface system is configured such that said map images include locations which substantially correspond to locations recorded in the vehicle event record.

14. The vehicle event data playback apparatus of claim 13 , wherein the graphical user interface system is configured such that said map images further include augmentations which depend upon data captured with the vehicle event recorder.

15. The vehicle event data playback apparatus of claim 14 , wherein the graphical user interface system is configured such that said augmentation is characterized as a vehicle position indicator.

16. The vehicle event data playback apparatus of claim 14 , wherein the graphical user interface system is configured such that said augmentation is characterized as an infraction indicator.

17. The vehicle event data playback apparatus of claim 9 , wherein the graphical user interface system is configured such that the one or more video player control objects further includes a third virtual video player, the third virtual video player characterized as a bird's eye view player.

18. The vehicle event data playback apparatus of claim 2 , wherein the corresponding period of time of the second notation includes a start time of the corresponding period of time and an end time of the corresponding period of time, wherein the start time is received from the reviewer through entry and/or selection of information, and wherein the end time is received from the reviewer through entry and/or selection of information.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF IP SECURITY AGREEMENT Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050258/0222 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050246/0118 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 26, 2016
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 039841/0148 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2012
From: PALMER, JASON; SLJIVAR, SLAVEN
To: SMARTDRIVE SYSTEMS INC.
Reel/Frame 028809/0549 →
Continuity (1)
Related Publication 20140046550A1 · Feb 13, 2014