IP Library Granted Patent US 9,911,253
Granted Patent B2
US 9,911,253 · App. 14/981,384 · Granted Mar 6, 2018

Memory management in event recording systems

Inventor: James Plante (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G07C5/0866G07C5/02H04N5/77H04N7/181H04N7/183H04N21/23406H04N21/41422H04N21/4223H04N21/42692H04N21/4334H04N21/44H04N21/44004H04N21/4435H04N21/440281
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,911,253
App. No.
14/981,384
Granted
Mar 6, 2018
Kind
B2
Abstract

A vehicle event recorder is provided that includes a camera for capturing a video as discrete image frames, and that further includes a managed loop memory and a management system for generating a virtual ‘timeline dilation’ effect. To overcome size limits in the buffer memory of the video event recorder, the maximum time extension of a video series is increased by enabling a reduction in temporal resolution in exchange for an increase in the temporal extension. Memory cells are overwritten in an ‘interleaved’ fashion to produce a reduced frame rate for the recording of certain time periods connected to an event moment. In time periods furthest from the event moment, the resulting frame rate is minimized while in time periods closest to the event moment, the resulting frame rate is maximized.

Claims (37)

1. A vehicle event recorder system configured to be mounted in a vehicle, the vehicle event recorder system comprising:

a camera configured to capture image data, wherein the camera has a field-of-view that includes an environment in and/or around the vehicle, wherein the image data includes a set of consecutive frames of visual information;

a buffer memory configured to electronically store information, wherein the information includes the image data;

a long-term storage memory configured to store information, wherein the stored information includes a subset of the set of consecutive frames of visual information;

one or more sensors configured to generate output signals conveying vehicle information related to a particular vehicle event at a particular time; and

a controller configured to:

detect the particular vehicle event based on the generated output signals;

effectuate storage of the set of consecutive frames of visual information in the buffer memory;

determine values of individual frames in the set of consecutive frames, wherein the values of the individual frames decrease with increasing time away from the particular time of the particular vehicle event;

facilitate overwriting of the individual frames stored in the buffer memory based on the determined values; and

responsive to detecting the particular vehicle event, transfer information stored in the buffer memory to the long-term storage memory, wherein the transferred information includes frames of visual information for a period of time that begins before the particular vehicle event and lasts until after the particular vehicle event.

2. The vehicle event recorder system of claim 1 , wherein the values of the individual frames further decrease based on similarity of the visual information of the individual frames.

3. The vehicle event recorder system of claim 1 , wherein the controller is configured such that the individual frame having the lowest determined value is not the oldest frame stored in the buffer memory.

4. The vehicle event recorder system of claim 3 , wherein the controller is configured to assign individual value scores to the set of consecutive frames of visual information such that every n- th frame, where n is an integer, is assigned a higher score than frames that immediately precede and immediately follow the n- th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

5. The vehicle event recorder system of claim 4 , wherein the controller is configured such that the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the particular time of the particular vehicle event, a distance traveled by the vehicle, a speed of the vehicle, a pixel difference between consecutive frames of visual information, or a geographic location of the vehicle.

6. The vehicle event recorder system of claim 1 , wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames such that a second individual additional frame that follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

7. The vehicle event recorder system of claim 1 , wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the camera captured the individual frames of visual information, whether an operator was present in the vehicle when the camera captured the individual frames of information, a distance traveled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

8. The vehicle event recorder system of claim 1 , further comprising a flush module configured to facilitate the transfer of the frames of visual information from the buffer memory to the long-term storage memory, the flush module configured to facilitate the transfer of the frames of visual information from the buffer memory, responsive to the detection of the particular vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are captured by the camera.

9. The vehicle event recorder system of claim 8 , wherein the flush module is configured to start the transfer immediately after the detection of the particular vehicle event rather than waiting for all video frames associated with the particular vehicle event to be stored in the buffer memory.

10. The vehicle event recorder system of claim 8 , wherein the flush module is configured, responsive to detection of a second vehicle event in temporal proximity to the particular vehicle event, to dynamically extend a duration of the period of time that begins before the particular vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the particular vehicle event and lasts until after the second vehicle event.

11. A method for storing frames of visual information with a vehicle event recording system, the method comprising:

capturing a set of consecutive frames of visual information representing an environment in and/or around a vehicle with a camera of the vehicle event recording system;

generating output signals conveying vehicle information related to a particular vehicle event with one or more sensors of the vehicle event recording system;

detecting the particular vehicle event based on the generated output signals;

effectuating storage of the consecutively captured frames of visual information in a buffer memory of the vehicle event recording system;

determining values of individual frames in the set of consecutive frames, wherein the values of the individual frames decreases with increasing time away from the particular time of the particular vehicle event;

facilitating overwriting of the individual frames stored in the buffer memory based on the determined values; and

responsive to detecting the particular vehicle event, transferring information stored in the buffer memory to a long-term storage memory, wherein the transferred information includes frames of visual information for a period of time that begins before the particular vehicle event and lasts until after the particular vehicle event.

12. The method of claim 11 , wherein the values of the individual frames further decrease based on similarity of the visual information of the individual frames.

13. The method of claim 11 , wherein the individual frame having the lowest determined value is not the oldest frame stored in the buffer memory.

14. The method of claim 13 , wherein every n- th frame of the consecutively captured frames of visual information, where n is an integer, is assigned a higher score than frames that immediately preceding and immediately following the n- th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

15. The method of claim 14 , wherein the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the time of the particular vehicle event, a distance traveled by the vehicle, a speed of the vehicle, a pixel difference between consecutively captured frames of visual information, or a geographic location of the vehicle.

16. The method of claim 11 , wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames captured by the camera such that a second individual additional frame that consecutively follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that consecutively follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

17. The method of claim 11 , wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the camera captured the individual frames of visual information, whether an operator was present in the vehicle when the camera captured the individual frames of information, a distance travelled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

18. The method of claim 11 , further comprising facilitating the transfer of the frames of visual information from the buffer memory, responsive to the detection of the particular vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are captured by the camera.

19. The method of claim 18 , wherein the transfer starts immediately after the detection of the particular vehicle event rather than waiting for all video frames associated with the particular vehicle event to be stored in the buffer memory.

20. The method of claim 18 , further comprising, responsive to detection of a second vehicle event in temporal proximity to the particular vehicle event, dynamically extending a duration of the period of time that begins before the particular vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the particular vehicle event and lasts until after the second vehicle event.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050246/0118 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
RELEASE OF IP SECURITY AGREEMENT Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050258/0222 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
EMPLOYMENT AGREEMENT Recorded Nov 20, 2017
From: PLANTE, JAMES
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 044488/0939 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 26, 2016
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 039841/0148 →
Continuity (5)
Continuation 14531854 · Nov 3, 2014
Continuation 13734800 · Jan 4, 2013
Continuation 12096592
Continuation 11296907 · Dec 8, 2005
Related Publication 20160117872A1 · Apr 28, 2016