IP Library Granted Patent US 9,226,004
Granted Patent B1
US 9,226,004 · App. 14/531,854 · Granted Dec 29, 2015

Memory management in event recording systems

Inventor: James Plante (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
H04N21/23406H04N21/41422H04N21/4223H04N21/42692H04N21/44H04N21/44004H04N21/4435H04N21/440281
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,226,004
App. No.
14/531,854
Filed
Nov 3, 2014
Granted
Dec 29, 2015
Kind
B1
Art Unit
3664
USPC
701/32.2
Abstract

A vehicle event recorder is provided that includes a camera for capturing a video as discrete image frames, and that further includes a managed loop memory and a management system for generating a virtual ‘timeline dilation’ effect. To overcome size limits in the buffer memory of the video event recorder, the maximum time extension of a video series is increased by enabling a reduction in temporal resolution in exchange for an increase in the temporal extension. Memory cells are overwritten in an ‘interleaved’ fashion to produce a reduced frame rate for the recording of certain time periods connected to an event moment. In time periods furthest from the event moment, the resulting frame rate is minimized while in time periods closest to the event moment, the resulting frame rate is maximized.

Claims (39)

1. A vehicle event recorder configured to be mounted in a vehicle, the vehicle event recorder comprising:

a video camera having a field-of-view that includes an environment about the vehicle, the video camera configured to acquire consecutive frames of visual information representing the environment about the vehicle;

a buffer memory configured to electronically store the consecutively acquired frames of visual information;

a long term storage memory configured to selectively store a subset of frames of the consecutively acquired frames of visual information

one or more sensors configured to generate output signals conveying information related to vehicle events; and

a controller configured to:

effectuate storage of the consecutively acquired frames of visual information in the buffer memory;

facilitate interleaved overwriting of less valuable individual frames of the consecutively acquired frames of visual information stored in the buffer memory with additional frames acquired by the video camera, wherein value of individual frames of the consecutively acquired frames decreases:

i. with increasing time away from a time of a given vehicle event, and

ii. with presence of one or more adjacent frames in the consecutively acquired frames that convey substantially similar visual information;

detect the given vehicle events based on the output signals; and

responsive to detecting the a given vehicle event, transfer the frames of visual information stored in the buffer memory to the long term storage memory, the transferred frames of visual information including frames of visual information for a period of time that begins before the given vehicle event and lasts until after the given vehicle event.

2. The vehicle event recorder of claim 1 , wherein the controller is configured such that the less valuable individual frames of the consecutively acquired frames are not the oldest frames stored in the buffer memory.

3. The vehicle event recorder of claim 1 , wherein the controller is configured to assign individual value scores to the consecutively acquired frames of visual information stored in the buffer memory, adjust the individual value scores based on an individual frame's age, and facilitate interleaved overwriting of the additional frames acquired by the video camera based on the adjusted individual value scores.

4. The vehicle event recorder of claim 3 , wherein the controller is configured to assign the individual value scores to the consecutively acquired frames of visual information such that every n-th frame, where n is an integer, is assigned a higher score than frames that immediately precede and immediately follow the n-th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

5. The vehicle event recorder of claim 4 , wherein the controller is configured such that the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the time of the given vehicle event, a distance travelled by the vehicle, a speed of the vehicle, a pixel difference between consecutively acquired frames of visual information, or a geographic location of the vehicle.

6. The vehicle event recorder of claim 1 , wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames acquired by the video camera such that a second individual additional frame that consecutively follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that consecutively follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

7. The vehicle event recorder of claim 1 , wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the video camera acquired the individual frames of visual information, whether an operator was present in the vehicle when the video camera acquired the individual frames of information, a distance travelled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

8. The vehicle event recorder of claim 1 , further comprising a flush module configured to facilitate the transfer of the frames of visual information from the buffer memory to the long term storage memory, the flush module configured to facilitate the transfer of the frames of visual information from the buffer memory, responsive to the detection of the given vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are acquired by the video camera.

9. The vehicle event recorder of claim 8 , wherein the flush module is configured to start the transfer immediately after the detection of the given vehicle event rather than waiting for all video frames associated with the given vehicle event to be stored in the buffer memory.

10. The vehicle event recorder of claim 8 , wherein the flush module is configured, responsive to detection of a second vehicle event in time proximity to the given vehicle event, to dynamically extend a duration of the period of time that begins before the given vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the given vehicle event and lasts until after the second vehicle event.

11. A method for storing frames of visual information with a vehicle event recording system, the method comprising:

acquiring consecutive frames of visual information representing an environment about a vehicle with a video camera of the vehicle event recording system;

generating output signals conveying information related to vehicle events with one or more sensors of the vehicle event recording system;

effectuating storage of the consecutively acquired frames of visual information in a buffer memory of the vehicle event recording system;

facilitating interleaved overwriting of less valuable individual frames of the consecutively acquired frames of visual information stored in the buffer memory with additional frames acquired by the video camera, wherein value of individual frames of the consecutively acquired frames decreases:

i. with increasing time away from a time of a given vehicle event, and

ii. with presence of one or more adjacent frames in the consecutively acquired frames that convey substantially similar visual information;

detecting the given vehicle events based on the output signals; and

responsive to detecting the a given vehicle event, transferring the frames of visual information stored in the buffer memory to a long term storage memory of the vehicle event recording system, the transferred frames of visual information including frames of visual information for a period of time that begins before the given vehicle event and lasts until after the given vehicle event.

12. The method of claim 11 , wherein the less valuable individual frames of the consecutively acquired frames are not the oldest frames stored in the buffer memory.

13. The method of claim 11 , further comprising assigning individual value scores to the consecutively acquired frames of visual information stored in the buffer memory, adjusting the individual value scores based on an individual frame's age, and facilitating interleaved overwriting of the additional frames acquired by the video camera based on the adjusted individual value scores.

14. The method of claim 13 , wherein every n-th frame of the consecutively acquired frames of visual information, where n is an integer, is assigned a higher score than frames that immediately preceding and immediately following the n-th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

15. The method of claim 14 , wherein the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the time of the given vehicle event, a distance travelled by the vehicle, a speed of the vehicle, a pixel difference between consecutively acquired frames of visual information, or a geographic location of the vehicle.

16. The method of claim 11 , wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames acquired by the video camera such that a second individual additional frame that consecutively follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that consecutively follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

17. The method of claim 11 , wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the video camera acquired the individual frames of visual information, whether an operator was present in the vehicle when the video camera acquired the individual frames of information, a distance travelled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

18. The method of claim 11 , further comprising facilitating the transfer of the frames of visual information from the buffer memory, responsive to the detection of the given vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are acquired by the video camera.

19. The method of claim 18 , wherein the transfer starts immediately after the detection of the given vehicle event rather than waiting for all video frames associated with the given vehicle event to be stored in the buffer memory.

20. The method of claim 18 , further comprising, responsive to detection of a second vehicle event in time proximity to the given vehicle event, dynamically extending a duration of the period of time that begins before the given vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the given vehicle event and lasts until after the second vehicle event.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF IP SECURITY AGREEMENT Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050258/0222 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050246/0118 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 26, 2016
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 039841/0148 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2014
From: PLANTE, JAMES
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 034130/0214 →
Continuity (3)
Continuation 13734800 · Jan 4, 2013
Continuation 12096592
Continuation 11296907 · Dec 8, 2005