IP Library Granted Patent US 10,818,109
Granted Patent B2
US 10,818,109 · App. 15/151,877 · Granted Oct 27, 2020

Systems and methods for capturing and offloading different information based on event trigger type

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G07C5/0841B60R1/00B60R2300/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,818,109
App. No.
15/151,877
Filed
May 11, 2016
Granted
Oct 27, 2020
Kind
B2
Art Unit
3669
USPC
701/1
Abstract

This disclosure relates to a system and method for detecting vehicle events. The system includes sensors configured to generate output signals conveying information related to the vehicle. The system detects a vehicle event based on the information conveyed by the output signals. The system selects a subset of sensors based on the detected vehicle event. The system captures and records information from the selected subset of sensors. The system transfers the recorded information to a remote server or provider.

Claims (57)

1. A system configured to capture information based on detected vehicle events, the system configured to couple with a vehicle, the system comprising:

electronic storage configured to electronically store information, wherein the electronic storage is carried by the vehicle;

a set of sensors configured to generate output signals conveying information related to current operating conditions of the vehicle, wherein the set of sensors is carried by the vehicle;

a set of cameras configured to capture image data, wherein the set of cameras is carried by the vehicle, wherein the set of cameras includes a first camera, a second camera, and a third camera configured to capture image data, and wherein the set of cameras includes at least one interior camera configured to capture visual information inside the vehicle; and

one or more processors configured to:

determine the current operating conditions of the vehicle while the vehicle is in motion, wherein determination is based on the generated output signals;

detect vehicle events while the vehicle is in motion based on driving maneuvers the vehicle is performing, wherein detection of the vehicle events is based on the determined current operating conditions related to information conveyed by the generated output signals from at least two different sensors in the set of sensors, wherein the driving maneuvers include one or more of swerving, a U-turn, freewheeling, over-revving, lane-departure, short following distance, imminent collision, unsafe turning that approaches rollover, hard braking, rapid acceleration, idling, driving outside a geo-fence boundary, crossing double-yellow lines, passing on single-lane roads, a certain number of lane changes within a certain amount of time or distance, fast lane change, cutting off other vehicles during lane-change speeding, running a red light, and/or running a stop sign, wherein the detected vehicle events include a first vehicle event, a second vehicle event, and a third vehicle event;

determine a first event type for the first vehicle event based on a first driving maneuver the vehicle is performing, a second event type for the second vehicle event based on a second driving maneuver the vehicle is performing, and a third event type for the third vehicle event based on a third driving maneuver the vehicle is performing, wherein the first, second, and third event types are different event types corresponding to different driving maneuvers;

responsive to detection of the first vehicle event, and based on the first event type, select a first subset of cameras from the set of cameras, wherein the first subset of cameras includes the first camera and excludes at least one of the second and third cameras;

responsive to detection of the second vehicle event, and based on the second event type, select a second subset of cameras from the set of cameras, wherein the second subset of cameras includes the second camera and excludes at least one of the first and third cameras;

responsive to detection of the third vehicle event, and based on the third event type, select a third subset of cameras from the set of cameras, wherein the third subset of cameras includes the third camera and excludes at least one of the first and second cameras;

capture first image data by the first subset of cameras proximate in time to the first vehicle event;

capture second image data by the second subset of cameras proximate in time to the second vehicle event;

capture third image data by the third subset of cameras proximate in time to the third vehicle event;

generate a first event record associated with the first vehicle event, wherein the first event record includes the captured first image data;

generate a second event record associated with the second vehicle event, wherein the second event record includes the captured second image data;

generate a third event record associated with the third vehicle event, wherein the third event record includes the captured third image data;

store the first, second, and third event record in the electronic storage; and

transmit the first, second, and third event records from the electronic storage to a remote server that is external to the vehicle.

2. The system of claim 1 , the vehicle having a rear side, wherein the first event type corresponds to vehicle events at or near the rear side of the vehicle.

3. The system of claim 1 , wherein the first event type corresponds to vehicle events at or near a side of the vehicle.

4. The system of claim 1 , wherein the set of sensors includes a depth sensor configured to generate output signals conveying depth information, the depth information including ranges of surfaces and/or objects within an environment in and/or around the vehicle, the environment around the vehicle including an area within a first field-of-view of the first camera and/or a second field-of-view of the second camera, wherein the first vehicle event is related to a distance between two vehicles, wherein detection of the first vehicle event is based on the depth information.

5. The system of claim 1 , wherein detection of the first vehicle event is based on a comparison of a value of a current operating condition of the vehicle with a threshold value.

6. The system of claim 1 , wherein a current operating condition of the vehicle includes one or more of an engine load, a throttle level, a particular change in vehicle direction, or multiple changes in vehicle direction.

7. The system of claim 1 , wherein the first vehicle event is related to unsafe vehicle speed.

8. The system of claim 1 , wherein the first vehicle event is an imminent collision, wherein the second vehicle event is a swerve, wherein the first camera is a forward-facing camera, wherein the second camera is a sideways-facing camera, wherein the first subset of cameras excludes the sideways-facing camera, and wherein the second subset of cameras includes the sideways-facing camera.

9. The system of claim 1 , wherein the first event type corresponds to vehicle events occurring at a particular speed of the vehicle, wherein the particular speed of the vehicle is less than a speed threshold, and wherein the first vehicle event occurred at a speed less than the speed threshold.

10. The system of claim 1 , wherein the one or more processors are further configured to obtain contextual information related to environmental conditions near and/or around the vehicle, wherein the environmental conditions include one or more of weather conditions, road surface conditions, and/or visibility, and wherein the vehicle events are further based on the obtained contextual information.

11. The system of claim 10 , wherein detection of the first vehicle event is based on a comparison with a threshold value, wherein the threshold value used for the detection is adjusted, and wherein adjustment of the threshold value is based on the contextual information.

12. The system of claim 1 , wherein the one or more processors are further configured to:

generate first, second, and third notifications related to the first, second, and third vehicle events, respectively, and transmit the first, second, and third notifications to the remote server; and

receive, from the remote server, one or more requests for one or more particular event records,

wherein transmission of the first, second, and third event records is responsive to the request by the remote server requesting the first, second, and third event records, respectively.

13. A method to capture information based on detected vehicle events of a vehicle, the method comprising:

generating, by a set of sensors, output signals conveying information related to current operating conditions of the vehicle, wherein the set of sensors is carried by the vehicle;

capturing, by a set of cameras, image data, wherein the set of cameras includes a first camera, a second camera, and a third camera configured to capture image data, and wherein the set of cameras includes at least one interior camera configured to capture visual information inside the vehicle;

determining the current operating conditions of the vehicle while the vehicle is in motion, wherein determination is based on the generated output signals;

detecting vehicle events while the vehicle is in motion based on driving maneuvers the vehicle is performing, wherein detection of the vehicle events is based on the determined current operating conditions, wherein the driving maneuvers includes one or more of swerving, a U-turn, freewheeling, over-revving, lane-departure, short following distance, imminent collision, unsafe turning that approaches rollover, hard braking, rapid acceleration, idling, driving outside a geo-fence boundary, crossing double-yellow lines, passing on single-lane roads, a certain number of lane changes within a certain amount of time or distance, fast lane change, cutting off other vehicles during lane-change speeding, running a red light, and/or running a stop sign, wherein the detected vehicle events include a first vehicle event, a second vehicle event, and a third vehicle event;

determining a first event type for the first vehicle event based on a first driving maneuver the vehicle is performing, a second event type for the second vehicle event based on a second driving maneuver the vehicle is performing, and a third event type for the third vehicle event based on a third driving maneuver the vehicle is performing, wherein the first, second, and third event types are different event types corresponding to different driving maneuvers;

responsive to detection of the first vehicle event, and based on the first event type, selecting a first subset of cameras from the set of cameras, wherein the first subset of cameras includes the first camera and excludes at least one of the second and third cameras;

responsive to detection of the second vehicle event, and based on the second event type, selecting a second subset of cameras from the set of cameras, wherein the second subset of cameras includes the second camera and excludes at least one of the first and third cameras;

responsive to detection of the third vehicle event, and based on the third event type, selecting a third subset of cameras from the set of cameras, wherein the third subset of cameras includes the third camera and excludes at least one of the first and second cameras;

capturing first image data by the first subset of cameras proximate in time to the first vehicle event;

capturing second image data by the second subset of cameras proximate in time to the second vehicle event;

capturing third image data by the third subset of cameras proximate in time to the third vehicle event;

generating a first event record associated with the first vehicle event, wherein the first event record includes the captured first image data;

generating a second event record associated with the second vehicle event, wherein the second event record includes the captured second image data;

generating a third event record associated with the third vehicle event, wherein the third event record includes the captured third image data;

storing the first, second, and third event records in electronic storage, wherein the electronic storage is carried by the vehicle; and

transmitting the first, second, and third event records from the electronic storage to a remote server that is external to the vehicle.

14. The method of claim 13 , the vehicle having a rear side, wherein the first event type corresponds to vehicle events at or near the rear side of the vehicle.

15. The method of claim 13 , wherein the first event type corresponds to vehicle events at or near a side of the vehicle.

16. The method of claim 13 , wherein the set of sensors includes a depth sensor configured to generate output signals conveying depth information, the depth information including ranges of surfaces and/or objects within an environment in and/or around the vehicle, the environment around the vehicle including an area within a first field-of-view of the first camera and/or a second field-of-view of the second camera, wherein the first vehicle event is related to a distance between two vehicles, wherein detection of the first vehicle event is based on the depth information.

17. The method of claim 13 , wherein detection of the first vehicle event is based on a comparison of a value of a current operating condition of the vehicle with a threshold value.

18. The method of claim 13 , wherein a current operating condition of the vehicle includes one or more of an engine load, a throttle level, a particular change in vehicle direction, or multiple changes in vehicle direction.

19. The method of claim 13 , wherein the first vehicle event is related to unsafe vehicle speed.

20. The method of claim 13 , wherein the first vehicle event is an imminent collision, wherein the second vehicle event is a swerve, wherein the first camera is a forward-facing camera, wherein the second camera is a sideways-facing camera, wherein the first subset of cameras excludes the sideways-facing camera, and wherein the second subset of cameras includes the sideways-facing camera.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF IP SECURITY AGREEMENT Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050258/0222 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050246/0118 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 26, 2016
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 039841/0148 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2016
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN; VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 038721/0592 →
Continuity (1)
Related Publication 20170330397A1 · Nov 16, 2017
Cited By (37)
US 12,197,610 US 12,213,090 US 12,228,944 US 12,253,617 US 12,256,021 US 12,260,616 US 12,269,498 US 12,289,181 US 12,306,010 US 12,327,445 US 12,328,639 US 12,344,168 US 12,346,712 US 12,354,374 US 12,367,718 US 12,423,864 US 12,426,007 US 12,445,285 US 12,450,329 US 12,456,305 US 12,479,446 US 12,501,178 US 12,511,947 US 12,534,097 US 12,552,318 US 12,561,624 US 12,565,143 US 12,586,230 US 12,626,200 US 12,630,050 US 12,646,402 US 12,651,529 US 12,662,152 US 12,665,989 US 12,671,464 US 12,675,419 US 12,701,004