IP Library Granted Patent US 10,589,750
Granted Patent B2
US 10,589,750 · App. 16/417,604 · Granted Mar 17, 2020

Autonomous vehicle operator performance tracking

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
B60W50/12B60W50/082G05D1/0061G05D1/0088B60W30/12B60W30/16B60W2540/22B60W2550/12B60W2550/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,589,750
App. No.
16/417,604
Granted
Mar 17, 2020
Kind
B2
Abstract

This disclosure relates to a system and method for determining vehicle operator preparedness for vehicles that support both autonomous operation and manual operation. The system includes sensors configured to generate output signals conveying information related to vehicles and their operation. During autonomous vehicle operation, the system gauges the level of responsiveness of an individual vehicle operator through challenges and corresponding responses. Based on the level of responsiveness, a preparedness metric is determined for each vehicle operator individually.

Claims (64)

1. A system configured to determine vehicle operator preparedness for vehicle operators of vehicles that support both an autonomous operation mode and a manual operation mode, the system configured to couple with a first vehicle, wherein the vehicle operators include a first vehicle operator for the first vehicle, the system comprising:

one or more processors configured to:

operate the first vehicle autonomously, wherein continued autonomous operation of the first vehicle requires the first vehicle operator to exhibit a preparedness of the first vehicle operator to assume control of the first vehicle;

present challenges to the first vehicle operator to gauge a level of responsiveness of the first vehicle operator;

detect responses by the first vehicle operator to the challenges;

determine a preparedness metric value that reflects the preparedness of the first vehicle operator to assume control of the first vehicle, wherein determination of the preparedness metric value is based on the detected responses;

perform a comparison of the preparedness metric value with a preparedness threshold level;

determine whether the preparedness metric value reflects an insufficient level of preparedness by the first vehicle operator to assume control of the first vehicle, wherein the determination is based on the comparison; and

responsive to the determination that the preparedness metric value reflects the insufficient level of preparedness by the first vehicle operator to assume control of the first vehicle, modify vehicle operation of the first vehicle.

2. The system of claim 1 , wherein the modification of the vehicle operation includes reducing speed of the first vehicle.

3. The system of claim 1 , wherein the modification of the vehicle operation includes a change in operation mode of the first vehicle.

4. The system of claim 1 , wherein the one or more processors are further configured to:

measure an elapsed time between a presentation of an individual challenge and a detection of an individual response to the individual challenge; and

wherein the determination of the preparedness metric value is based on the elapsed time.

5. The system of claim 1 , wherein an individual challenge corresponds to an individual expected response, wherein determining the preparedness metric value is based on comparing the detected responses with expected responses, and wherein the one or more processors are further configured to:

determine a change in the preparedness metric value over a period of time spanning at least three detections of responses.

6. The system of claim 1 , wherein the one or more processors are further configured to:

determine a change in the preparedness metric value over a period of time spanning more than one day.

7. The system of claim 1 , wherein the one or more processors are further configured to:

determine that vehicle control shall be transitioned from the autonomous operation mode to the manual operation mode, wherein the determination to transition the vehicle control is based on a set of considerations;

transition the vehicle control from the autonomous operation mode to the manual operation mode;

determine a level of actual responsiveness of the first vehicle operator during the transition; and

modify the preparedness metric value based on the determined level of actual responsiveness.

8. The system of claim 7 , wherein the preparedness metric value is further based on the set of considerations that prompted the determination to transition the vehicle control.

9. The system of claim 1 , wherein the one or more processors are further configured to:

determine that vehicle control shall be transitioned from the autonomous operation mode to the manual operation mode, wherein the determination to transition the vehicle control is based on a set of considerations;

transition the vehicle control from the autonomous operation mode to the manual operation mode;

determine driving performance of the first vehicle operator during and/or after the transition, wherein the driving performance is based on the output signals; and

modify the preparedness metric value based on the determined driving performance.

10. The system of claim 1 , wherein the one or more processors are further configured to:

determine the preparedness metric value of the first vehicle operator multiple times over a period of time of at least a week;

generate a report regarding the preparedness of the first vehicle operator, wherein the report spans the period of time of at least a week; and

transmit the generated report to a remote server that is external to the first vehicle.

11. A method to determine vehicle operator preparedness for vehicle operators of vehicles that support both an autonomous operation mode and a manual operation mode, wherein the vehicles include a first vehicle, wherein the vehicle operators include a first vehicle operator for the first vehicle, the method comprising:

operating the first vehicle autonomously, wherein continued autonomous operation of the first vehicle requires the first vehicle operator to exhibit a preparedness of the first vehicle operator to assume control of the first vehicle;

presenting challenges to the first vehicle operator to gauge a level of responsiveness of the first vehicle operator;

detecting responses by the first vehicle operator to the challenges;

determining a preparedness metric value that reflects the preparedness of the first vehicle operator to assume control of the first vehicle, wherein determination of the preparedness metric value is based on the detected responses;

performing a comparison of the preparedness metric value with a preparedness threshold level;

determining whether the preparedness metric value reflects an insufficient level of preparedness by the first vehicle operator to assume control of the first vehicle, wherein the determination is based on the comparison; and

responsive to the determination that the preparedness metric value reflects the insufficient level of preparedness by the first vehicle operator to assume control of the first vehicle, modifying vehicle operation of the first vehicle.

12. The method of claim 11 , wherein modifying the vehicle operation includes reducing speed of the first vehicle.

13. The method of claim 11 , wherein modifying the vehicle operation includes a change in operation mode of the first vehicle.

14. The method of claim 11 , further comprising:

measuring an elapsed time between a presentation of an individual challenge and a detection of an individual response to the individual challenge; and

wherein the determination of the preparedness metric value is further based on the elapsed time.

15. The method of claim 11 , wherein an individual challenge corresponds to an individual expected response, wherein determining the preparedness metric value is based on comparing the detected responses with expected responses, the method further comprising:

determining a change in the preparedness metric value over a period of time spanning at least three detections of responses.

16. The method of claim 11 , further comprising:

determining a change in the preparedness metric value over a period of time spanning more than one day.

17. The method of claim 11 , further comprising:

determining that vehicle control shall be transitioned from the autonomous operation mode to the manual operation mode, wherein the determination to transition vehicle control is based on a set of considerations;

transitioning the vehicle control from the autonomous operation mode to the manual operation mode;

determining a level of actual responsiveness of the first vehicle operator during the transition; and

modifying the preparedness metric value based on the determined level of actual responsiveness.

18. The method of claim 17 , wherein the preparedness metric value is further based on the set of considerations that prompted the determination to transition the vehicle control.

19. The method of claim 11 , further comprising:

determining that vehicle control shall be transitioned from the autonomous operation mode to the manual operation mode, wherein the determination to transition the vehicle control is based on a set of considerations;

transitioning the vehicle control from the autonomous operation mode to the manual operation mode;

determining driving performance of the first vehicle operator during and/or after the transition, wherein the driving performance is based on the output signals; and

modifying the preparedness metric value based on the determined driving performance.

20. The method of claim 11 , wherein the preparedness metric value of the first vehicle operator is determined multiple times over a period of time of at least a week, the method further comprising:

generating a report regarding the preparedness of the first vehicle operator, wherein the report spans the period of time of at least a week; and

transmitting the generated report to a remote server that is external to the first vehicle.

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2019
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN; VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 049235/0741 →
Continuity (5)
Continuation 16160451 · Oct 15, 2018
Continuation 15879927 · Jan 25, 2018
Continuation 15606760 · May 26, 2017
Continuation 15341737 · Nov 2, 2016
Related Publication 20190276046A1 · Sep 12, 2019