IP Library Granted Patent US 9,908,535
Granted Patent B1
US 9,908,535 · App. 15/606,760 · Granted Mar 6, 2018

Autonomous vehicle operator performance tracking

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
B60W50/12B60W50/082G05D1/0061G05D1/0088B60W2540/22B60W2550/12B60W2550/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,908,535
App. No.
15/606,760
Granted
Mar 6, 2018
Kind
B1
Abstract

This disclosure relates to a system and method for determining vehicle operator preparedness for vehicles that support both autonomous operation and manual operation. The system includes sensors configured to generate output signals conveying information related to vehicles and their operation. During autonomous vehicle operation, the system gauges the level of responsiveness of an individual vehicle operator through challenges and corresponding responses. Based on the level of responsiveness, a preparedness metric is determined for each vehicle operator individually.

Claims (61)

1. A system configured to determine vehicle operator preparedness for vehicle operators of vehicles that support both autonomous operation and manual operation, the system configured to couple with one or more vehicles, wherein the vehicles include a first vehicle and a second vehicle, wherein the operators include a first vehicle operator for the first vehicle and a second vehicle operator for the second vehicle, the system comprising:

a set of sensors configured to generate output signals conveying information related to vehicle operation of the first vehicle; and

one or more processors configured to:

operate the first vehicle autonomously based on the output signals;

present challenges to the first vehicle operator to gauge a level of responsiveness of the first vehicle operator;

present a second set of challenges to the second vehicle operator to gauge a second level of responsiveness of the second vehicle operator;

detect responses by the first vehicle operator to the challenges;

detect a second set of responses by the second vehicle operator to the second set of challenges;

determine the level of responsiveness of the first vehicle operator based on the responses;

determine the second level of responsiveness of the second vehicle operator based on the second set of responses;

determine a preparedness metric value that reflects preparedness of the first vehicle operator to assume control of the first vehicle; and

determine a second preparedness metric value that reflects preparedness of the second vehicle operator to assume control of the second vehicle.

2. The system of claim 1 , wherein the one or more processors are further configured to:

determine a change in the preparedness metric value over a period of time spanning at least three detections of responses.

3. The system of claim 1 , wherein the one or more processors are further configured to:

determine a change in the preparedness metric value over a period of time spanning more than one day.

4. The system of claim 1 , wherein the output signals convey one or more of biometric information of the first vehicle operator, operator information related to a direction of view of the first vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, and wherein the preparedness metric value is further based on the output signals.

5. The system of claim 1 , wherein the one or more processors are further configured to:

determine that vehicle control shall be transitioned from autonomous operation to manual operation by the first vehicle operator, wherein the determination to transition vehicle control is based on a set of considerations;

transition vehicle control from autonomous operation to manual operation by the first vehicle operator;

determine a level of actual responsiveness of the first vehicle operator during the transition; and

modify the preparedness metric value based on the determined level of actual responsiveness.

6. The system of claim 5 , wherein the preparedness metric value is further based on the set of considerations that prompted the determination to transition vehicle control.

7. The system of claim 1 , wherein the one or more processors are further configured to:

determine that vehicle control shall be transitioned from autonomous operation to manual operation by the first vehicle operator, wherein the determination to transition vehicle control is based on a set of considerations;

transition vehicle control from autonomous operation to manual operation by the first vehicle operator;

determine driving performance of the first vehicle operator during and/or after the transition, wherein the driving performance is based on the output signals; and

modify the preparedness metric value based on the determined driving performance.

8. The system of claim 1 , wherein the one or more processors are configured to determine the preparedness metric value by a remote server that is external to the first vehicle.

9. The system of claim 1 , wherein the one or more processors are further configured to:

compare the preparedness metric value with the second preparedness metric value.

10. A method to determine vehicle operator preparedness for vehicle operators of vehicles that support both autonomous operation and manual operation, wherein the vehicles include a first vehicle and a second vehicle, wherein the operators include a first vehicle operator for the first vehicle and a second vehicle operator for the second vehicle, the method comprising:

generating, by a set of sensors, output signals conveying information related to vehicle operation of the first vehicle;

operating the first vehicle autonomously based on the output signals;

presenting challenges to the first vehicle operator to gauge a level of responsiveness of the first vehicle operator;

presenting a second set of challenges to the second vehicle operator to gauge a second level of responsiveness of the second vehicle operator;

detecting responses by the first vehicle operator to the challenges;

detecting a second set of responses by the second vehicle operator to the second set of challenges;

determining the level of responsiveness of the first vehicle operator based on the responses;

determining the second level of responsiveness of the second vehicle operator based on the second set of responses;

determining a preparedness metric value that reflects preparedness of the first vehicle operator to assume control of the first vehicle; and

determining a second preparedness metric value that reflects preparedness of the second vehicle operator to assume control of the second vehicle.

11. The method of claim 10 , further comprising:

determining a change in the preparedness metric value over a period of time spanning at least three detections of responses.

12. The method of claim 10 , further comprising:

determine a change in the preparedness metric value over a period of time spanning more than one day.

13. The method of claim 10 , wherein the output signals convey one or more of biometric information of the first vehicle operator, operator information related to a direction of view of the first vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, and wherein the preparedness metric value is further based on the output signals.

14. The method of claim 10 , further comprising:

determining that vehicle control shall be transitioned from autonomous operation to manual operation by the first vehicle operator, wherein the determination to transition vehicle control is based on a set of considerations;

transitioning vehicle control from autonomous operation to manual operation by the first vehicle operator;

determining a level of actual responsiveness of the first vehicle operator during the transition; and

modifying the preparedness metric value based on the determined level of actual responsiveness.

15. The method of claim 14 , wherein the preparedness metric value is further based on the set of considerations that prompted the determination to transition vehicle control.

16. The method of claim 10 , further comprising:

determining that vehicle control shall be transitioned from autonomous operation to manual operation by the first vehicle operator, wherein the determination to transition vehicle control is based on a set of considerations;

transitioning vehicle control from autonomous operation to manual operation by the first vehicle operator;

determining driving performance of the first vehicle operator during and/or after the transition, wherein the driving performance is based on the output signals; and

modifying the preparedness metric value based on the determined driving performance.

17. The method of claim 10 , wherein determining the preparedness metric value is performed by a remote server that is external to the first vehicle.

18. The method of claim 10 , further comprising:

comparing the preparedness metric with the second preparedness metric value.

Assignments (17)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
RELEASE OF SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Sep 23, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050460/0598 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0893 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Feb 11, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 048302/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2017
From: VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 042518/0872 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2017
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 042518/0818 →
Continuity (1)
Continuation 15341737 · Nov 2, 2016