IP Library Granted Patent US 9,823,657
Granted Patent B1
US 9,823,657 · App. 15/341,714 · Granted Nov 21, 2017

Measuring operator readiness and readiness testing triggering in an autonomous vehicle

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G05D1/0061B60W40/08G07C5/008B60W2550/14B60W2550/20G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,823,657
App. No.
15/341,714
Granted
Nov 21, 2017
Kind
B1
Abstract

This disclosure relates to a system and method for transitioning vehicle control between autonomous operation and manual operation. The system includes sensors configured to generate output signals conveying information related to the vehicle and its operation. During autonomous vehicle operation, the system gauges the level of responsiveness of a vehicle operator through challenges and corresponding responses. The system determines when to present a challenge to the vehicle operator based on internal and external factors. If necessary, the system will transition from an autonomous operation mode to a manual operation mode.

Claims (56)

1. A system configured to transition vehicle control between autonomous operation and manual operation, the system configured to couple with a vehicle, the system comprising:

a set of sensors configured to generate output signals conveying information related to vehicle operation;

a user interface configured to provide an interface between the system and users; and

one or more processors configured to:

operate the vehicle autonomously in an autonomous operation mode;

determine an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue vehicle operation;

determine a first moment in time for presenting a challenge to a vehicle operator to gauge a level of responsiveness of the vehicle operator, wherein determination of the first moment in time is based on the output signals and the automation confidence, and wherein the challenge corresponds to an expected response by the vehicle operator, wherein the expected response is a particular interaction with the user interface;

present, at the first moment in time, the challenge to the vehicle operator to gauge the level of responsiveness of the vehicle operator;

detect whether the vehicle operator provides a response to the challenge that matches the expected response, wherein detection is based on interaction between the vehicle operator and the user interface;

determine the level of responsiveness of the vehicle operator based on the detection; and

operate the vehicle based on the determined level of responsiveness.

2. The system of claim 1 , wherein the one or more processors are further configured to:

determine whether the level of responsiveness meets a threshold of adequate responsiveness to maintain the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bring the vehicle to a stop.

3. The system of claim 2 , wherein the threshold of adequate responsiveness is adjusted dynamically based on the output signals.

4. The system of claim 1 , wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determination of the first moment in time is based on the output signal.

5. The system of claim 1 , wherein the level of responsiveness of the vehicle operator is determined in an ongoing manner for a period extending beyond 15 minutes, and wherein determination of the first moment in time is based on the level of responsiveness.

6. The system of claim 1 , wherein the one or more processors are further configured to:

determine an operator confidence that the vehicle operator is currently prepared to assume control of vehicle operation, wherein determination of the operator confidence is based on the output signals,

wherein determination of the first moment in time is based on the operator confidence.

7. The system of claim 1 , wherein the one or more processors are further configured such that:

the determination of the automation confidence is based on one or more of traffic information related to current traffic parameters, environmental information related to surface parameters of the road, or weather parameters.

8. The system of claim 1 , wherein the one or more processors are further configured to:

capture information conveyed by the output signals proximate in time to presentation of the challenge; and

generate a first event record associated with a transition from the autonomous operation mode to a manual operation mode, wherein the first event record includes the captured information.

9. The system of claim 8 , wherein the one or more processors are further configured to:

transmit the first event record from the vehicle to a remote server that is external to the vehicle.

10. The system of claim 1 , wherein the challenge includes generation of one or both of a sound and a tactile notification, wherein the vehicle operator provides the response through tactile feedback, wherein the level of responsiveness is based on elapsed time between the challenge and the response.

11. A method to transition vehicle control between autonomous operation and manual operation, the method comprising:

generating, by a set of sensors, output signals conveying information related to vehicle operation;

providing, by a user interface, an interface between a vehicle and users;

operating the vehicle autonomously in an autonomous operation mode;

determine an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue vehicle operation;

determining a first moment in time for presenting a challenge to a vehicle operator to gauge a level of responsiveness of the vehicle operator, wherein determination of the first moment in time is based on the output signals and the automation confidence, and wherein the challenge corresponds to an expected response by the vehicle operator, wherein the expected response is a particular interaction with the user interface;

presenting, at the first moment in time, the challenge to the vehicle operator to gauge the level of responsiveness of the vehicle operator;

detecting whether the vehicle operator provides a response to the challenge that matches the expected response, wherein detection is based on interaction between the vehicle operator and the user interface;

determining the level of responsiveness of the vehicle operator based on the detection; and

operating the vehicle based on the determined level of responsiveness.

12. The method of claim 11 , further comprising:

determining whether the level of responsiveness meets a threshold of adequate responsiveness to maintain the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bringing the vehicle to a stop.

13. The method of claim 12 , further comprising:

adjusting the threshold of adequate responsiveness dynamically based on the output signals.

14. The method of claim 11 , wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determining the first moment in time is based on the output signal.

15. The method of claim 11 , wherein the level of responsiveness of the vehicle operator is determined in an ongoing manner for a period extending beyond 15 minutes, and wherein determining the first moment in time is based on the level of responsiveness.

16. The method of claim 11 , further comprising:

determining an operator confidence that the vehicle operator is currently prepared to assume control of vehicle operation, wherein determination of the operator confidence is based on the output signals,

wherein determining the first moment in time is based on the operator confidence.

17. The method of claim 11 , further comprising:

wherein the determination of the automation confidence is based on one or more of traffic information related to current traffic parameters, environmental information related to surface parameters of the road, or weather parameters.

18. The method of claim 11 , further comprising:

capturing information conveyed by the output signals proximate in time to presentation of the challenge; and

generating a first event record associated with a transition from the autonomous operation mode to a manual operation mode, wherein the first event record includes the captured information.

19. The method of claim 18 , further comprising:

transmitting the first event record from the vehicle to a remote server that is external to the vehicle.

20. The method of claim 11 , wherein presenting the challenge includes generating one or both of a sound and a tactile notification, wherein detecting the response includes detecting tactile feedback, and wherein determining the level of responsiveness includes determining elapsed time between the challenge and the response.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Sep 23, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050460/0598 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0893 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Feb 11, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 048302/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2017
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN; VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 042791/0595 →