IP Library Granted Patent US 10,705,523
Granted Patent B2
US 10,705,523 · App. 16/138,588 · Granted Jul 7, 2020

Measuring operator readiness and readiness testing triggering in an autonomous vehicle

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SmartDrive Systems, Inc.
G05D1/0061G07C5/008B60W2040/0863B60W2552/05B60W2552/40B60W2554/00B60Y2302/05G05D2201/0213G07C5/0841
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,705,523
App. No.
16/138,588
Granted
Jul 7, 2020
Kind
B2
Abstract

This disclosure relates to a system and method for transitioning vehicle control between autonomous operation and manual operation. The system includes sensors configured to generate output signals conveying information related to the vehicle and its operation. During autonomous vehicle operation, the system gauges the level of responsiveness of a vehicle operator through challenges and corresponding responses. The system determines when to present a challenge to the vehicle operator based on internal and external factors. If necessary, the system will transition from an autonomous operation mode to a manual operation mode.

Claims (55)

1. A system configured to determine whether to transition vehicle control of a vehicle between autonomous operation and another mode of operation that is not the autonomous operation, the system configured to couple with the vehicle, the system comprising:

a user interface configured to provide an interface between the system and a vehicle operator to gauge responsiveness of vehicle operator; and

one or more processors configured to:

present, while the vehicle is being controlled through the autonomous operation, through the user interface, a challenge to the vehicle operator to gauge the responsiveness of the vehicle operator, wherein the challenge corresponds to an expected response by the vehicle operator, wherein the expected response is a particular interaction by the vehicle operator with the user interface, and wherein continued control of the vehicle through the autonomous operation requires the vehicle operator to provide a response to the challenge that matches the expected response;

detect whether the vehicle operator provides, through the user interface, the response to the challenge that matches the expected response, wherein detection is based on an interaction between the vehicle operator and the user interface; and

determine whether to effectuate continued autonomous operation of the vehicle or to effectuate a transition of the vehicle control to another mode of operation that is not the autonomous operation, wherein the determination is based on the detection.

2. The system of claim 1 , wherein the one or more processors are further configured to:

determine a level of responsiveness of the vehicle operator based on the detection whether the vehicle operator has provided the response to the challenge that matches the expected response,

wherein either the continuation of the autonomous operation or the transition of the vehicle control to another mode of operation that is not the autonomous operation by the vehicle operator is based on the determined level of responsiveness.

3. The system of claim 1 , wherein the one or more processors are further configured to:

operate the vehicle autonomously in an autonomous operation mode; and

determine an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue operating the vehicle;

wherein the challenge is presented at a first moment in time,

wherein the one or more processors are further configured to determine the first moment in time based on the automation confidence.

4. The system of claim 3 , wherein the one or more processors are further configured to:

determine whether the level of responsiveness meets a threshold of adequate responsiveness to continue operating in the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bring the vehicle to a stop.

5. The system of claim 4 , wherein the one or more processors are further configured to:

capture information conveyed by the output signals proximate in time to the presentation of the challenge; and

generate a first event record associated with the challenge and the response, wherein the first event record includes the captured information.

6. The system of claim 3 , wherein the level of responsiveness of the vehicle operator is determined in an ongoing manner for a period extending beyond 15 minutes, and wherein determination of the first moment in time is further based on the level of responsiveness.

7. The system of claim 3 , wherein the one or more processors are further configured such that determination of the automation confidence is based on one or more of traffic information related to current traffic parameters, environmental information related to surface parameters of the road, or weather parameters.

8. The system of claim 1 , wherein the system further comprises a set of sensors configured to generate output signals conveying information related to vehicle operation, wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determination of the first moment in time is based on the output signal.

9. The system of claim 1 , wherein the one or more processors are further configured to:

determine an operator confidence that the vehicle operator is currently prepared to assume manual control of vehicle operation,

wherein presentation of the challenge is timed based on the operator confidence.

10. The system of claim 1 , wherein the challenge includes generation of one or both of a sound and a tactile notification, wherein the vehicle operator provides the response through tactile feedback, wherein the level of responsiveness is based on elapsed time between the challenge and the response.

11. A method to transition vehicle control of a vehicle between autonomous operation and another mode of operation that is not the autonomous operation, the method comprising:

providing, by a user interface, an interface between a vehicle and a vehicle operator to gauge responsiveness of vehicle operators;

presenting, while the vehicle is being controlled through the autonomous operation, through the user interface, a challenge to the vehicle operator to gauge responsiveness of the vehicle operator, wherein the challenge corresponds to an expected response by the vehicle operator, wherein the expected response is a particular interaction by the vehicle operator with the user interface, and wherein continued control of the vehicle through the autonomous operation requires the vehicle operator to provide a response to the channenge that matches the expected response;

detecting whether the vehicle operator provides, through the user interface, the response to the challenge that matches the expected response, wherein detection is based on an interaction between the vehicle operator and the user interface; and

determining whether to effectuate continued autonomous operation of the vehicle or to effectuate a transition of the vehicle control to another mode of operation that is not the autonomous operation, wherein the determination is based on the detection.

12. The method of claim 10 , further comprising:

determining a level of responsiveness of the vehicle operator based on the detection whether the vehicle operator has provided the response to the challenge that matches the expected response,

wherein either the continuation of the autonomous operation or the transition of the vehicle control to another mode of operation that is not the autonomous operation by the vehicle operator is based on the determined level of responsiveness.

13. The method of claim 10 , further comprising:

operating the vehicle autonomously in an autonomous operation mode; and

determining an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue operating the vehicle;

wherein the challenge is presented at a first moment in time,

wherein the method further comprises determining the first moment in time based on the automation confidence.

14. The method of claim 13 , further comprising:

determining whether the level of responsiveness meets a threshold of adequate responsiveness to continue operating in the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bringing the vehicle to a stop.

15. The method of claim 14 , further comprising:

capturing information conveyed by the output signals proximate in time to the presentation of the challenge; and

generating a first event record associated with the challenge and the response, wherein the first event record includes the captured information.

16. The method of claim 13 , wherein the level of responsiveness of the vehicle operator is determined in an ongoing manner for a period extending beyond 15 minutes, and wherein determining the first moment in time is further based on the level of responsiveness.

17. The method of claim 13 , wherein determination of the automation confidence is based on one or more of traffic information related to current traffic parameters, environmental information related to surface parameters of the road, or weather parameters.

18. The method of claim 11 , further comprising:

generating output signals conveying information related to vehicle operation;

wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determining the first moment in time is based on the output signal.

19. The method of claim 11 , further comprising:

determining an operator confidence that the vehicle operator is currently prepared to assume manual control of vehicle operation,

wherein presenting the challenge is timed based on the operator confidence.

20. The method of claim 11 , wherein presenting the challenge includes generating one or both of a sound and a tactile notification, wherein detecting the response includes detecting tactile feedback, and wherein determining the level of responsiveness includes determining elapsed time between the challenge and the response.

Assignments (16)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
TERMINATION AND RELEASE OF GRANT OF A SECURITY INTEREST - PATENTS Recorded Oct 6, 2020
From: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 053983/0525 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
RELEASE OF SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Sep 23, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050460/0598 →
SECURITY INTEREST Recorded Sep 3, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: TCS TALENTS, LLC, AS THE COLLATERAL AGENT
Reel/Frame 050255/0071 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ALLY BANK
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0893 →
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2019
From: ORIX GROWTH CAPITAL, LLC
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 050254/0872 →
SECURITY INTEREST Recorded Feb 15, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 048352/0843 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Feb 11, 2019
From: SMARTDRIVE SYSTEMS, INC.
To: ALLY BANK
Reel/Frame 048302/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN; VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 046942/0316 →
Continuity (3)
Continuation 15782140 · Oct 12, 2017
Continuation 15341714 · Nov 2, 2016
Related Publication 20190025827A1 · Jan 24, 2019