IP Library Granted Patent US 11,334,068
Granted Patent B2
US 11,334,068 · App. 16/899,377 · Granted May 17, 2022

Measuring operator readiness and readiness testing triggering in an autonomous vehicle

Inventors: Jason Palmer (Carlsbad, CA); Mark Freitas (San Diego, CA); Daniel A. Deninger (Carlsbad, CA); David Forney (La Jolla, CA); Slaven Sljivar (San Diego, CA); Alekh Vaidya (San Diego, CA); Jeffrey Griswold (San Diego, CA)
Assignee: SMARTDRIVE SYSTEMS, INC.
G05D1/0061G07C5/008B60W2040/0863B60W2552/05B60W2552/40B60W2554/00B60Y2302/05G05D2201/0213G07C5/0841
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,334,068
App. No.
16/899,377
Granted
May 17, 2022
Kind
B2
Abstract

This disclosure relates to a system and method for transitioning vehicle control between autonomous operation and manual operation. The system includes sensors configured to generate output signals conveying information related to the vehicle and its operation. During autonomous vehicle operation, the system gauges the level of responsiveness of a vehicle operator through challenges and corresponding responses. The system determines when to present a challenge to the vehicle operator based on internal and external factors. If necessary, the system will transition from an autonomous operation mode to a manual operation mode.

Claims (55)

1. A system configured to determine whether to transition vehicle control of a vehicle between an autonomous operation mode and another mode of operation that is not the autonomous operation mode, the system configured to couple with the vehicle, the system comprising:

a user interface configured to provide an interface between the system and a vehicle operator to gauge responsiveness of the vehicle operator; and

one or more processors configured to:

present, while the vehicle is being controlled through the autonomous operation mode, through the user interface, a challenge to the vehicle operator to gauge the responsiveness of the vehicle operator, wherein the challenge corresponds to an expected response by the vehicle operator, and wherein continued control of the vehicle through the autonomous operation mode requires the vehicle operator to provide a response to the challenge that matches the expected response;

detect whether the vehicle operator provides the response to the challenge that matches the expected response, wherein detection is based on an interaction involving the vehicle operator; and

determine whether to effectuate continued operation in the autonomous operation mode of the vehicle or to effectuate a transition of the vehicle control to another mode of operation that is not the autonomous operation mode, wherein the determination is based on the detection.

2. The system of claim 1 , wherein the expected response is a particular interaction by the vehicle operator with the user interface, and wherein the detection is based on the interaction between the vehicle operator and the user interface.

3. The system of claim 1 , wherein the one or more processors are further configured to:

determine a level of responsiveness of the vehicle operator based on the detection whether the vehicle operator has provided the response to the challenge that matches the expected response,

wherein either the continued operation in the autonomous operation mode or the transition of the vehicle control to another mode of operation that is not the autonomous operation mode by the vehicle operator is based on the determined level of responsiveness.

4. The system of claim 1 , wherein the one or more processors are further configured to:

operate the vehicle autonomously in the autonomous operation mode; and

determine an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue operating the vehicle;

wherein the challenge is presented at a first moment in time,

wherein the one or more processors are further configured to determine the first moment in time based on the automation confidence.

5. The system of claim 4 , wherein the one or more processors are further configured to:

determine whether the level of responsiveness meets a threshold of adequate responsiveness to continue operating in the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bring the vehicle to a stop.

6. The system of claim 4 , wherein the level of responsiveness of the vehicle operator is determined in an ongoing manner for a period extending beyond 15 minutes, and wherein determination of the first moment in time is further based on the level of responsiveness.

7. The system of claim 4 , wherein the one or more processors are further configured such that determination of the automation confidence is based on one or more of traffic information related to current traffic parameters, environmental information related to surface parameters of the road, or weather parameters.

8. The system of claim 1 , wherein the system further comprises a set of sensors configured to generate output signals conveying information related to vehicle operation, wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determination of the first moment in time is based on the output signal.

9. The system of claim 8 , wherein the one or more processors are further configured to:

capture information conveyed by the output signals proximate in time to the presentation of the challenge; and

generate a first event record associated with the challenge and the response, wherein the first event record includes the captured information.

10. The system of claim 1 , wherein the one or more processors are further configured to:

determine an operator confidence that the vehicle operator is currently prepared to assume manual control of vehicle operation,

wherein presentation of the challenge is timed based on the operator confidence.

11. The system of claim 1 , wherein the challenge includes generation of one or both of a sound and a tactile notification, wherein the vehicle operator provides the response through tactile feedback, wherein the level of responsiveness is based on elapsed time between the challenge and the response.

12. A method to transition vehicle control of a vehicle between an autonomous operation mode and another mode of operation that is not the autonomous operation mode, the method comprising:

providing, by a user interface, an interface between a vehicle and a vehicle operator to gauge responsiveness of the vehicle operator;

presenting, while the vehicle is being controlled through the autonomous operation mode, through the user interface, a challenge to the vehicle operator to gauge the responsiveness of the vehicle operator, wherein the challenge corresponds to an expected response by the vehicle operator, and wherein continued control of the vehicle through the autonomous operation mode requires the vehicle operator to provide a response to the challenge that matches the expected response;

detecting whether the vehicle operator provides the response to the challenge that matches the expected response, wherein detection is based on an interaction involving the vehicle operator; and

determining whether to effectuate continued operation in the autonomous operation mode of the vehicle or to effectuate a transition of the vehicle control to another mode of operation that is not the autonomous operation mode, wherein the determination is based on the detection.

13. The method of claim 12 , wherein the expected response is a particular interaction by the vehicle operator with the user interface, and wherein the detecting is based on the interaction between the vehicle operator and the user interface.

14. The method of claim 12 , further comprising:

determining a level of responsiveness of the vehicle operator based on the detection whether the vehicle operator has provided the response to the challenge that matches the expected response,

wherein either the continued operation in the autonomous operation mode or the transition of the vehicle control to another mode of operation that is not the autonomous operation mode by the vehicle operator is based on the determined level of responsiveness.

15. The method of claim 12 , further comprising:

operating the vehicle autonomously in the autonomous operation mode; and

determining an automation confidence that the autonomous operation mode of the vehicle is currently prepared to continue operating the vehicle;

wherein the challenge is presented at a first moment in time,

wherein the method further comprises determining the first moment in time based on the automation confidence.

16. The method of claim 15 , further comprising:

determining whether the level of responsiveness meets a threshold of adequate responsiveness to continue operating in the autonomous operation mode; and

responsive to the level of responsiveness failing to meet the threshold of adequate responsiveness, bringing the vehicle to a stop.

17. The method of claim 12 , further comprising:

generating output signals conveying information related to vehicle operation;

wherein the output signals convey one or more of biometric information of the vehicle operator, operator information related to a direction of view of the vehicle operator, traffic information related to current traffic parameters, and environmental information related to surface parameters of the road, or wherein determining the first moment in time is based on the output signal.

18. The method of claim 17 , further comprising:

capturing information conveyed by the output signals proximate in time to the presentation of the challenge; and

generating a first event record associated with the challenge and the response, wherein the first event record includes the captured information.

19. The method of claim 12 , further comprising:

determining an operator confidence that the vehicle operator is currently prepared to assume manual control of vehicle operation,

wherein presenting the challenge is timed based on the operator confidence.

20. The method of claim 12 , wherein presenting the challenge includes generating one or both of a sound and a tactile notification, wherein detecting the response includes detecting tactile feedback, and wherein determining the level of responsiveness includes determining elapsed time between the challenge and the response.

Assignments (9)
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056601 FRAME 0630. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 058174/0907 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER D856640 PREVIOUSLY RECORDED ON REEL 056598 FRAME 0059. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN PATENT SECURITY AGREEMENT. Recorded Nov 17, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 058175/0775 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: GOLDMAN SACHS LENDING PARTNERS LLC, AS COLLATERAL AGENT
Reel/Frame 056601/0630 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 16, 2021
From: OMNITRACS, LLC; ROADNET TECHNOLOGIES, INC.; SMARTDRIVE SYSTEMS, INC.; XRS CORPORATION; HYPERQUEST, LLC (F/K/A HYPERQUEST, INC.); AUDATEX NORTH AMERICA, LLC (F/K/A AUDATEX NORTH AMERICA, INC.); CLAIMS SERVICES GROUP, LLC; DMEAUTOMOTIVE LLC; ENSERVIO, LLC (F/K/A ENSERVIO, INC.); MOBILE PRODUCTIVITY, LLC; SEE PROGRESS, LLC (F/K/A SEE PROGRESS, INC.); SOLERA HOLDINGS, LLC (F/K/A SOLERA HOLDINGS, INC.); EDRIVING FLEET LLC; FINANCE EXPRESS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 056598/0059 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0320) Recorded Jun 8, 2021
From: BARCLAYS BANK PLC, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056520/0944 →
SECURITY INTEREST RELEASE (REEL/FRAME: 054236/0435) Recorded Jun 8, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS GRANTEE
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 056518/0845 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054236/0435 →
SECURITY INTEREST Recorded Oct 6, 2020
From: SMARTDRIVE SYSTEMS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 054236/0320 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: PALMER, JASON; FREITAS, MARK; DENINGER, DANIEL A.; FORNEY, DAVID; SLJIVAR, SLAVEN; VAIDYA, ALEKH; GRISWOLD, JEFFREY
To: SMARTDRIVE SYSTEMS, INC.
Reel/Frame 052914/0563 →
Continuity (4)
Continuation 16138588 · Sep 21, 2018
Continuation 15782140 · Oct 12, 2017
Continuation 15341714 · Nov 2, 2016
Related Publication 20200301417A1 · Sep 24, 2020