IP Library Granted Patent US 10,437,247
Granted Patent B2
US 10,437,247 · App. 15/673,601 · Granted Oct 8, 2019

Multi-stage operation of autonomous vehicles

Inventors: Akshat Patel (San Francisco, CA); Hugo Boyer (Burlingame, CA); Vineet Singh (Burlingame, CA)
Assignee: UDELV INC.
G05D1/0038G05D1/0027G05D1/0061G05D1/0214G05D1/0223G05D1/0276G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,437,247
App. No.
15/673,601
Granted
Oct 8, 2019
Kind
B2
Abstract

Systems and methods for operating a vehicle by switching between an autonomous control system within the vehicle and a remote operator are described herein. For the handover between the autonomous control system and the remote operator, the system can process current maneuvering parameters of the vehicle to at least select a teleoperation control type. The system can also generate a concurrent feature profile including a set of automated features that are configured to be implemented during teleoperation of the vehicle. The system can implement the handover of vehicle control according to the teleoperation control type while the vehicle autonomously or semi-autonomously operates according to the concurrent feature profile.

Claims (70)

1. A method of operating a system for controlling a vehicle, the method comprising:

detecting one or more current maneuvering parameters of the vehicle, wherein the current maneuvering parameters represent a status of the vehicle or a portion thereof, an environment surrounding the vehicle, or a combination thereof;

generating a handover request based on the one or more current maneuvering parameters, wherein the handover request is for initiating teleoperation for operating the vehicle according to control inputs from an operator located remotely from the vehicle;

generating a concurrent feature profile based on the one or more current maneuvering parameters, wherein the concurrent feature profile represents one or more automated or semi-automated features to be implemented during teleoperation of the vehicle; and

implementing one or more teleoperation commands while operating the vehicle according to the concurrent feature profile, wherein the one or more teleoperation commands represent commands from the remote operator for operating the vehicle.

2. The method of claim 1 , wherein implementing the teleoperation commands while operating the vehicle according to the concurrent feature profile includes:

calculating an autonomous feature threshold based on the current maneuvering parameters, wherein the autonomous feature threshold identifies a geographic distance or area relative to the vehicle; and

operating the vehicle according to the concurrent feature profile and independent of the teleoperation commands based on identifying an abnormality located within the autonomous feature threshold.

3. The method of claim 2 , wherein calculating the autonomous feature threshold includes calculating the autonomous feature threshold based on a current speed of the vehicle, the current maneuvering parameters associated with generating the handover request, a teleoperation control type, or a combination thereof.

4. The method of claim 1 , further comprising:

identifying a teleoperation trigger type for initiating operation of the vehicle according to a remote operator instead of the vehicle autonomously operating itself, wherein the teleoperation trigger type is identified based on the current maneuvering parameters; and

selecting a teleoperation control type based on the teleoperation trigger type, wherein the teleoperation control type indicates details for teleoperating the vehicle.

5. The method of claim 4 , wherein:

identifying the teleoperation trigger type includes identifying a system status trigger representing a condition associated with a vehicle maneuvering system, a computing circuit, a communication circuit, a sensor circuit, an actuator, a storage circuit, a software associated thereto, or a combination thereof within the vehicle; and

selecting the teleoperation control type includes selecting a mode for operating the vehicle according to real-time control commands from the remote operator.

6. The method of claim 4 , wherein:

identifying the teleoperation trigger type includes identifying a decision ambiguity trigger corresponding to a confidence level or an oscillation status of an automated maneuvering decision or a device-generated path; and

selecting the teleoperation control type includes selecting a real-time control mode or a path designation mode, wherein the real-time control mode is for operating the vehicle according to real-time control commands from the remote operator, and the path designation mode is for operating the vehicle to traverse an operator-generated path.

7. The method of claim 4 , further comprising:

generating a safety status based on identification of the teleoperation trigger type, wherein the safety status is generated according to the current maneuvering parameters;

determining a pre-handover maneuver based on the safety status, the teleoperation trigger type, the current maneuvering parameters, or a combination thereof, wherein the pre-handover maneuver is for maneuvering the vehicle in preparation for the teleoperation; and

implementing the pre-handover maneuver before implementing the teleoperation commands.

8. The method of claim 7 , wherein determining the pre-handover maneuver includes determining an emergency stop maneuver based on the safety status.

9. The method of claim 7 , wherein determining the pre-handover maneuver includes determining a reduced speed.

10. The method of claim 9 , further comprising:

communicating a handover request for notifying the remote operator to control the vehicle;

tracking an awaiting-reply timer based on communicating the handover request;

determining a reply timing threshold based on the reduced speed and an upcoming abnormality location;

calculating a pullover location for stopping the vehicle outside of traffic flow, wherein the pullover location is between a current vehicle location and the upcoming abnormality location; and

wherein:

determining the pre-handover maneuver includes determining a pullover maneuver when the awaiting-reply timer exceeds the reply timing threshold, wherein the pullover maneuver is for maneuvering the vehicle to a stop at the pullover location.

11. The method of claim 7 , wherein determining the pre-handover maneuver includes:

calculating a pullover location based on the safety status, the teleoperation trigger type, the current maneuvering parameters, or a combination thereof, wherein the pullover location is outside of traffic flow and between a current vehicle location and the upcoming abnormality location; and

determining a pullover maneuver for the pre-handover maneuver independent of communicating a handover request for notifying the remote operator to control the vehicle.

12. The method of claim 1 , further comprising:

communicating the current maneuvering parameters to the remote operator in real-time;

wherein implementing the teleoperation commands includes:

receiving real-time control commands representing operating inputs from the remote operator; and

controlling the vehicle according to the real-time control commands generated by the remote operator.

13. The method of claim 1 , further comprising:

communicating the current maneuvering parameters to the remote operator in real-time;

wherein implementing the teleoperation commands includes:

receiving operator-generated path representing a set of geographic locations for the vehicle to follow; and

controlling the vehicle to traverse the operator-generated path.

14. The method of claim 1 , further comprising:

after implementing the teleoperation commands, storing the teleoperation commands along with the current maneuvering parameters, analysis results thereof, resulting states, or a combination thereof corresponding to the teleoperation commands; and

accessing the teleoperation commands based on matching the current maneuvering parameters, the analysis results thereof, the resulting states, or a combination thereof, wherein the teleoperation commands is accessed for maneuvering the vehicle at a later time in response to a condition associated with the previous implementation of the teleoperation commands.

15. A non-transitory computer-readable medium encoded with instructions that, when executed by a processor, perform a method of operating a system for controlling a vehicle, the method comprising:

detecting one or more current maneuvering parameters of the vehicle, wherein the current maneuvering parameters represent a status of the vehicle or a portion thereof, an environment surrounding the vehicle, or a combination thereof;

generating a handover request based on the one or more current maneuvering parameters, wherein the handover request is for initiating teleoperation for operating the vehicle according to control inputs from an operator located remotely from the vehicle;

generating a concurrent feature profile based on the one or more current maneuvering parameters, wherein the concurrent feature profile represents one or more automated or semi-automated features to be implemented during teleoperation of the vehicle; and

implementing one or more teleoperation commands while operating the vehicle according to the concurrent feature profile, wherein the one or more teleoperation commands represent commands from the remote operator for operating the vehicle.

16. The non-transitory computer-readable medium of claim 15 including the method, wherein implementing the teleoperation commands while operating the vehicle according to the concurrent feature profile including:

calculating an autonomous feature threshold based on the current maneuvering parameters, wherein the autonomous feature threshold identifies a geographic distance or area relative to the vehicle; and

operating the vehicle according to the concurrent feature profile and independent of the teleoperation commands based on identifying an abnormality located within the autonomous feature threshold.

17. The non-transitory computer-readable medium of claim 16 including the method, wherein calculating the autonomous feature threshold includes calculating the autonomous feature threshold based on a current speed of the vehicle, the current maneuvering parameters associated with generating the handover request, a teleoperation control type, or a combination thereof.

18. The non-transitory computer-readable medium of claim 15 including the method, the method further comprising:

identifying a teleoperation trigger type for initiating operation of the vehicle according to a remote operator instead of the vehicle autonomously operating itself, wherein the teleoperation trigger type is identified based on the current maneuvering parameters; and

selecting a teleoperation control type based on the teleoperation trigger type, wherein the teleoperation control type indicates details for teleoperating the vehicle.

19. The non-transitory computer-readable medium of claim 18 including the method, wherein:

identifying the teleoperation trigger type including identifying a system status trigger or a decision ambiguity trigger, wherein:

the system trigger represents a condition associated with a component or software within the vehicle, and the decision ambiguity trigger corresponds to a confidence level or an oscillation status of an automated maneuvering decision or a device-generated path; and

selecting the teleoperation control type including selecting a real-time control mode or a path designation mode based on the teleoperation trigger type, wherein:

the real-time mode is for operating the vehicle according to real-time control commands from the remote operator, and the path designation mode is for operating the vehicle to traverse an operator-generated path.

20. A vehicle controlling system, comprising:

an interface configured to receive one or more current maneuvering parameters associated with a vehicle, wherein the current maneuvering parameters represent a status of the vehicle or a portion thereof, an environment surrounding the vehicle, or a combination thereof;

one or more processors, operably coupled to the interface, configured to:

process a handover request corresponding to the one or more current maneuvering parameters, wherein the handover request is for initiating teleoperation for operating the vehicle according to control inputs from an operator located remotely from the vehicle;

generate a concurrent feature profile based on the one or more current maneuvering parameters, wherein the concurrent feature profile represents one or more automated features to be implemented during teleoperation of the vehicle; and

implement one or more teleoperation commands while operating the vehicle according to the concurrent feature profile, wherein the one or more teleoperation commands represent commands from the remote operator for operating the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: PATEL, AKSHAT; BOYER, HUGO; SINGH, VINEET
To: UDELV INC.
Reel/Frame 043434/0513 →
Continuity (1)
Related Publication 20190049948A1 · Feb 14, 2019
Cited By (4)
US 12,384,410 US 12,461,523 US 12,555,385 US 12,675,753