IP Library Granted Patent US 12,269,491
Granted Patent B2
US 12,269,491 · App. 18/108,709 · Granted Apr 8, 2025

Methods and systems for increasing autonomous vehicle safety and flexibility using voice interaction

Inventors: Nils Lenke (Aachen, DE); Johan Wouters (Cham, CH); Adam Emfield (Concord, MA); Sumanta Chakraborty (San Ramon, CA); Charles L. Ortiz, Jr. (Fremont, CA)
Assignee: Cerence Operating Company
B60W50/08B60W30/18G05D1/0088G10L15/22B60W2050/007B60W2050/0074B60W2420/403B60W2540/043B60W2540/21G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,269,491
App. No.
18/108,709
Granted
Apr 8, 2025
Kind
B2
Abstract

A vehicle control system executing a voice control system for facilitating voice-based dialog with a driver to enable the driver or autonomous vehicle to control certain operational aspects of an autonomous vehicle is provided. Using environmental and sensor input, the vehicle control system can select optimal routes for operating the vehicle in an autonomous mode or choose a preferred operational mode. Occupants of the autonomous vehicle can change a destination, route or driving mode by engaging with the vehicle control system in a dialog enabled by the voice control system.

Claims (21)

1. A method comprising using a voice-control system to cause a vehicle to transition from operating in a first mode to operating in a second mode, wherein causing said vehicle to transition comprises causing said voice-control system to execute, while said vehicle is operating in said first mode, a determining step, a generating step, a receiving step, and a responding step, wherein said determining step comprises making a determination that operation in a second mode has become available, wherein said generating step comprises, in response to having made said determination, making an announcement, wherein said announcement indicates that operation in said second mode is available, wherein said receiving step comprises receiving an utterance indicating a desire to cause said transition, wherein said responding step comprises instructing said vehicle to operate in said second mode, wherein said determining step further comprises determining that there exist first and second routes along which said operation in said second mode is available, wherein said method further comprises announcing said routes and receiving an instruction to traverse said first route in said second mode, and wherein instructing said vehicle to operate in said second mode comprises instructing said vehicle to operate in said second mode along said first route.

2. The method of claim 1 , further comprising, after having instructed said vehicle to operate in said second mode, determining a need to a transition back into said first mode, announcing a need to make said transition, receiving an utterance acknowledging said transition, and instructing said vehicle to return to operating in said first mode.

3. The method of claim 1 , wherein said first mode is a manual mode and said second mode is an autonomous mode.

4. The method of claim 1 , further comprising, prior to said responding step, causing said voice control system to identify, in said utterance, information indicative of an event that is to occur before said transition and wherein said method comprises instructing said vehicle to operate in said second mode only upon having detected occurrence of said event.

5. The method of claim 1 , wherein making said determination that operation in said second mode has become available comprises using a vehicle context manager to make said determination based at least in part on information provided by a sensor.

6. The method of claim 1 , wherein making said determination that operation in said second mode has become available comprises detecting entry into an area that allows for operation in said second mode, wherein said second mode is an autonomous mode.

7. A method comprising using a voice-control system to cause a vehicle to transition from operating in a first mode to operating in a second mode, wherein causing said vehicle to transition comprises causing said voice-control system to execute, while said vehicle is operating in said first mode, a determining step, a generating step, a receiving step, and a responding step, wherein said determining step comprises making a determination that operation in a second mode has become available, wherein said generating step comprises, in response to having made said determination, making an announcement, wherein said announcement indicates that operation in said second mode is available, wherein said receiving step comprises receiving an utterance indicating a desire to cause said transition, and wherein said responding step comprises instructing said vehicle to operate in said second mode, said method further comprising, after having received said utterance indicating said desire to cause said transition, identifying a preferred route, wherein instructing said vehicle to operate in said second mode comprises instructing said vehicle to operate in said second mode along said preferred route.

8. The method of claim 7 , further comprising, after having instructed said vehicle to operate in said second mode, determining a need to a transition back into said first mode, announcing a need to make said transition, receiving an utterance acknowledging said transition, and instructing said vehicle to return to operating in said first mode.

9. The method of claim 7 , wherein said first mode is a manual mode and said second mode is an autonomous mode.

10. The method of claim 7 , further comprising, prior to said responding step, causing said voice control system to identify, in said utterance, information indicative of an event that is to occur before said transition and wherein said method comprises instructing said vehicle to operate in said second mode only upon having detected occurrence of said event.

11. The method of claim 7 , wherein making said determination that operation in said second mode has become available comprises using a vehicle context manager to make said determination based at least in part on information provided by a sensor.

12. The method of claim 7 , wherein making said determination that operation in said second mode has become available comprises detecting entry into an area that allows for operation in said second mode, wherein said second mode is an autonomous mode.

13. A method comprising using a voice-control system to cause a vehicle to transition from operating in a first mode to operating in a second mode, wherein causing said vehicle to transition comprises causing said voice-control system to execute, while said vehicle is operating in said first mode, a determining step, a generating step, a receiving step, and a responding step, wherein said determining step comprises making a determination that operation in a second mode has become available, wherein said generating step comprises, in response to having made said determination, making an announcement, wherein said announcement indicates that operation in said second mode is available, wherein said receiving step comprises receiving an utterance indicating a desire to cause said transition, and wherein said responding step comprises instructing said vehicle to operate in said second mode, said method further comprising, after having received said utterance indicating said desire to cause said transition, determining that a new route is required to operate in said second mode and wherein instructing said vehicle to operate in said second mode comprises instructing said vehicle to operate in said second mode along said new route.

14. The method of claim 13 , further comprising, after having instructed said vehicle to operate in said second mode, determining a need to a transition back into said first mode, announcing a need to make said transition, receiving an utterance acknowledging said transition, and instructing said vehicle to return to operating in said first mode.

15. The method of claim 13 , wherein said first mode is a manual mode and said second mode is an autonomous mode.

16. The method of claim 13 , further comprising, prior to said responding step, causing said voice control system to identify, in said utterance, information indicative of an event that is to occur before said transition and wherein said method comprises instructing said vehicle to operate in said second mode only upon having detected occurrence of said event.

17. The method of claim 13 , wherein making said determination that operation in said second mode has become available comprises using a vehicle context manager to make said determination based at least in part on information provided by a sensor.

18. The method of claim 13 , wherein making said determination that operation in said second mode has become available comprises detecting entry into an area that allows for operation in said second mode, wherein said second mode is an autonomous mode.

19. A method comprising using a voice-control system to cause a vehicle to transition from operating in a first mode to operating in a second mode, wherein causing said vehicle to transition comprises causing said voice-control system to execute, while said vehicle is operating in said first mode, a determining step, a generating step, a receiving step, and a responding step, wherein said determining step comprises making a determination that operation in a second mode has become available, wherein said generating step comprises, in response to having made said determination, making an announcement, wherein said announcement indicates that operation in said second mode is available, wherein said receiving step comprises receiving an utterance indicating a desire to cause said transition, wherein said responding step comprises instructing said vehicle to operate in said second mode, and wherein making said determination that operation in said second mode has become available comprises determining that said vehicle has entered a portion of a route having a speed limit that is larger than a predetermined threshold speed limit.

20. The method of claim 19 , further comprising, after having instructed said vehicle to operate in said second mode, determining a need to a transition back into said first mode, announcing a need to make said transition, receiving an utterance acknowledging said transition, and instructing said vehicle to return to operating in said first mode.

21. The method of claim 19 , wherein said first mode is a manual mode and said second mode is an autonomous mode.

Assignments (3)
RELEASE (REEL 067417 / FRAME 0303) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0422 →
SECURITY AGREEMENT Recorded Apr 15, 2024
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 067417/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: LENKE, NILS; WOUTERS, JOHAN; EMFIELD, ADAM; CHAKRABORTY, SUMANTA; ORTIZ, CHARLES L., JR.
To: CERENCE OPERATING COMPANY
Reel/Frame 062816/0376 →
Cited By (1)
US 12,547,172