IP Library Granted Patent US 12703395
Granted Patent B2
US 12703395 · App. 18/397,472 · Granted Aug 11, 2026

In-vehicle artificial intelligence assistant for critical and undetected scenario accident prevention and related method

Inventors: Divya Garikapati (San Jose, CA); Hiroshi Yasuda (San Carlos, CA)
Assignee: Toyota Jidosha Kabushiki Kaisha
B60W60/0016G08G1/165B60W2540/21B60W2540/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12703395
App. No.
18/397,472
Granted
Aug 11, 2026
Kind
B2
Abstract

Described are systems and methods for minimizing the effects of critical and undetected scenarios using an in-vehicle artificial intelligence system. In one example, the system includes a processor and a memory in communication with the processor. The memory includes instructions that cause the processor to receive an utterance input from an occupant of a vehicle describing a critical scenario that may be undetected by the active safety system of the vehicle. The instructions also cause the processor to determine one or more behavioral measurements of the occupant when the occupant was describing the critical scenario. In response to the utterance input, the behavioral measurement, and the likelihood that the critical scenario can occur at the location of the vehicle, the instructions can cause the vehicle to perform an emergency maneuver to minimize effects of the critical scenario on the vehicle.

Claims (29)

1 . A system comprising:

a processor; and

a memory in communication with the processor, the memory having instructions that, when executed by the processor, cause the processor to:

receive an utterance input from an occupant of a vehicle describing a critical scenario;

responsive to determining that a likelihood of the critical scenario occurring in a location of the vehicle meets a threshold, cause the vehicle to

perform an emergency maneuver to minimize effects of the critical scenario on the vehicle when a mood of the occupant is at least one of anger, sadness, fear, disgust, and surprise; and

responsive to determining that the likelihood of the critical scenario occurring in the location of the vehicle does not meet the threshold, cause the vehicle to (b)-perform the emergency maneuver after receiving additional information from the occupant that the critical scenario is occurring when the mood of the occupant is at least one of being happy and being sociable.

2 . The system of claim 1 , wherein the additional information includes at least one of confirmation that the critical scenario is occurring and a location of the critical scenario.

3 . The system of claim 1 , wherein the mood of the occupant is based on one or more of: a gaze of the occupant, gestures of the occupant, and facial expressions of the occupant.

4 . The system of claim 1 , wherein the memory further includes instructions that, when executed by the processor, cause the processor to activate vehicle sensors to detect the critical scenario in response to the utterance input.

5 . The system of claim 1 , wherein the emergency maneuver is determined based on a behavioral measurement of the occupant.

6 . The system of claim 1 , wherein the memory further includes instructions that, when executed by the processor, cause the processor to leverage external data from external devices and save information that can be referenced later in scenarios where a data streaming ability is limited due to network limitations, the information comprises locations related to elements in the scenarios along with map information.

7 . A method comprising steps of:

receiving an utterance input from an occupant of a vehicle describing a critical scenario;

responsive to determining that a likelihood of the critical scenario occurring in a location of the vehicle meets a threshold, causing the vehicle to

perform an emergency maneuver to minimize effects of the critical scenario on the vehicle when a mood of the occupant is at least one of anger, sadness, fear, disgust, and surprise; and

responsive to determining that the likelihood of the critical scenario occurring in the location of the vehicle does not meet the threshold, causing the vehicle to perform the emergency maneuver after receiving additional information from the occupant that the critical scenario is occurring when the mood of the occupant is at least one of being happy and being sociable.

8 . The method of claim 7 , wherein the additional information includes at least one of confirmation that the critical scenario is occurring and a location of the critical scenario.

9 . The method of claim 7 , wherein the mood of the occupant is based on one or more of: a gaze of the occupant, gestures of the occupant, and facial expressions of the occupant.

10 . The method of claim 7 , further comprising activating vehicle sensors to detect the critical scenario in response to the utterance input.

11 . The method of claim 7 , wherein the emergency maneuver is determined based on a behavioral measurement of the occupant.

12 . The method of claim 7 , further comprising leveraging external data from external devices and saving information that can be referenced later in scenarios where a data streaming ability is limited due to network limitations, the information comprises locations related to elements in the scenarios along with map information.

13 . A non-transitory computer-readable medium having instructions that, when executed by a processor, cause the processor to:

receive an utterance input from an occupant of a vehicle describing a critical scenario;

responsive to determining that a likelihood of the critical scenario occurring in a location of the vehicle meets a threshold, cause the vehicle to

perform an emergency maneuver to minimize effects of the critical scenario on the vehicle when a mood of the occupant is at least one of anger, sadness, fear, disgust, and surprise; and

responsive to determining that the likelihood of the critical scenario occurring in the location of the vehicle does not meet the threshold, cause the vehicle to perform the emergency maneuver after receiving additional information from the occupant that the critical scenario is occurring when the mood of the occupant is at least one of being happy and being sociable.

14 . The non-transitory computer-readable medium of claim 13 , wherein the additional information includes at least one of confirmation that the critical scenario is occurring and a location of the critical scenario.

15 . The non-transitory computer-readable medium of claim 13 , wherein the mood of the occupant is based on one or more of: a gaze of the occupant, gestures of the occupant, and facial expressions of the occupant.