IP Library Granted Patent US 12,027,050
Granted Patent B2
US 12,027,050 · App. 17/707,878 · Granted Jul 2, 2024

Hazard notification method and system for implementing

Inventor: Daisuke Hashimoto (Chofu, JP)
Assignee: WOVEN BY TOYOTA, INC.
G08G1/162B60W40/02B60W40/09B60W50/14B60W2420/403B60W2510/20B60W2540/00B60W2540/225B60W2556/65
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,027,050
App. No.
17/707,878
Granted
Jul 2, 2024
Kind
B2
Abstract

A method of identifying a hazard includes receiving control parameter data from a first sensor attached to a vehicle, wherein the control parameter data is associated with a behavior of an occupant of the vehicle. The method further includes comparing the control parameter data with a performance distribution of the occupant to determine whether the control parameter indicates abnormal behavior. The method further includes identifying, in response to a determination that the control parameter indicates abnormal behavior, sensor data to be collected from a second sensor attached to the vehicle. The method further includes generating log data based on the collected sensor data. The method further includes transmitting the log data to an external device.

Claims (41)

1. A method of identifying a hazard, the method comprising:

receiving control parameter data from a first sensor attached to a vehicle, wherein the control parameter data is associated with a behavior of an occupant of the vehicle;

comparing the control parameter data with a performance distribution of the occupant to determine whether the control parameter indicates abnormal behavior;

identifying, in response to a determination that the control parameter indicates abnormal behavior, sensor data to be collected from a second sensor attached to the vehicle;

generating log data based on the collected sensor data; and

transmitting the log data to an external device.

2. The method according to claim 1 , wherein comparing the control parameter data with the performance distribution comprises:

determining that the control parameter indicates abnormal behavior in response to the control parameter data being three or more standard deviations from a peak value of the performance distribution.

3. The method according to claim 1 , wherein receiving the control parameter data comprises receiving data related to at least one of acceleration of the vehicle, steering of the vehicle, or speed of the vehicle.

4. The method according to claim 1 , wherein receiving the control parameter data comprises receiving gaze data indicating a direction in which a gaze of the occupant is directed.

5. The method according to claim 1 , wherein identifying the sensor data to be collected comprises identifying image data from a camera attached to the vehicle.

6. The method according to claim 5 , further comprising cropping the image data prior to generating the log data.

7. The method according to claim 1 , wherein generating the log data comprises associating the collected sensor data with a location at which the sensor data was captured.

8. The method according to claim 1 , further comprising capturing an image of an environment surrounding the vehicle.

9. The method according to claim 8 , further comprises performing object recognition on the image, using a trained neural network, to determine whether an abnormal object is present in the image.

10. The method according to claim 8 , further comprising performing scene classification on the image, using a trained neural network, to determine whether an abnormal scene is present in the image.

11. The method according to claim 8 , further comprising performing semantic segmentation on the image, using a trained neural network, to generate a bitmap of the environment surrounding the vehicle.

12. A hazard identification system, the system comprising:

a non-transitory computer readable medium configured to store instructions thereon; and

a processor connected to the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

receiving control parameter data from a first sensor attached to a vehicle, wherein the control parameter data is associated with a behavior of an occupant of the vehicle;

comparing the control parameter data with a performance distribution of the occupant to determine whether the control parameter indicates abnormal behavior;

identifying, in response to a determination that the control parameter indicates abnormal behavior, sensor data to be collected from a second sensor attached to the vehicle;

generating log data based on the collected sensor data; and

generating instructions for transmitting the log data to an external device.

13. The system according to claim 12 , wherein the processor is further configured to execute the instructions for determining that the control parameter indicates abnormal behavior in response to the control parameter data being three or more standard deviations from a peak value of the performance distribution.

14. The system according to claim 12 , wherein the processor is further configured to execute the instructions for receiving the control parameter data comprising data related to at least one of acceleration of the vehicle, steering of the vehicle, or speed of the vehicle.

15. The system according to claim 12 , wherein the processor is further configured to execute the instructions for receiving the control parameter data comprising gaze data indicating a direction in which a gaze of the occupant is directed.

16. The system according to claim 12 , wherein the processor is further configured to execute the instructions for identifying the sensor data to be collected comprising image data from a camera attached to the vehicle.

17. The system according to claim 16 , wherein the processor is further configured to execute the instructions for cropping the image data prior to generating the log data.

18. The system according to claim 12 , wherein the processor is further configured to execute the instructions for generating the log data comprising associating the collected sensor data with a location at which the sensor data was captured.

19. A method of notifying a notified vehicle of a hazard, the method comprising:

receiving control parameter data from a first sensor attached to a detecting vehicle, wherein the control parameter data is associated with a behavior of an occupant of the detecting vehicle;

comparing the control parameter data with a performance distribution of the occupant of the detecting vehicle to determine whether the control parameter indicates abnormal behavior;

generating log data based on data from a second sensor attached to the detecting vehicle in response to a determination that the control parameter indicates abnormal behavior; and

transmitting the log data to the notified vehicle; and

notifying an occupant of the notified vehicle of a hazard based on the log data.

20. The method according to claim 19 , wherein transmitting the log data comprises:

transmitting the log data from the detecting vehicle to a server;

encoding the log data using the server; and

transmitting the encoded log data to the notified vehicle.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded May 26, 2023
From: WOVEN ALPHA, INC.; WOVEN BY TOYOTA, INC.
To: WOVEN BY TOYOTA, INC.
Reel/Frame 063769/0764 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2023
From: HASHIMOTO, DAISUKE
To: WOVEN ALPHA, INC.
Reel/Frame 062289/0189 →
Continuity (1)
Related Publication 20230316919A1 · Oct 5, 2023