IP Library Granted Patent US 12,079,702
Granted Patent B2
US 12,079,702 · App. 17/103,096 · Granted Sep 3, 2024

Driving automation device to mitigate the risk of other road users

Inventors: Joshua E. Domeyer (Madison, WI); Benjamin P. Austin (Saline, MI); John K. Lenneman (Okemos, MI)
Assignee: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
G06N3/04G08G1/0112G08G1/161G08G1/166B60W30/095B60W2554/404B60W2756/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,079,702
App. No.
17/103,096
Granted
Sep 3, 2024
Kind
B2
Abstract

A system and method for a host vehicle to assess risk for road users is disclosed. The host vehicle monitors its surrounding driving environment and sends alerts to road users if a threat is detected. The host vehicle can determine the best course of action to mitigate a threat, and coordinate such action. The host vehicle comprises processing circuitry configured to perform the foregoing tasks. Further, the host vehicle may use a machine learning-based system comprising a trained neural network.

Claims (38)

1. A method for broadcasting safety related information from a host vehicle traveling on a road, the method comprising:

monitoring, from the host vehicle, behavior of a first road user and a second road user, the first road user and the second road user being different from the host vehicle;

determining, based on the monitored behavior of the first road user and the second road user, whether a threat to the first road user or the second road user is present and whether the first road user or the second road user is mitigating the threat, the threat being determined based on movement of the first road user or the second road user relative to other objects disposed about the road;

determining which of the host vehicle and another road user is to alert at least one of the first road user or the second road user of the threat in a case that the first road user or the second road user is not mitigating the threat;

signaling, by physical operation of the host vehicle, to alert the at least one of the first road user or the second road user of the threat in a case that the host vehicle is to alert the at least one of the first road user or the second road user of the threat; and

signaling to the other road user to alert the at least one of the first road user or the second road user of the threat in a case that the other road user is to alert the at least one of the first road user or the second road user of the threat, by a physical operation of a vehicle of the other road user.

2. The method of claim 1 , wherein the host vehicle includes a machine learning-based system to determine whether the threat is present, the machine learning-based system comprising a trained neural network.

3. The method of claim 1 , wherein the host vehicle is a semi-autonomous vehicle or an autonomous vehicle.

4. The method of claim 1 , wherein the signaling, by the physical operation of the host vehicle, is transmitted auditorily, visually, using wireless communication, or via a combination thereof.

5. The method of claim 1 , wherein the signaling, by the physical operation of the host vehicle, is at least an intervention by the host vehicle, the intervention being a change in position, speed, or a combination thereof by the host vehicle.

6. The method of claim 1 , further comprising:

obtaining, from collected sensor data by the host vehicle, a magnitude of the threat in the case that the threat is determined to be present, wherein the magnitude of the threat depends on speed of the first road user or the second road user relative to other objects disposed about the road, size of the first road user or second road user relative to other objects disposed about the road, or a combination thereof.

7. The method of claim 1 , wherein monitoring behavior of the first road user and the second road user includes monitoring for a distraction level by the host vehicle, the distraction level being determined by at least one of the first road user's head orientation or the second road user's head orientation.

8. The method of claim 1 , wherein determining which of the host vehicle and the other vehicle of the other road user is to alert the at least one of the first road user or the second road user is a determination made based upon visibility.

9. The method of claim 6 , wherein the signaling, by the physical operation of the host vehicle, is at least an execution of a course of action that mitigates the magnitude of the threat.

10. The method of claim 6 , wherein a degree of the signaling, by the physical operation of the host vehicle, increases as the magnitude of the threat increases.

11. A system for broadcasting safety related information from a host vehicle traveling on a road, the system comprising:

processing circuitry configured to:

monitor, from the host vehicle, behavior of a first road user and a second road user;

determine, based on the monitored behavior of the first road user and the second road user, whether a threat to the first road user or the second road user is present and whether the first road user or the second road user is mitigating the threat, the threat being determined based on movement of the first road user or the second road user relative to other objects disposed about the road;

determining which of the host vehicle and another road user is to alert at least one of the first road user or the second road user of the threat in a case that the first road user or the second road user is not mitigating the threat;

cause the host vehicle to signal, by physical operation of thereof, to alert the at least one of the first road user or the second road user of the threat in a case that the host vehicle is to alert the at least one of the first road user or the second road user of the threat; and

signal to the other road user to alert the at least one of the first road user or the second road user of the threat in a case that the other road user is to alert the at least one of the first road user or the second road user of the threat, by a physical operation of a vehicle of the other road user.

12. The system of claim 11 , wherein the host vehicle includes a machine learning-based system to determine whether the threat is present, the machine learning-based system comprising a trained neural network.

13. The system of claim 11 , wherein the host vehicle is a semi-autonomous vehicle or an autonomous vehicle.

14. The system of claim 11 , wherein the signal, by the physical operation of the host vehicle, is transmitted auditorily, visually, using wireless communication, or via a combination thereof.

15. The system of claim 11 , wherein the signal, by the physical operation of the host vehicle, is at least an intervention by the host vehicle, the intervention being a change in position, speed, or a combination thereof by the host vehicle.

16. The system of claim 11 , wherein the processing circuitry is further configured to:

obtain, from collected sensor data by the host vehicle, a magnitude of the threat in the case that the threat is determined to be present, wherein the magnitude of the threat depends on speed of the first road user or the second road user relative to other objects disposed about the road, size of the first road user or second road user relative to other objects disposed about the road, or a combination thereof.

17. The system of claim 11 , wherein monitored behavior of the first road user and the second road user includes monitoring for a distraction level by the host vehicle, the distraction level being determined by at least one of the first road user's head orientation or the second road user's head orientation.

18. The system of claim 16 , wherein the signal, by the physical operation of the host vehicle, is at least an execution of a course of action that mitigates the magnitude of the threat.

19. The system of claim 16 , wherein a degree of the signal, by the physical operation of the host vehicle, increases as the magnitude of the threat increases.

20. A non-transitory computer-readable medium including computer-readable instructions that, when executed by a computing system, cause the computing system to sort data by performing a method comprising:

monitoring, from a host vehicle, behavior of a first road user and a second road user;

determining, based on the monitored behavior of the first road user and the second road user, whether a threat to the first road user or the second road user is present and whether the first road user or the second road user is mitigating the threat, the threat being determined based on movement of the first road user or the second road user relative to other objects disposed about the road;

determining which of the host vehicle and another road user is to alert at least one of the first road user or the second road user of the threat in a case that the first road user or the second road user is not mitigating the threat;

signaling, by physical operation of the host vehicle, to alert the at least one of the first road user or the second road user of the threat in a case that the host vehicle is to alert the at least one of the first road user or the second road user of the threat; and

signaling to the other road user to alert the at least one of the first road user or the second road user of the threat in a case that the other road user is to alert the at least one of the first road user or the second road user of the threat, by a physical operation of a vehicle of the other road user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2024
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 068886/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2020
From: DOMEYER, JOSHUA E.; AUSTIN, BENJAMIN P.; LENNEMAN, JOHN K.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 054459/0525 →
Continuity (1)
Related Publication 20220161823A1 · May 26, 2022