IP Library Granted Patent US 10,147,324
Granted Patent B1
US 10,147,324 · App. 15/645,569 · Granted Dec 4, 2018

Providing user assistance in a vehicle based on traffic behavior models

Inventor: James J. Kuffner, Jr. (Sunnyvale, CA)
Assignee: Toyota Research Institute, Inc.
G08G1/166G06K9/00798G08G1/0112G08G1/0133H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,147,324
App. No.
15/645,569
Granted
Dec 4, 2018
Kind
B1
Abstract

Providing user assistance in a vehicle includes evaluating information about an environment surrounding the vehicle, including identifying an object in the environment surrounding the vehicle, and predicting, based on the evaluation of the information about the environment surrounding the vehicle, the future maneuvering of the object. The user assistance further includes receiving a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects. The prediction includes switching from extrapolating the predominating traffic behavior of the like population of reference objects, to, in response to identifying a traffic behavior of the object, extrapolating the traffic behavior of the object.

Claims (64)

1. A vehicle, comprising:

at least one processor; and

a memory communicably coupled to the at least one processor and storing:

a perception module including instructions that when executed by the at least one processor cause the at least one processor to:

evaluate information about an environment surrounding the vehicle, the evaluation including identifying an object in the environment surrounding the vehicle; and

identify, based on the evaluation of the information about the environment surrounding the vehicle, a traffic behavior of the object; and

a planning/decision making module including instructions that when executed by the at least one processor cause the at least one processor to:

receive a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects; and

predict, based on the evaluation of the information about the environment surrounding the vehicle, a future maneuvering of the object, the prediction including switching from extrapolating the predominating traffic behavior of the like population of reference objects, to, in response to identifying the traffic behavior of the object, extrapolating the traffic behavior of the object.

2. The vehicle of claim 1 , wherein the planning/decision making module includes instructions that when executed by the at least one processor cause the at least one processor to issue, at at least one interface, an alert to a user of the predicted future maneuvering of the object.

3. The vehicle of claim 1 , wherein:

the traffic behavior model describes traffic maneuvers performed by the like population of reference objects; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes a predicted traffic maneuver identified from among the traffic maneuvers performed by the like population of reference objects.

4. The vehicle of claim 3 , wherein:

the traffic behavior model describes predominating attributes of how the like population of reference objects performs the traffic maneuvers; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes at least one attribute of how the object is predicted to perform the predicted traffic maneuver that matches a corresponding at least one predominating attribute of how the like population of reference objects performs the traffic maneuver.

5. The vehicle of claim 1 , wherein under the extrapolation of the traffic behavior of the object, the predicted future maneuvering of the object includes a traffic maneuver being performed by the object.

6. A vehicle, comprising:

at least one processor; and

a memory communicably coupled to the at least one processor and storing:

a perception module including instructions that when executed by the at least one processor cause the at least one processor to:

evaluate information about an environment surrounding the vehicle, the evaluation including identifying an object in the environment surrounding the vehicle; and

identify, based on the evaluation of the information about the environment surrounding the vehicle, a traffic behavior of the object; and

a planning/decision making module including instructions that when executed by the at least one processor cause the at least one processor to:

receive a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects; and

predict, based on the evaluation of the information about the environment surrounding the vehicle, a future maneuvering of the object, the prediction including extrapolating the predominating traffic behavior of the like population of reference objects in response to an identifiability of the traffic behavior of the object not meeting a confidence threshold.

7. The vehicle of claim 6 , wherein the planning/decision making module includes instructions that when executed by the at least one processor cause the at least one processor to issue, at at least one interface, an alert to a user of the predicted future maneuvering of the object.

8. The vehicle of claim 6 , wherein:

the traffic behavior model describes traffic maneuvers performed by the like population of reference objects; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes a predicted traffic maneuver identified from among the traffic maneuvers performed by the like population of reference objects.

9. The vehicle of claim 8 , wherein:

the traffic behavior model describes predominating attributes of how the like population of reference objects performs the traffic maneuvers; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes at least one attribute of how the object is predicted to perform the predicted traffic maneuver that matches a corresponding at least one predominating attribute of how the like population of reference objects performs the traffic maneuver.

10. The vehicle of claim 6 , wherein the prediction includes extrapolating the traffic behavior of the object in response to the identifiability of the traffic behavior of the object meeting the confidence threshold.

11. The vehicle of claim 10 , wherein under the extrapolation of the traffic behavior of the object, the predicted future maneuvering of the object includes a traffic maneuver being performed by the object.

12. A method of providing user assistance in a vehicle executed by at least one processor, comprising:

evaluating information about an environment surrounding the vehicle, the evaluation including identifying an object in the environment surrounding the vehicle;

identifying, based on the evaluation of the information about the environment surrounding the vehicle, a traffic behavior of the object;

receiving a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects; and

predicting, based on the evaluation of the information about the environment surrounding the vehicle, a future maneuvering of the object, the prediction including switching from extrapolating the predominating traffic behavior of the like population of reference objects, to, in response to identifying the traffic behavior of the object, extrapolating the traffic behavior of the object.

13. The method of claim 12 , further comprising:

issuing, at at least one interface, an alert to a user of the predicted future maneuvering of the object.

14. The method of claim 12 , wherein:

the traffic behavior model describes traffic maneuvers performed by the like population of reference objects; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes a predicted traffic maneuver identified from among the traffic maneuvers performed by the like population of reference objects.

15. The method of claim 14 , wherein:

the traffic behavior model describes predominating attributes of how the like population of reference objects performs the traffic maneuvers; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes at least one attribute of how the object is predicted to perform the predicted traffic maneuver that matches a corresponding at least one predominating attribute of how the like population of reference objects performs the traffic maneuver.

16. The method of claim 12 , wherein under the extrapolation of the traffic behavior of the object, the predicted future maneuvering of the object includes a traffic maneuver being performed by the object.

17. A method of providing user assistance in a vehicle executed by at least one processor, comprising:

evaluating information about an environment surrounding the vehicle, the evaluation including identifying an object in the environment surrounding the vehicle;

identifying, based on the evaluation of the information about the environment surrounding the vehicle, a traffic behavior of the object;

receiving a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects; and

predicting, based on the evaluation of the information about the environment surrounding the vehicle, a future maneuvering of the object, the prediction including extrapolating the predominating traffic behavior of the like population of reference objects in response to an identifiability of the traffic behavior of the object not meeting a confidence threshold.

18. The method of claim 17 , further comprising:

issuing, at at least one interface, an alert to a user of the predicted future maneuvering of the object.

19. The method of claim 17 , wherein:

the traffic behavior model describes traffic maneuvers performed by the like population of reference objects; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes a predicted traffic maneuver identified from among the traffic maneuvers performed by the like population of reference objects.

20. The method of claim 19 , wherein:

the traffic behavior model describes predominating attributes of how the like population of reference objects performs the traffic maneuvers; and

under the extrapolation of the predominating traffic behavior of the like population of reference objects, the predicted future maneuvering of the object includes at least one attribute of how the object is predicted to perform the predicted traffic maneuver that matches a corresponding at least one predominating attribute of how the like population of reference objects performs the traffic maneuver.

21. The method of claim 17 , wherein the prediction includes extrapolating the traffic behavior of the object in response to the identifiability of the traffic behavior of the object meeting the confidence threshold.

22. The method of claim 21 , wherein under the extrapolation of the traffic behavior of the object, the predicted future maneuvering of the object includes a traffic maneuver being performed by the object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2019
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 047927/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2017
From: KUFFNER, JR., JAMES J.
To: TOYOTA RESEARCH INSTITUTE, INC.
Reel/Frame 043346/0472 →
Cited By (3)
US 12,415,545 US 12,722,489 US 12,728,879