IP Library › Granted Patent US 12,441,369
Granted Patent B2
US 12,441,369 · App. 18/639,421 · Granted Oct 14, 2025

Automated cut-in identification and classification

Inventors: Pablo Abad (Mountain View, CA); Aman Ved Kalia (Mountain View, CA); Juan Gomez-Ramos (Mountain View, CA); Jiayi Chen (Mountain View, CA); Jasman Singh Malik (Mountain View, CA); Joe Riggs (Mountain View, CA)
Assignee: Waymo LLC
B60W60/0027B60W50/0098G05B13/0265B60W2050/0031B60W2520/10B60W2520/12B60W2554/4042B60W2554/4043B60W2554/4045B60W2554/4046B60W2554/801B60W2554/802B60W2710/18B60W2720/10B60W2720/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,441,369
App. No.
18/639,421
Granted
Oct 14, 2025
Kind
B2
Abstract

Example embodiments relate to a method for cut-in identification and classification. An example embodiment includes a obtaining operational data about one or more vehicles; based on the operational data, identifying the presence of one or more cut-ins within the operational data; extracting, from the operational data, cut-in data that depicts one or more of the cut-ins identified within the operational data; and, based on the extracted cut-in data, training a model for controlling an autonomous vehicle. Identifying the presence of a given cut-in includes: determining that at least one vertex of a bounding box surrounding a vehicle was located more than a threshold distance within a lane being navigated by a given vehicle; and determining that the ability of the given vehicle to maintain its course and speed was impeded by the presence of the particular additional vehicle within the lane.

Claims (42)

1. A method comprising:

obtaining operational data about one or more vehicles;

based on the operational data, identifying the presence of one or more cut-ins within the operational data;

extracting, from the operational data, cut-in data that depicts one or more of the cut-ins identified within the operational data;

based on the extracted cut-in data, training a model for controlling an autonomous vehicle, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data comprises:

determining one or more scores for the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data, wherein the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data is determined by a first model for controlling the autonomous vehicle; and

based on the one or more scores, selecting a new model from a plurality of such models to replace the first model; and

based on the model for controlling the autonomous vehicle, generating and implementing a control output to operate the autonomous vehicle.

2. The method of claim 1 , further comprising, based on the extracted cut-in data, classifying one or more of the cut-ins identified within the operational data.

3. The method of claim 2 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data as at least one of an aborted cut-in, a cut-through, or a zipper cut-in.

4. The method of claim 2 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data based on at least one of: a degree to which a vehicle slowed down due to the cut-in, a timing of an action taken by a vehicle in reaction to the cut-in relative to a timing at which the cut-in occurred, or a duration of a period that a vehicle followed a cut-in agent at a distance less than a threshold safety distance following a cut-in.

5. The method of claim 1 , wherein the one or more scores comprise human-interpretable metrics for the quality of the first model with respect to efficiency or vehicle wear, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data further comprises, based on the one or more scores, updating the first model, and wherein updating the first model comprises using the one or more scores to select whether to retain the first model, replicate the first model, fold the first model, discard the first model, combine the first model with another model in the plurality of models, or set a weight of the first model relative to other models in the plurality of models.

6. The method of claim 1 , wherein determining the one or more scores comprises generating a score based on at least one of: a degree to which the autonomous vehicle slowed down due to the particular cut-in, a timing of an action taken by the autonomous vehicle in reaction to the particular cut-in relative to a timing at which the particular cut-in occurred, or a duration of a period that the autonomous vehicle followed a cut-in agent at a distance less than a threshold safety distance following the particular cut-in.

7. The method of claim 1 , wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data further comprises, based on the one or more scores, updating the first model.

8. A non-transitory computer readable medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to perform operations comprising:

obtaining operational data about one or more vehicles;

based on the operational data, identifying the presence of one or more cut-ins within the operational data;

extracting, from the operational data, cut-in data that depicts one or more of the cut-ins identified within the operational data;

based on the extracted cut-in data, training a model for controlling an autonomous vehicle, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data comprises:

determining one or more scores for the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data, wherein the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data is determined by a first model for controlling the autonomous vehicle; and

based on the one or more scores, selecting a new model from a plurality of such models to replace the first model; and

based on the model for controlling the autonomous vehicle, generating and implementing a control output to operate the autonomous vehicle.

9. The non-transitory computer readable medium of claim 8 , wherein the operations further comprise, based on the extracted cut-in data, classifying one or more of the cut-ins identified within the operational data.

10. The non-transitory computer readable medium of claim 9 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data as at least one of an aborted cut-in, a cut-through, or a zipper cut-in.

11. The non-transitory computer readable medium of claim 9 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data based on at least one of: a degree to which a vehicle slowed down due to the cut-in, a timing of an action taken by a vehicle in reaction to the cut-in relative to a timing at which the cut-in occurred, or a duration of a period that a vehicle followed a cut-in agent at a distance less than a threshold safety distance following a cut-in.

12. The non-transitory computer readable medium of claim 8 , wherein the one or more scores comprise human-interpretable metrics for the quality of the first model with respect to efficiency or vehicle wear, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data further comprises, based on the one or more scores, updating the first model, and wherein updating the first model comprises using the one or more scores to select whether to retain the first model, replicate the first model, fold the first model, discard the first model, combine the first model with another model in the plurality of models, or set a weight of the first model relative to other models in the plurality of models.

13. The non-transitory computer readable medium of claim 8 , wherein determining the one or more scores comprises generating a score based on at least one of: a degree to which the autonomous vehicle slowed down due to the particular cut-in, a timing of an action taken by the autonomous vehicle in reaction to the particular cut-in relative to a timing at which the particular cut-in occurred, or a duration of a period that the autonomous vehicle followed a cut-in agent at a distance less than a threshold safety distance following the particular cut-in.

14. The non-transitory computer readable medium of claim 8 , wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data further comprises, based on the one or more scores, updating the first model.

15. A system comprising: one or more processing units; and

a non-transitory computer-readable medium storing at least computer-executable instructions that, when executed by the one or more processing units, cause the one or more processing units to perform operations comprising:

obtaining operational data about one or more vehicles;

based on the operational data, identifying the presence of one or more cut-ins within the operational data;

extracting, from the operational data, cut-in data that depicts one or more of the cut-ins identified within the operational data;

based on the extracted cut-in data, training a model for controlling an autonomous vehicle, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data comprises:

determining one or more scores for the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data, wherein the autonomous vehicle's reaction to one or more of the cut-ins identified within the operational data is determined by a first model for controlling the autonomous vehicle; and

based on the one or more scores, selecting a new model from a plurality of such models to replace the first model; and

based on the model for controlling the autonomous vehicle, generating and implementing a control output to operate the autonomous vehicle.

16. The system of claim 15 , wherein the operations further comprise, based on the extracted cut-in data, classifying one or more of the cut-ins identified within the operational data.

17. The system of claim 16 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data as at least one of an aborted cut-in, a cut-through, or a zipper cut-in.

18. The system of claim 16 , wherein classifying one or more of the cut-ins identified within the operational data comprises classifying one or more of the cut-ins identified within the operational data based on at least one of: a degree to which a vehicle slowed down due to the cut-in, a timing of an action taken by a vehicle in reaction to the cut-in relative to a timing at which the cut-in occurred, or a duration of a period that a vehicle followed a cut-in agent at a distance less than a threshold safety distance following a cut-in.

19. The system of claim 15 , wherein the one or more scores comprise human-interpretable metrics for the quality of the first model with respect to efficiency or vehicle wear, wherein training the model for controlling the autonomous vehicle based on the extracted cut-in data further comprises, based on the one or more scores, updating the first model, and wherein updating the first model comprises using the one or more scores to select whether to retain the first model, replicate the first model, fold the first model, discard the first model, combine the first model with another model in the plurality of models, or set a weight of the first model relative to other models in the plurality of models.

20. The system of claim 15 , wherein determining the one or more scores comprises generating a score based on at least one of: a degree to which the autonomous vehicle slowed down due to the particular cut-in, a timing of an action taken by the autonomous vehicle in reaction to the particular cut-in relative to a timing at which the particular cut-in occurred, or a duration of a period that the autonomous vehicle followed a cut-in agent at a distance less than a threshold safety distance following the particular cut-in.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2024
From: ABAD, PABLO; KALIA, AMAN VED; GOMEZ-RAMOS, JUAN; CHEN, JIAYI; MALIK, JASMAN SINGH; RIGGS, JOE
To: WAYMO LLC
Reel/Frame 067160/0763 →
Continuity (2)
Continuation 17565232 · Dec 29, 2021
Related Publication 20240262393A1 · Aug 8, 2024
References Cited (25)
US 8280601B2 · Huang et al. · 2012 [cited by applicant]
US 8457827B1 · Ferguson et al. · 2013 [cited by applicant]
US 8903588B2 · Schmudderich et al. · 2014 [cited by applicant]
US 10209712B2 · Stein · 2019 [cited by applicant]
US 10818184B2 · Han et al. · 2020 [cited by applicant]
US 10915109B2 · Telpaz et al. · 2021 [cited by applicant]
US 11004000B1 · Gutmann et al. · 2021 [cited by applicant]
US 20190308620A1 · Sapp et al. · 2019 [cited by applicant]
US 20190384292A1 · Aragon et al. · 2019 [cited by applicant]
US 20200273342A1 · Kompalli et al. · 2020 [cited by applicant]
US 20210001897A1 · Chai et al. · 2021 [cited by applicant]
US 20210009140A1 · Brooks · 2021 [cited by applicant]
US 20210132619A1 · Refaat et al. · 2021 [cited by applicant]
US 20210269065A1 · Haggblade et al. · 2021 [cited by applicant]
US 20210295171A1 · Kamenev et al. · 2021 [cited by applicant]
US 20210312177A1 · Bansal et al. · 2021 [cited by applicant]
US 20210319287A1 · Refaat et al. · 2021 [cited by applicant]
US 20210380099A1 · Lee et al. · 2021 [cited by applicant]
Remmen et al., “Cut-in Scenario Prediction for Automated Vehicles”, IEEE International Conference on Vehicular Electronics and Safety, Sep. 12-14, 2018, 7 pages. [cited by applicant]
Hu et al., “Decision Tree-Based Maneuver Prediction for Driver Rear-End Risk-Avoidance Behaviors in Cut-In Scenarios”, Journal of Advanced Transportation, vol. 2017, Article ID 7170358, 13 pages. [cited by applicant]
Ahmed et al., “Statistical modelling of critical cut-ins for the evaluation of autonomous vehicles and advanced driver assistance systems”, Master's Thesis in Automotive Engineering, Chalmers University of Technology, 2… [cited by applicant]
“Interaction-Aware Cut-in Behavior Prediction and Risk Assessment for Autonomous Driving”; Jinwei Zhang, et al.; IFAC-PAPERSONLINE—16th IFAC Symposium on Control in Transportation Systems CTS 2021 Lille, France, Jun. 8-… [cited by applicant]
“Naturalistic Driving Behavior Analysis under Typical Normal Cut-In Scenarios”; Xuehan Ma, et al.; SAE 2010 Commercial Vehicle Engineering Congress SAR Technical Papers; vol. 1 (Apr. 2, 2019). [cited by applicant]
“Driver Behavior Classification under Cut-In Scenarios Using Support Vector Machine Based on Naturalistic Driving Data”; Xuehan Ma, et al.; SAE 2010 Commercial Vehicle Engineering Congress SAE Technical Papers; vol. 1 (… [cited by applicant]
“Predicting Cut-Ins in Traffic Using a Neural Network Master's thesis in Systems, Control and Mechatronics”; Tonja Heinemann; XP055603765; Gothenburg, Sweden; retrieved from URL: https://pdfs.semanticscholar.org/be17/07… [cited by applicant]