IP Library Granted Patent US 12,567,331
Granted Patent B2
US 12,567,331 · App. 18/179,193 · Granted Mar 3, 2026

Systems and methods to manage tracking of objects through occluded regions

Inventors: Collin Otis (Driggs, ID); Philip C. Du Toit (Fort Collins, CO)
Assignee: Kodiak Robotics, Inc.
G08G1/166B60W30/0956B60W50/0097B60W60/0015B60W60/0027G06V20/58B60W2554/4041B60W2554/4045B60W2554/4048B60W2556/20B60W2556/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,567,331
App. No.
18/179,193
Granted
Mar 3, 2026
Kind
B2
Abstract

Exemplary embodiments include systems and methods to maintain tracking of an object that passes into an occluded area, including defining a map of a driving area; defining one or more occlusion areas within the map; detecting an object using sensor data from one or more sensors; creating an object track for the object detected using sensor data; determining that the object track entered one of the one or more occlusion areas; and maintaining the object track while the object track remains in the one or more occlusion areas.

Claims (50)

1 . A method, comprising:

defining, using a computing device comprising a processor and a memory, a map of a driving area;

defining, using the computing device, an occlusion map within the map of the driving area, the occlusion map comprising one or more occlusion areas;

recording sensor data of an environment of a vehicle using one or more sensors;

detecting, using the computing device, an object using the sensor data;

creating, using the computing device, an object track for the object detected using sensor data;

determining, using the computing device, whether the object track has entered any of the one or more occlusion areas;

maintaining, using the computing device and the one or more sensors, the object track while the object track remains in any of the one or more occlusion areas;

dropping the object track when a probability that the object is no longer in the one or more occlusion areas has surpassed a threshold; and

driving the vehicle based on the object track.

2 . The method of claim 1 , further comprising maintaining the object track while the object remains undetected by the one or more sensors.

3 . The method of claim 1 , further comprising dropping the object track when the object exits the one or more occlusion areas,

wherein the object is determined to have exited the one or more occlusion areas when the object is detected by the one or more sensors.

4 . The method of claim 1 , further comprising dropping the object track when a probability that the object is no longer in one or more occlusion areas has surpassed a threshold.

5 . The method of claim 1 , further comprising updating a probability location of the object while the object remains undetected by the one or more sensors and within the one or more occlusion areas.

6 . The method of claim 5 , wherein a certainty of the probability location manifests in an area of probability in which the object may be within the one or more occlusion areas along the object track.

7 . The method of claim 6 , wherein the probability location is determined with less certainty the longer the object remains in the one or more occlusion areas.

8 . The method of claim 7 , wherein the less certainty results in a larger area of probability associated with the object along the object track.

9 . A method, comprising:

defining, using a computing device comprising a processor and a memory, a map of a driving area having a driving surface including one or more drive lanes for a vehicle to traverse;

recording sensor data of an environment of the vehicle using one or more sensors;

detecting an object, separate from the vehicle, using the sensor data;

defining an occlusion map within the map of the driving area, the occlusion map comprising one or more occlusion areas, wherein an occlusion area is an area that is obstructed by another object, and/or is in an area not detectable by the one or more sensors, and/or is within a set proximity to the vehicle;

creating an object track for the object detected using sensor data, wherein the object track is determined from data received from the one or more sensors before the object enters the one or more occlusion areas and is configured to provide a predicted location as the object remains within the one or more occlusion areas;

determining whether the object track has entered any of the one or more occlusion areas;

determining a predicted location of the object within the one or more occlusion areas, wherein the predicted location comprises an area based on the object track;

updating the predicted location of the object, increasing an area of the predicted location as time increases as the object remains within the one or more occlusion areas;

dropping the object track when a probability that the object is no longer in the one or more occlusion areas has surpassed a threshold; and

driving the vehicle based on the object track.

10 . The method of claim 9 , further comprising dropping the object track when the object exits the one or more occlusion areas,

wherein the object is determined to have exited the one or more occlusion areas when the object is detected by the one or more sensors.

11 . A system, comprising:

one or more sensors configured to generate sensor data of an environment of a vehicle; and

a computing device, comprising a processor and a memory, wherein the memory is configured to store instructions that, when executed by the processor, are configured to cause the processor to:

define a map of a driving area of the vehicle;

detect an object from the sensor data;

define an occlusion map within the map of the driving area, the occlusion map comprising one or more occlusion areas;

create an object track for the object detected and configured to maintain the object track when the object is determined to enter the one or more occlusion areas;

drop the object track when a probability that the object is no longer in the one or more occlusion areas has surpassed a threshold; and

drive the vehicle based on the object track.

12 . The system of claim 11 , wherein the instructions, when executed by the processor, are further configured to cause the processor to drop the object track when it is determined that the one or more occlusion areas is cleared.

13 . The system of claim 11 , wherein:

the instructions, when executed by the processor, are further configured to cause the processor to drop the object track when it is determined that the object has exited the one or more occlusion areas, and

the object is determined to have exited the one or more occlusion areas when the object is detected by the one or more sensors.

14 . The system of claim 11 , wherein the instructions, when executed by the processor, are further configured to cause the processor to update a probability location of the object while the object remains undetected by the one or more sensors and within the one or more occlusion areas.

15 . The system of claim 14 , wherein the instructions, when executed by the processor, are further configured to cause the processor to:

define a certainty of the probability location; and

manifest the certainty as an area of probability in which the object may be within the one or more occlusion areas along the object track.

16 . The system of claim 15 , wherein the instructions, when executed by the processor, are further configured to cause the processor to determine the probability location with less certainty the longer the object remains in the one or more occlusion areas.

17 . The system of claim 16 , wherein the instructions, when executed by the processor, are further configured to cause the processor to define a reduction in the certainty as a larger area of probability associated with the object along the object track.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2026
From: OTIS, COLLIN; DU TOIT, PHILIP C.
To: KODIAK ROBOTICS, INC.
Reel/Frame 073585/0211 →
SECURITY INTEREST Recorded Jan 21, 2026
From: KODIAK AI, INC.
To: HORIZON TECHNOLOGY FINANCE CORPORATION
Reel/Frame 074459/0570 →
SECURITY INTEREST Recorded Jun 12, 2024
From: KODIAK ROBOTICS, INC.
To: HORIZON TECHNOLOGY FINANCE CORPORATION
Reel/Frame 067711/0909 →
Continuity (1)
Related Publication 20240300533A1 · Sep 12, 2024
References Cited (39)
US 9428187B2 · Lee · 2016 [cited by applicant]
US 9718466B2 · Kim et al. · 2017 [cited by applicant]
US 10783381B2 · Yu · 2020 [cited by examiner]
US 10807599B2 · Zhu et al. · 2020 [cited by applicant]
US 11126180B1 · Kobilarov · 2021 [cited by examiner]
US 11127294B2 · Kim · 2021 [cited by examiner]
US 11188082B2 · Silva · 2021 [cited by examiner]
US 11513519B1 · Akella · 2022 [cited by examiner]
US 12055945B2 · Becker · 2024 [cited by examiner]
US 20070030212A1 · Shibata · 2007 [cited by examiner]
US 20090140881A1 · Sakai · 2009 [cited by examiner]
US 20090237269A1 · Okugi · 2009 [cited by examiner]
US 20110102195A1 · Kushi · 2011 [cited by examiner]
US 20120218125A1 · Demirdjian · 2012 [cited by examiner]
US 20130223686A1 · Shimizu · 2013 [cited by examiner]
US 20180233049A1 · Ishii · 2018 [cited by examiner]
US 20190049992A1 · Riess · 2019 [cited by examiner]
US 20190329768A1 · Shalev-Shwartz · 2019 [cited by examiner]
US 20200103523A1 · Liu · 2020 [cited by examiner]
US 20200189467A1 · Kondo · 2020 [cited by examiner]
US 20200225669A1 · Silva · 2020 [cited by examiner]
US 20200264622A1 · Tokumochi · 2020 [cited by examiner]
US 20200278681A1 · Gier · 2020 [cited by examiner]
US 20200377092A1 · Torres · 2020 [cited by examiner]
US 20210027629A1 · Tao · 2021 [cited by examiner]
US 20210197811A1 · Tsushima · 2021 [cited by examiner]
US 20220185267A1 · Beller · 2022 [cited by examiner]
US 20220242403A1 · Horita · 2022 [cited by examiner]
US 20220262128A1 · Nakamura · 2022 [cited by examiner]
US 20220300748A1 · Tokmakov · 2022 [cited by examiner]
US 20220315051A1 · Patel · 2022 [cited by examiner]
US 20220383749A1 · Ishikawa · 2022 [cited by examiner]
US 20230195830A1 · Raina · 2023 [cited by examiner]
US 20230332919A1 · Mehdi · 2023 [cited by examiner]
US 20240300486A1 · Otis · 2024 [cited by examiner]
US 20240300533A1 · Otis et al. · 2024 [cited by applicant]
Ess, A. et al., “Object Detection and Tracking for Autonomous Navigation in Dynamic Environments,” The International Journal of Robotics Research (2010); 29(14): pp. 1707-1725. [cited by applicant]
International Search Report issued on Oct. 11, 2024 for International Patent Application No. PCT/US2024/018516 (5 pages). [cited by applicant]
Yu, M. Y. et al., “Occlusion-Aware Risk Assessment for Autonomous Driving in Urban Environments,” IEEE Robotics and Automation Letters (2019); 4(2): pp. 2235-2241. [cited by applicant]