IP Library Granted Patent US 12,724,422
Granted Patent B2
US 12,724,422 · App. 18/678,498 · Granted Sep 1, 2026

Perception-based navigation for mobile machines

Inventors: Andrew T. Whitten (Dunlap, IL); Adam Jacobson (Chermside West, AU); Michael D. Braunstein (Washington, IL)
Assignee: Caterpillar Inc.
G05D1/246G05D1/244G05D2105/05G05D2105/87G05D2107/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,724,422
App. No.
18/678,498
Granted
Sep 1, 2026
Kind
B2
Abstract

A map generation application and method generates a computer-readable worksite map for managing navigation and travel for a plurality of mobile machines equipped with perception-based localization and navigation systems at a worksite. Survey data and development data associated with the worksite are obtained and used to prepare an unmarked worksite development map including one or more travel/activity areas. Marker positioning factors are obtained and are associated with the one or more travel/activity areas. The application determines assigned marker positions based on the marker positioning factors for the placement of physical markers about the worksite.

Claims (30)

1 . A worksite server comprising:

a map developer routine/module programmed to receive survey data about a physical worksite and prepare an unmarked worksite map in computer-readable format from the survey data;

a marker assignment routine/module including an analytic engine and a simulator, the analytic engine programmed to assign at least one assigned marker position to the unmarked worksite map and the simulator programmed to simulate an effectiveness of the at least one assigned marker position based on a perceptibility of a corresponding physical marker in the physical worksite; and

a map generator to generate a marker worksite map in computer-readable format that includes the at least one assigned marker position.

2 . The worksite server of claim 1 , wherein the analytic engine receives and applies one or more marker positioning factors to assign the at least one assigned marker position.

3 . The worksite server of claim 2 , wherein the simulator adjusts the one or more marker positioning factors.

4 . The worksite server of claim 3 , wherein the one or more marker positioning factors includes one or more of a topology factor associated with the one or more worksite features, a traffic factor associated with the plurality of mobile machines, an environmental factor associated with the physical worksite, a system resolution factor associated with a perception-based localization and navigation system, and an operational factor associated with at least one of the plurality of mobile machines.

5 . The worksite server of claim 4 , wherein the worksite features are indicative of one or more of route curve, an intersection, an incline, and an elevation obstruction.

6 . The worksite server of claim 1 , wherein the simulator uses a simulated mobile machine model to simulate the effectiveness of the at least one assigned marker position.

7 . The worksite server of claim 6 , wherein the effectiveness of the at least one assigned marker position is based on a reaction of a perception-based localization and navigation system associated with the mobile machine model to the at least one assigned marker position.

8 . The worksite server of claim 7 , wherein the reaction of the perception-based localization and navigation system to the at least one assigned marker position is assessed based on distances and/or viewing angles between the mobile machine model and the assigned marker position.

9 . The worksite server of claim 1 , wherein the simulator is programmed to designate the at least one assigned marker position as a temporary marker position, to simulate the effectiveness of the temporary marker position, and to adjust the temporary marker position based on effectiveness.

10 . The worksite server of claim 1 , wherein the simulator is programmed to iteratively repeat simulating the effectiveness of the at least one assigned marker position.

11 . A computer-implemented method of developing a computer-readable worksite map of a physical worksite comprising:

generating a worksite map including a plurality of assigned marker positions based in part on one or more marker positioning factors;

simulating an assigned marker position from the plurality of marker positions to assess an effectiveness of a perception-based localization and navigation system to perceive a physical marker in the physical worksite that corresponds to the assigned marker position; and

adjusting the assigned marker position in the worksite map to improve perceptibility of the physical marker.

12 . The method of claim 11 , wherein the step of simulating the assigned marker position includes adjusting the one or more marker positioning factors.

13 . The method of claim 12 , wherein the step of simulating the assigned marker position uses a simulated mobile machine model responsive to the assigned marker position factors.

14 . The method of claim 13 , wherein the one or more marker positioning factors includes one or more of a topology factor associated with the one or more worksite features, a traffic factor associated with the plurality of mobile machines, an environmental factor associated with the physical worksite, a system resolution factor associated with the perception-based localization and navigation system, and an operational factor associated with at least one of the plurality of mobile machines.

15 . The method of claim 11 , further comprising iterating the step of simulating the assigned marker positions.

16 . A computer-implemented method for updating a computer-readable worksite map of a physical worksite comprising:

retrieving a worksite map that includes one or more assigned marker positions;

obtaining marker perception data from a perception-based localization and navigation system associated with a mobile machine operating at the physical worksite;

analyzing the marker perception data to determine a perceptibility effectiveness of a physical marker in the physical worksite corresponding to an assigned marker position of the one or more assigned marker positions; and

adjusting the assigned marker position in the worksite map to improve perceptibility effectiveness of the physical marker.

17 . The method of claim 16 , wherein the step of adjusting the assigned marker position in the worksite map includes assigning an effectiveness indication to the assigned marker position.

18 . The method of claim 17 , wherein the marker perception data is obtained from a plurality of mobile machines operating at the physical worksite.

19 . The method of claim 16 , wherein the marker perception data is indicative of a frequency with which the perception-based localization and navigation system detects physical markers at the physical worksite.

20 . The method of claim 16 , wherein the marker perception data is indicative of the accuracy of the perception-based localization and navigation system in locating a mobile machine at the physical worksite.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2024
From: WHITTEN, ANDREW T.; JACOBSON, ADAM; BRAUNSTEIN, MICHAEL D.
To: CATERPILLAR INC.
Reel/Frame 067630/0407 →
Continuity (1)
Related Publication 20250370456A1 · Dec 4, 2025
References Cited (43)
US 6292715B1 · Rongo · 2001 [cited by applicant]
US 8868302B2 · Everett et al. · 2014 [cited by applicant]
US 8924067B2 · Halder et al. · 2014 [cited by applicant]
US 9097520B2 · Stratton et al. · 2015 [cited by applicant]
US 9142063B2 · Chen · 2015 [cited by examiner]
US 9182760B2 · Braunstein et al. · 2015 [cited by applicant]
US 10222215B2 · Holz · 2019 [cited by applicant]
US 10788603B2 · Cortelyou et al. · 2020 [cited by applicant]
US 11169534B2 · Micks et al. · 2021 [cited by applicant]
US 11378964B2 · Wei · 2022 [cited by applicant]
US 11520332B1 · Zamiska et al. · 2022 [cited by applicant]
US 11531113B1 · Bristow · 2022 [cited by applicant]
US 11549817B2 · Ondruska et al. · 2023 [cited by applicant]
US 11555705B2 · Lin Sörstedt et al. · 2023 [cited by applicant]
US 20090099707A1 · Greiner · 2009 [cited by applicant]
US 20120173185A1 · Taylor et al. · 2012 [cited by applicant]
US 20130311153A1 · Moughler et al. · 2013 [cited by applicant]
US 20140184643A1 · Friend · 2014 [cited by applicant]
US 20160342915A1 · Humphrey · 2016 [cited by applicant]
US 20200117201A1 · Oetken et al. · 2020 [cited by applicant]
US 20200241561A1 · Hendricks · 2020 [cited by applicant]
US 20210003683A1 · Chen et al. · 2021 [cited by applicant]
US 20210011122A1 · Tanaka et al. · 2021 [cited by applicant]
US 20210018927A1 · Ackerman · 2021 [cited by examiner]
US 20210182758A1 · Deenathayalan et al. · 2021 [cited by applicant]
US 20210230842A1 · Vorobiev et al. · 2021 [cited by applicant]
US 20220091271A1 · Iwase et al. · 2022 [cited by applicant]
US 20220111515A1 · He et al. · 2022 [cited by applicant]
US 20220180131A1 · Oblak et al. · 2022 [cited by applicant]
US 20220252405A1 · Imazu · 2022 [cited by applicant]
US 20230004161A1 · McClelland · 2023 [cited by applicant]
US 20230297900A1 · Bonnington · 2023 [cited by examiner]
US 20240025040A1 · Vangal Ramamurthy · 2024 [cited by examiner]
US 20250369772A1 · Braunstein · 2025 [cited by examiner]
CN 115328171B · 2023 [cited by applicant]
CN 115683086A · 2023 [cited by examiner]
DE 102020003930A1 · 2021 [cited by applicant]
EP 2983955B1 · 2019 [cited by applicant]
EP 3670757A1 · 2020 [cited by examiner]
EP 3926304A1 · 2021 [cited by applicant]
U.S. Appl. No. 18/678,421, filed May 30, 2024. [cited by applicant]
U.S. Appl. No. 18/678,448, filed May 30, 2024. [cited by applicant]
U.S. Appl. No. 18/678,472, filed May 30, 2024. [cited by applicant]