IP Library Granted Patent US 12,571,669
Granted Patent B2
US 12,571,669 · App. 17/345,439 · Granted Mar 10, 2026

Detecting and generating a rendering of fill level and distribution of material in receiving vehicle(s)

Inventors: Kellen O'Connor (Clive, IA); Ryan R. White (Polk City, IA); Sara C. Wendte (West Des Moines, IA)
Assignee: DEERE & COMPANY
G01F23/292G01F22/00G06T15/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,571,669
App. No.
17/345,439
Granted
Mar 10, 2026
Kind
B2
Abstract

A detector detects a fill level of a receiving vehicle. A rendering is generated that shows a representation of the receiving vehicle and a distribution of the material in the receiving vehicle based on the detected fill level.

Claims (40)

1 . A material filling system comprising:

a camera, on a material loading vehicle, configured to capture a plurality of images of material being loaded onto a receiving vehicle;

one or more processors; and

a data store that stores computer executable instructions that, when executed by the one or more processors, configure the one or more processors to:

based on an image of the plurality of images, identify a fill level and material distribution of material on the receiving vehicle and generate a plurality of different computer-generated renderings of the receiving vehicle, each computer-generated rendering, of the plurality of different computer-generated renderings, showing the fill level and material distribution, wherein a computer-generated rendering, of the plurality of different computer-generated renderings, shows the fill level and material distribution in a three-dimensional representation of the receiving vehicle;

based on subsequent images of the plurality of images and subsequent to the image, dynamically, at a given frequency, identify an updated fill level and material distribution on the receiving vehicle;

adjust the given frequency based on a fill level threshold; and

generate a display control signal to control a display mechanism to simultaneously display the plurality of different computer-generated renderings.

2 . The material filling system of claim 1 , wherein a computer-generated rendering, of the plurality of different computer-generated renderings, comprises a grid-based rendering with a plurality of cells, each cell including a fill level indicator indicating a fill level of material in a portion of the receiving vehicle corresponding to the cell.

3 . The material filling system of claim 1 , wherein the camera captures the image from a set of one or more perspectives, wherein the plurality of different computer-generated renderings of the receiving vehicle includes a first computer-generated rendering of the receiving vehicle that shows a first representation of the receiving vehicle and the fill level and material distribution from a first perspective, different than the one or more perspectives of the set of one or more perspectives, and a second computer-generated rendering of the receiving vehicle that shows a second representation of the receiving vehicle different than the first representation and the fill level and material distribution from a second perspective, different than both the one or more perspectives of the set of one or more perspectives and the first perspective.

4 . The material filling system of claim 1 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a rectangle that represents the receiving vehicle.

5 . The material filling system of claim 1 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a cuboid indicator that represents the receiving vehicle, the cuboid indicator including a first side surface representing a first side of the receiving vehicle, a second side surface representing a second side of the receiving vehicle, a first end surface representing a first end of the receiving vehicle, and a second end surface representing a second end of the receiving vehicle, a top surface representing a top boundary of the receiving vehicle, and a bottom surface representing a bottom of the receiving vehicle, the first side surface, the second side surface, the first end surface, the second end surface, the top surface, and the bottom surface defining a graphical volume of the cuboid indicator, the graphical volume of the cuboid indicator representing a volume of a receiving area of the receiving vehicle.

6 . The material filling system of claim 5 , wherein the at least one computer-generated rendering includes an indicator that represents the fill level and material distribution, wherein the indicator is disposed within the graphical volume of the cuboid indicator and includes a smooth surface that extends across a width and length of the cuboid indicator and further can be of a different graphical volume than the graphical volume of the cuboid indicator.

7 . The material filling system of claim 1 , wherein the computer executable instructions, when executed by the one or more processors, further configure the one or more processors to: generate a plurality of updated computer-generated renderings of the receiving vehicle, each updated computer-generated rendering, of the plurality of updated computer-generated renderings, showing the updated fill level and material distribution, wherein each updated computer generated rendering, of the plurality of updated computer-generated renderings, shows the updated fill level and material distribution in a different manner than at least one other updated computer-generated rendering of the plurality of updated computer-generated renderings.

8 . A computer-implemented method comprising:

obtaining a plurality of images, of material being loaded onto a receiving vehicle, captured by a camera on a material loading vehicle;

based on an image of the plurality of images, identifying a fill level and material distribution of material on the receiving vehicle and generating a plurality of different computer-generated renderings of the receiving vehicle, each computer-generated rendering, of the plurality of different computer-generated renderings, showing the fill level and material distribution, wherein a computer-generated rendering, of the plurality of different computer-generated renderings, shows the fill level and material distribution in a three-dimensional representation of the receiving vehicle;

based on subsequent images of the plurality of images and subsequent to the image, dynamically, at a given frequency, identifying an updated fill level and material distribution on the receiving vehicle;

adjusting the given frequency based on a fill level threshold; and

generating a display control signal to control a display mechanism to simultaneously display the plurality of different computer-generated renderings.

9 . The computer-implemented method of claim 8 , wherein a computer-generated rendering, of the plurality of different computer-generated renderings, comprises a grid-based rendering with a plurality of cells, each cell including a fill level indicator indicating a fill level of material in a portion of the receiving vehicle corresponding to the cell.

10 . The computer-implemented method of claim 8 , wherein the camera captures the image from a set of one or more perspectives, wherein the plurality of different computer-generated renderings of the receiving vehicle includes a first computer-generated rendering of the receiving vehicle that shows a first representation of the receiving vehicle and the fill level and material distribution from a first perspective, different than the one or more perspectives of the set of one or more perspectives, and a second computer-generated rendering of the receiving vehicle that shows a second representation of the receiving vehicle different than the first representation and the fill level and material distribution from a second perspective, different than both the one or more perspectives of the set of one or more perspectives and the first perspective.

11 . The computer-implemented method of claim 8 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a rectangle that represents the receiving vehicle.

12 . The computer-implemented method of claim 8 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a cuboid indicator that represents the receiving vehicle, the cuboid indicator including a first side surface representing a first side of the receiving vehicle, a second side surface representing a second side of the receiving vehicle, a first end surface representing a first end of the receiving vehicle, and a second end surface representing a second end of the receiving vehicle, a top surface representing a top boundary of the receiving vehicle, and a bottom surface representing a bottom of the receiving vehicle, the first side surface, the second side surface, the first end surface, the second end surface, the top surface, and the bottom surface defining a graphical volume of the cuboid indicator, the graphical volume of the cuboid indicator representing a volume of a receiving area of the receiving vehicle.

13 . The computer-implemented method of claim 12 , wherein the at least one computer-generated rendering includes an indicator that represents the fill level and material distribution, wherein the indicator is disposed within the graphical volume of the cuboid indicator and includes a smooth surface that extends across a width and length of the cuboid indicator and further can be of a different graphical volume than the graphical volume of the cuboid indicator.

14 . The computer-implemented method of claim 8 , and further comprising:

generating a plurality of updated computer-generated renderings of the receiving vehicle, each updated computer-generated rendering, of the plurality of updated computer-generated renderings, showing the updated fill level and material distribution, wherein each updated computer generated rendering, of the plurality of updated computer-generated renderings, shows the updated fill level and material distribution in a different manner than at least one other updated computer-generated rendering of the plurality of updated computer-generated renderings.

15 . A material loading vehicle comprising:

a camera configured to capture a plurality of images of material being loaded onto a receiving vehicle;

one or more processors; and

a data store that stores computer executable instructions that, when executed by the one or more processors, configure the one or more processors to:

based on an image of the plurality of images, identify a fill level and material distribution of material on the receiving vehicle and generate a plurality of different computer-generated renderings of the receiving vehicle, each computer-generated rendering, of the plurality of different computer-generated renderings, showing the fill level and material distribution, wherein a computer-generated rendering, of the plurality of different computer-generated renderings, shows the fill level and material distribution in a three-dimensional representation of the receiving vehicle;

based on subsequent images of the plurality of images and subsequent to the image, dynamically, at a given frequency, identify an updated fill level and material distribution on the receiving vehicle;

adjust the given frequency based on a fill level threshold; and

generate a display control signal to control a display mechanism to simultaneously display the plurality of different computer-generated renderings.

16 . The material loading vehicle of claim 15 , wherein a computer-generated rendering, of the plurality of different computer-generated renderings, comprises a grid-based rendering with a plurality of cells, each cell including a fill level indicator indicating a fill level of material in a portion of the receiving vehicle corresponding to the cell.

17 . The material loading vehicle of claim 15 , wherein the camera captures the image from a set of one or more perspectives, wherein the plurality of different computer-generated renderings of the receiving vehicle includes a first computer-generated rendering of the receiving vehicle that shows a first representation of the receiving vehicle and the fill level and material distribution from a first perspective, different than the one or more perspectives of the set of one or more perspectives, and a second computer-generated rendering of the receiving vehicle that shows a second representation of the receiving vehicle different than the first representation and the fill level and material distribution from a second perspective, different than both the one or more perspectives of the set of one or more perspectives and the first perspective.

18 . The material loading vehicle of claim 15 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a rectangle that represents the receiving vehicle.

19 . The material loading vehicle of claim 15 , wherein at least one computer-generated rendering of the plurality of different computer-generated renderings shows a representation of the receiving vehicle, wherein the representation of the receiving vehicle is of a different appearance than an appearance of the receiving vehicle and includes a cuboid indicator that represents the receiving vehicle, the cuboid indicator including a first side surface representing a first side of the receiving vehicle, a second side surface representing a second side of the receiving vehicle, a first end surface representing a first end of the receiving vehicle, and a second end surface representing a second end of the receiving vehicle, a top surface representing a top boundary of the receiving vehicle, and a bottom surface representing a bottom of the receiving vehicle, the first side surface, the second side surface, the first end surface, the second end surface, the top surface, and the bottom surface defining a graphical volume of the cuboid indicator, the graphical volume of the cuboid indicator representing a volume of a receiving area of the receiving vehicle.

20 . The material loading vehicle of claim 15 , wherein the computer executable instructions, when executed by the one or more processors, further configure the one or more processors to: generate a plurality of updated computer-generated renderings of the receiving vehicle, each updated computer-generated rendering, of the plurality of updated computer-generated renderings, showing the updated fill level and material distribution, wherein each updated computer generated rendering, of the plurality of updated computer-generated renderings, shows the updated fill level and material distribution in a different manner than at least one other updated computer-generated rendering of the plurality of updated computer-generated renderings.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2021
From: O'CONNOR, KELLEN; WHITE, RYAN R.; WENDTE, SARA C.
To: DEERE & COMPANY
Reel/Frame 056513/0473 →
Continuity (1)
Related Publication 20220397442A1 · Dec 15, 2022
References Cited (33)
US 6097425A · Behnke et al. · 2000 [cited by applicant]
US 8380401B2 · Pighi et al. · 2013 [cited by applicant]
US 8656693B2 · Madsen et al. · 2014 [cited by applicant]
US 9392746B2 · Darr et al. · 2016 [cited by applicant]
US 10019790B2 · Bonefas et al. · 2018 [cited by applicant]
US 12135571B2 · Faust et al. · 2024 [cited by applicant]
US 12402563B2 · O'Connor et al. · 2025 [cited by applicant]
US 20090044505A1 · Huster et al. · 2009 [cited by applicant]
US 20110307149A1 · Pighi · 2011 [cited by examiner]
US 20140083556A1 · Darr et al. · 2014 [cited by applicant]
US 20150177114A1 · Kapoor · 2015 [cited by examiner]
US 20160331282A1 · Satish · 2016 [cited by examiner]
US 20180038805A1 · Heikkilä · 2018 [cited by examiner]
US 20200133262A1 · Suleman · 2020 [cited by examiner]
US 20200191580A1 · Christensen · 2020 [cited by examiner]
US 20200249070A1 · Gurumohan · 2020 [cited by examiner]
US 20200325655A1 · Hageman · 2020 [cited by examiner]
US 20210042993A1 · Tagra · 2021 [cited by examiner]
US 20210397171A1 · Sayyarrodsari · 2021 [cited by examiner]
US 20220019239A1 · Christiansen · 2022 [cited by examiner]
US 20220397442A1 · O'Connor et al. · 2022 [cited by applicant]
US 20230194325A1 · Schroeder · 2023 [cited by applicant]
US 20240037806A1 · Christiansen et al. · 2024 [cited by applicant]
US 20240138301A1 · Faust et al. · 2024 [cited by applicant]
DE 19647522A1 · 1998 [cited by applicant]
EP 1977640A1 · 2008 [cited by applicant]
EP 2311307A1 · 2011 [cited by applicant]
EP 2798939A1 · 2014 [cited by applicant]
EP 2798939B1 · 2018 [cited by applicant]
EP 3760026A1 · 2021 [cited by examiner]
WO WO2024206644A3 · 2025 [cited by applicant]
Computer Vision and Biosystems Signal Processing Group, UAV LIDAR mapping for crop fields, accessed on Mar. 14, 2021, 27 pages. [cited by applicant]
Extended European Search Report and Written Opinion issued in European Patent Application No. 22174731.4, dated Nov. 15, 2022, in 08 pages. [cited by applicant]