IP Library Granted Patent US 10,019,790
Granted Patent B2
US 10,019,790 · App. 14/997,012 · Granted Jul 10, 2018

Fill level indicator for an automated unloading system

Inventors: Zachary T. Bonefas (Grimes, IA); Herman Herman (Gibsonia, PA); Joan Campoy (Pittsburgh, PA)
Assignees: Deere & Company; Carnegie Mellon University
G06T7/0004G06T7/0081G06T7/408G06T7/602G06T19/006H04N5/23293H04N13/02G06T2207/20021G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,790
App. No.
14/997,012
Granted
Jul 10, 2018
Kind
B2
Abstract

First imaging device collects first image data, whereas second imaging device collects second image data of a storage portion. An image processing module identifies a rim of a container in either the first image data or the second image data. The image processing module then overlays an outline of the rim in an image presented on a display to an operator of a transferring vehicle. The image processing module further identifies the fill level of material in a receiving vehicle container and overlays this information in the image presented on the display.

Claims (28)

1. A method of displaying on a user interface a level of agricultural material in a container, the method comprising:

obtaining stereo image data from at least one imaging device facing the container;

identifying a perimeter of an opening of the container from the image data using an image processing module;

determining a reliability of an edge identified in the perimeter of the opening of the container using an edge detector,

wherein the edge detector identifies and locates discontinuities between pixels in the image data;

dividing the opening into a matrix of cells,

wherein each cell of the matrix of cells spans a width of the container;

determining an average height of pixels in the stereo image data for each cell in the matrix of cells,

wherein the height of the pixels corresponds to a height of the agricultural material in the container;

displaying on a user interface first augmented image data relating to the height of the agricultural material in each cell in the matrix of cells relative to a height of the container where the perimeter of the opening of the container intersects a boundary of each cell in the matrix of cells;

displaying on a user interface second augmented image data relating to the perimeter of the opening of the container,

wherein the first augmented image data and the second augmented image data are overlaid on the image data of the container.

2. The method of claim 1 , wherein the first augmented image data is a virtual representation of the average height of the agricultural material in the container.

3. The method of claim 2 , wherein the virtual representation is a plurality of translucent pixels displayed on a sidewall of the container.

4. The method of claim 1 , wherein the second augmented image data is a virtual outline overlying the perimeter of the opening.

5. The method of claim 4 , wherein the virtual outline is a plurality of opaque pixels displayed in the image data.

6. The method according to claim 1 , further comprising updating the first augmented image data in real-time as agricultural material is added to the container.

7. The method according to claim 1 , wherein the second augmented image data comprises opaque pixels that replace pixels in the image data.

8. The method according to claim 1 , wherein the first augmented image data is generated using an alpha-blending technique.

9. The method according to claim 1 wherein the cells are substantially rectangular.

10. The method according to claim 1 wherein the average height comprises a median height.

11. The method of claim 1 , wherein the first augmented image data comprises a plurality of colors, wherein each color of the plurality of colors represents a different average height.

12. The method of claim 1 , wherein the first augmented image data comprises a color palette, wherein a first end of the color palette represents a minimum fill height and a second end of the color palette represents a maximum fill height.

13. The method of claim 1 , wherein the first augmented image data comprises red, orange, and green colors,

wherein green signifies a cell fill level at a maximum fill height,

wherein orange signifies a cell fill level below a maximum fill height but above a minimum fill height, and

wherein red signifies a cell fill level at the minimum fill height.

14. The method of claim 1 , wherein the user interface is an LCD screen.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2018
From: BONEFAS, ZACHARY T.
To: DEERE & COMPANY
Reel/Frame 044952/0838 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2018
From: HERMAN, HERMAN; CAMPOY, JOAN
To: CARNEGIE MELLON UNIVERSITY
Reel/Frame 044952/0894 →
Continuity (1)
Related Publication 20170206645A1 · Jul 20, 2017
Cited By (42)
US 1,105,105 US 1,106,229 US 1,108,451 US 1,108,452 US 1,110,339 US 1,117,231 US 12,193,350 US 12,216,472 US 12,225,846 US 12,229,886 US 12,245,549 US 12,250,905 US 12,271,196 US 12,284,934 US 12,295,288 US 12,298,767 US 12,302,791 US 12,310,286 US 12,329,148 US 12,358,493 US 12,386,354 US 12,419,220 US 12,422,847 US 12,472,911 US 12,495,733 US 12,520,759 US 12,527,245 US 12,540,834 US 12,543,655 US 12,550,802 US 12,571,669 US 12,582,033 US 12,582,035 US 12,588,589 US 12,588,593 US 12,596,384 US 12,650,701 US 12,660,758 US 12,668,951 US 12,669,361 US 12,677,990 US 12,696,845