IP Library › Granted Patent US 11,533,843
Granted Patent B2
US 11,533,843 · App. 16/471,600 · Granted Dec 27, 2022

Crop monitoring system and method

Inventors: Vidyanath Gururajan (Lincoln, GB); Alison Wright (Lincoln, GB); Mark Hansen (Bristol, GB); Ian Hales (Bristol, GB); Melvyn Smith (Bristol, GB); Lyndon Smith (Bristol, GB); Dave Samworth (Grantham, GB); Luke Greenwood (West Bridgford, GB)
Assignee: B-Hive Innovations Limited
A01D41/127A01D17/00A01D33/00A01D43/087A01D91/00A01D2033/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,533,843
App. No.
16/471,600
Granted
Dec 27, 2022
Kind
B2
Abstract

A harvester monitoring system configured to determine one or more parameters associated with harvested items, the system comprising: a camera module having a field of view and configured to generate image data associated with the harvested items; a mounting bracket configured to secure the camera module to a harvester such that a conveyor of the harvester is within the field of view of the camera module; a location sub-system configured to determine and output location data representative of a geographical location of the harvester monitoring system; and a processing unit configured to receive the image data and the location data, to determine one or more parameters associated with the harvested items, and to record the one or more parameters in association with the location data on a computer readable medium.

Claims (49)

1. A harvester monitoring system configured to determine one or more parameters associated with harvested items, the system comprising:

a camera module having a field of view and configured to generate image data associated with the harvested items;

a mounting bracket configured to secure the camera module to a harvester such that a conveyor of the harvester is within the field of view of the camera module;

a location sub-system configured to determine and output location data representative of a geographical location of the harvester monitoring system; and

a processing unit configured to receive the image data and the location data, to determine one or more parameters associated with the harvested items, and to record the one or more parameters in association with the location data on a computer readable medium,

wherein the camera module is configured to determine depth data for the harvested items, and

wherein the processing unit is further configured to depth filter the image data to exclude or delete parts of the image data which are more than a maximum distance away from the camera module, and wherein the maximum distance away from the camera module is determined in a calibration stage in accordance with which the processing unit is configured to:

determine, around at least part of a perimeter of one of the harvested items, the distance from the camera module to an outer part of the harvested item;

determine the distance from the camera module to a central part of the harvested item; and

approximate the distance to the conveyor as being the distance to the outer part plus the difference in distance between the outer part and the central part.

2. The harvester monitoring system according to claim 1 , wherein the depth data is a depth map.

3. The harvester monitoring system according to claim 1 , wherein the camera module includes a stereoscopic camera.

4. The harvester monitoring system according to claim 1 , wherein the camera module includes a visible light camera, an infra-red transmitter, and an infra-red receiver, and the depth data is determined by analysis of a distortion pattern of infra-red light emitted by the infra-red transmitter and received by the infra-red receiver.

5. The harvester monitoring system according to claim 1 , wherein the camera module includes a shroud configured to shield a camera of the camera module from ambient light.

6. The harvester monitoring system according to claim 5 , wherein the shroud includes a downwardly and outwardly extending skirt at a part of the shroud which is remote from the camera of the camera module.

7. The harvester monitoring system according to claim 1 , wherein the mounting bracket is an adjustable bracket which is configured to allow the height of the camera module from the conveyor to be adjusted.

8. The harvester monitoring system according to claim 1 , wherein the mounting bracket includes at least one mounting beam member with one or more mounting hooks associated therewith, the one or more mounting hooks being configured to engage at least part of the harvester.

9. The harvester monitoring system according to claim 8 , wherein the one or more mounting hooks include at least one mounting hook which is telescopically secured to the at least one mounting beam member.

10. The harvester monitoring system according to claim 1 , wherein the processing unit is configured to depth filter the image data to exclude or delete parts of the image data which are less than a minimum distance away from the camera module.

11. The harvester monitoring system according to claim 1 , wherein the processing unit is configured to segment the image data into at least one portion which represents one of the harvested items.

12. The harvester monitoring system according to claim 1 , wherein the one or more parameters include size information and the size information includes one or both of a dimension of the harvested items and a weight of the harvested items.

13. The harvester monitoring system according to claim 12 , wherein the processing unit is configured to categorise the harvested items based on the size information.

14. The harvester monitoring system according to claim 13 , wherein the processing unit is configured to categorise the harvested items by determining whether the harvested items would pass through a sizing aperture of a virtual sieve based on the sizing information.

15. The harvester monitoring system according to claim 1 , further including a storage sub-system which is configured to store the one or more parameters in association with the location data.

16. A monitoring method to determine one or more parameters associated with harvested items, the method comprising:

generating image data associated with the harvested items using a camera module having a field of view, the camera module being secured by a mounting bracket to a harvester such that a conveyor of the harvester is within the field of view of the camera module;

determining and outputting location data representative of a geographical location of the harvester using a location sub-system;

receiving the image data and the location data at a processing unit;

determining one or more parameters associated with the harvested items at the processing unit based on the received image data; and

recording, using the processing unit, the one or more parameters in association with the location data on a computer readable medium,

wherein the camera module is configured to determine depth data for the harvested items, and wherein the method further comprises:

depth filtering the image data, at the processing unit using the depth data, to exclude or delete parts of the image data which are more than a maximum distance away from the camera module, and wherein the maximum distance away from the camera module is determined in a calibration stage which comprises:

determining around at least part of a perimeter of one of the harvested items, using the processing unit, the distance from the camera module to an outer part of the harvested item;

determining, using the processing unit, the distance from the camera module to a central part of the harvested item; and

approximating, using the processing unit, the distance to the conveyor as being the distance to the outer part plus the distance between the outer part and the central part.

17. The monitoring method according to claim 16 , further including:

generating a graphical representation in the form of a map indicating the one or more parameters at locations based on the location data.

18. The monitoring method according to claim 16 , wherein the determining the one or more parameters associated with the harvested items includes determining size information, and wherein the size information includes one or both of a dimension of the harvested items and a weight of the harvested items.

19. A non-transitory computer readable medium having instructions stored thereon which, when executed by a processing unit, cause a method of determining one or more parameters associated with harvested items to be performed including:

generating image data associated with the harvested items using a camera module having a field of view, the camera module being secured by a mounting bracket to a harvester such that a conveyor of the harvester is within the field of view of the camera module;

determining and outputting location data representative of a geographical location of the harvester using a location sub-system;

receiving the image data and the location data at a processing unit;

determining one or more parameters associated with the harvested items at the processing unit based on the received image data; and

recording, using the processing unit, the one or more parameters in association with the location data on a computer readable medium,

wherein the camera module is configured to determine depth data for the harvested items, and the method includes:

depth filtering the image data, at the processing unit using the depth data, to exclude or delete parts of the image data which are more than a maximum distance away from the camera module, and wherein the maximum distance away from the camera module is determined in a calibration stage which comprises:

determining around at least part of a perimeter of one of the harvested items, using the processing unit, the distance from the camera module to an outer part of the harvested item;

determining, using the processing unit, the distance from the camera module to a central part of the harvested item; and

approximating, using the processing unit, the distance to the conveyor as being the distance to the outer part plus the difference in distance between the outer part and the central part.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2024
From: B-HIVE INNOVATIONS LIMITED
To: HARVESTEYE LIMITED
Reel/Frame 068504/0426 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2022
From: BRANSTON LIMITED
To: B-HIVE INNOVATIONS LIMITED
Reel/Frame 059638/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2022
From: GURURAJAN, VIDYANATH; WRIGHT, ALISON; HANSEN, MARK; HALES, IAN; SMITH, MELVYN; SMITH, LYNDON; SAMWORTH, DAVE; GREENWOOD, LUKE
To: BRANSTON LIMITED
Reel/Frame 059625/0827 →
Priority Claims (2)
GB 1621879 · Dec 21, 2016 · national
GB 1713953 · Aug 31, 2017 · national
Continuity (1)
Related Publication 20200084963A1 · Mar 19, 2020
Cited By (1)
US 12,446,486