Agricultural machine guidance
Systems and methods are provided for guiding an agricultural machine utilising image data received from one or more imaging sensors associated with the agricultural machine. The image data is analysed utilising a detection model to classify at least one object within the environment of the agricultural machine and the classification is used to identify a cooperative machine for performing a cooperative operational task with the agricultural machine. The systems extend to controlling operation of the guidance system in dependence on the identified cooperative machine.
1 . A control system for a guidance system of an agricultural machine, the control system comprising one or more controllers, and being configured to:
receive image data from one or more imaging sensors associated with the agricultural machine;
analyze the image data utilizing a detection model to classify at least one object within the environment of the agricultural machine;
identify, from the at least one classified object, a cooperative machine for performing a cooperative operational task with the agricultural machine;
generate and output one or more control signals for controlling operation of the guidance system in dependence on the identified cooperative machine; and
maneuver the agricultural machine on an operational path to perform at least a portion of the cooperative operation task while both the cooperative machine and the agricultural machine are in motion.
2 . The control system as claimed in claim 1 , wherein the control system is further configured to control the guidance system in dependence on at least one of an identity and a position of the identified cooperative machine.
3 . The control system of claim 1 , wherein the guidance system comprises a user interface; and the control system is configured to control operation of the user interface for outputting one or more indicators indicative of at least one of an identity and a position of the cooperative machine.
4 . The control system of claim 3 , wherein the control system is further configured to control operation of the user interface of the guidance system for outputting one or more instructions for an operator of the agricultural machine relating to movement of the agricultural machine with respect to the cooperative machine.
5 . The control system of claim 1 , wherein the control system is further configured to determine the operational path for the agricultural machine for performing the cooperative operational task.
6 . The control system of claim 5 , wherein maneuvering the agricultural machine on the operational path to perform at least a portion of the cooperative operation task comprises controlling operation of the guidance system of the agricultural machine for controlling motion of the agricultural machine along the operational path.
7 . The control system of claim 6 , wherein the control system is further configured to control:
a propulsion system of the agricultural machine for controlling a forward speed of the agricultural machine; and
a steering system of the agricultural machine for controlling steering of the machine along or with respect to the operational path or with respect to the cooperative machine or one or more components thereof.
8 . The control system of claim 5 , wherein:
the operational path comprises a suggested or determined path for moving the agricultural machine to an operational position with respect to the cooperative machine; and
the operational path comprises a suggested or determined path for moving the agricultural machine along a path to perform the cooperative operational task.
9 . The control system of claim 1 , wherein the control system is further configured to utilize the detection model for determining a classification for each of a plurality of objects within the image data.
10 . The control system of claim 9 , wherein the control system is further configured to:
determine, from the multiple classifications, one or more candidate cooperative machines;
select one of the one or more candidate cooperative machines; and
control the guidance system of the agricultural machine in dependence thereon.
11 . The control system of claim 1 , wherein the detection model comprises a machine-learned model trained on one or more training datasets with known objects with respective classifications.
12 . The control system of claim 1 , wherein the classification output by the detection model comprises a bounding box overlaid onto the image data at the location of the object as determined by the respective model; and wherein the position of the bounding box within the image data is utilized by the control system for controlling the guidance system.
13 . The control system of claim 1 , wherein the agricultural machine comprises a tractor with a trailer suitably coupled thereto; and the control system is configured to:
identify the cooperative agricultural machine within the environment of the tractor as a combine harvester performing a harvesting operation; and
control the guidance system in accordance with an operational path which aligns the trailer with an unloading mechanism of the combine for receiving crop material from the combine in the trailer of the tractor-trailer combination.
14 . The control system of claim 1 , wherein the agricultural machine comprises a tractor with an implement suitably coupled thereto; and the control system is configured to:
identify the cooperative agricultural machine within the environment as a tractor with a corresponding implement coupled thereto; and
control the guidance system in accordance with an operational path which aligns the tractor and implement combination with the corresponding cooperative machine such that the tractor and implement combination works an adjacent row to the cooperative machine.
15 . The control system of claim 1 , wherein the agricultural machine comprises a baler; and the control system is configured to:
identify the cooperative agricultural machine within the environment of the tractor as a combine harvester performing a harvesting operation; and
control the guidance system in accordance with an operational path which aligns the intake of the baler with a swath of residue material spread by the combine during the harvesting operation.
16 . The control system of claim 1 , wherein the agricultural machine comprises a harvesting machine; and the control system is configured to:
identify the cooperative agricultural machine within the environment as a corresponding harvesting machine; and
control the guidance system in accordance with an operational path which aligns the harvesting machine with the corresponding cooperative harvesting machine such that the harvesting machine works in parallel with the cooperative harvesting machine.
17 . A guidance system for an agricultural machine, comprising one or more imaging sensors; and wherein the system further comprises the control system of claim 1 .
18 . An agricultural machine comprising a control system for a guidance system of the agricultural machine, the control system comprising one or more controllers, and being configured to:
receive image data from one or more imaging sensors associated with the agricultural machine;
analyze the image data utilizing a detection model to classify at least one object within the environment of the agricultural machine;
identify, from the at least one classified object, a cooperative machine for performing a cooperative operational task with the agricultural machine;
generate and output one or more control signals for controlling operation of the guidance system in dependence on the identified cooperative machine; and
maneuver the agricultural machine on an operational path to perform at least a portion of the cooperative operation task while both the cooperative machine and the agricultural machine are in motion.
19 . A method for guiding an agricultural machine, comprising:
receiving image data from one or more imaging sensors associated with the agricultural machine;
analyzing the image data utilizing a detection model to classify at least one object within the environment of the agricultural machine;
identifying, from the at least one classified object, a cooperative machine for performing a cooperative operational task with the agricultural machine;
controlling operation of a guidance system of the agricultural machine in dependence on the identified cooperative machine; and
maneuver the agricultural machine on an operational path to perform at least a portion of the cooperative operation task while both the identified cooperative machine and the agricultural machine are in motion.