Machine-learned tillage shank malfunction in an autonomous farming vehicle
A detection system detects malfunctions in an autonomous farming vehicle during an autonomous routine using one or more models and data from sensors coupled to the autonomous farming vehicle. The models may include machine-learned models trained on the sensor data and configured to identify objects indicative of an operational or malfunctioning component within a tilling assembly such as a tilling shank or sweep. Additionally, a machine-learned model may be trained on sensor data to detect whether debris has plugged the tilling assembly of the autonomous farming vehicle. In response to detecting a malfunction or a plug, the detection system may modify the autonomous routine (e.g., pausing operation) or provide information for the malfunction to be addressed (e.g., the likely location of a malfunctioning sweep that has detached from the tilling assembly).
1 . A method of detecting plugs between tilling shanks by an autonomous farming vehicle, comprising:
accessing, in real-time, distance sensor data from a distance sensor coupled to a first tilling shank of a set of tilling shanks as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing an autonomous routine, the distance sensor configured to indicate a distance between the first tilling shank and a second tilling shank of the set of tilling shanks;
determining that a measure of a signal received by the distance sensor is below a threshold level, indicative of a plug in between the first tilling shank and the second tilling shank;
determining a location of the plug among the set of tilling shanks based on an identifier associated with the distance sensor coupled to the first tilling shank;
performing a modified autonomous routine of the autonomous farming vehicle to remove the plug from the set of tilling shanks at the determined location;
accessing image data as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing the modified autonomous routine; and
verifying, using the image data, that the plug is absent from the set of tilling shanks at the determined location.
2 . The method of claim 1 , further comprising responsive to verifying that the plug is absent from the set of tilling shanks at the determined location, generating instructions to revert from the modified autonomous routine to the autonomous routine.
3 . The method of claim 2 , further comprising:
determining a first location corresponding to where the plug is first detected;
determining a second location corresponding to where the plug is determined to be absent; and
modifying the autonomous routine to include tilling a path defined in the autonomous routine, the path between the first location and the second location.
4 . The method of claim 1 , further comprising:
accessing load cell data from a load cell sensor coupled to the set of tilling shanks, the load cell sensor associated with a plurality of draft forces required to pull the set of tilling shanks through the earth; and
determining that a draft force of the plurality of draft forces is above a threshold force, indicative of the plug among the set of tilling shanks.
5 . The method of claim 1 , further comprising:
accessing, in real-time, through-beam sensor data from a through-beam sensor comprising an emitter and a receiver coupled to the first and the second tilling shank, respectively, of the set of tilling shanks; and
determining a measure of a signal transmitted by the emitter and received at the receiver is below a threshold level indicative of the plug in between the first and second tilling shanks.
6 . The method of claim 1 , further comprising:
modifying the autonomous routine of the autonomous farming vehicle, wherein the modification comprises pausing the autonomous routine of the autonomous farming vehicle.
7 . The method of claim 1 , further comprising:
accessing environmental data representative of a plurality of conditions under which the autonomous farming vehicle performs the autonomous routine;
applying a statistical model to the environmental data, the statistical model configured to estimate a likelihood of detecting the plug based on the environmental data; and
detecting the plug further based on the application of the statistical model.
8 . The method of claim 7 , wherein the environmental data comprises a time, a temperature, or soil moisture level.
9 . The method of claim 1 , further comprising:
accessing equipment data representative of an arrangement of the set of tilling shanks, wherein the arrangement of the set of tilling shanks comprises a minimum spacing between each tilling shank of the set of tilling shanks;
applying a statistical model to the equipment data, the statistical model configured to estimate a likelihood of detecting a plug based on the equipment data; and
detecting the plug further based on the application of the statistical model.
10 . The method of claim 1 , further comprising:
determining a geographic location where the plug is detected;
determining whether a threshold number of plugs have been detected at the geographic location; and
in response to determining that the threshold number of detections has occurred at the geographic location:
generating a notification identifying the geographic location, and
transmitting the notification to a remote monitoring system.
11 . A detection system for an autonomous farming vehicle including a hardware processor and a non-transitory computer-readable medium storing executable instructions that, when executed by the hardware processor, cause the detection system to perform steps comprising:
accessing, in real-time, distance sensor data from a distance sensor coupled to a first tilling shank of a set of tilling shanks as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing an autonomous routine, the distance sensor configured to indicate a distance between the first tilling shank and a second tilling shank of the set of tilling shanks;
determining that a measure of a signal received by the distance sensor is below a threshold level, indicative of a plug in between the first tilling shank and the second tilling shank;
determining a location of the plug among the set of tilling shanks based on an identifier associated with the distance sensor coupled to the first tilling shank;
performing a modified autonomous routine of the autonomous farming vehicle to remove the plug from the set of tilling shanks at the determined location;
accessing image data as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing the modified autonomous routine; and
verifying, using the image data, that the plug is absent from the set of tilling shanks at the determined location.
12 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps comprising, responsive to verifying that the plug is absent from the set of tilling shanks at the determined location, generating instructions to revert from the modified autonomous routine to the autonomous routine.
13 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps further comprising:
determining a first location corresponding to where the plug is first detected;
determining a second location corresponding to where the plug is determined to be absent; and
modifying the autonomous routine to include tilling a path defined in the autonomous routine, the path between the first location and the second location.
14 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps further comprising:
accessing load cell data from a load cell sensor coupled to the set of tilling shanks, the load cell sensor associated with a plurality of draft forces required to pull the set of tilling shanks through the earth; and
determining that a draft force of the plurality of draft forces is above a threshold force, indicative of the plug among the set of tilling shanks.
15 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps further comprising:
accessing, in real-time, through-beam sensor data from a through-beam sensor comprising an emitter and a receiver coupled to the first and the second tilling shank, respectively, of the set of tilling shanks; and
determining a measure of a signal transmitted by the emitter and received at the receiver is below a threshold level indicative of the plug in between the first and second tilling shanks.
16 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps comprising modifying the autonomous routine of the autonomous farming vehicle, wherein the modification comprises pausing the autonomous routine of the autonomous farming vehicle.
17 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps further comprising:
accessing environmental data representative of a plurality of conditions under which the autonomous farming vehicle performs the autonomous routine;
applying a statistical model to the environmental data, the statistical model configured to estimate a likelihood of detecting the plug based on the environmental data; and
detecting the plug further based on the application of the statistical model.
18 . The detection system of claim 17 , wherein the environmental data comprises a time, a temperature, or soil moisture level.
19 . The detection system of claim 11 , wherein the instructions, when executed by the hardware processor, further cause the detection system to perform steps further comprising:
accessing equipment data representative of an arrangement of the set of tilling shanks, wherein the arrangement of the set of tilling shanks comprises a minimum spacing between each tilling shank of the set of tilling shanks;
applying a statistical model to the equipment data, the statistical model configured to estimate a likelihood of detecting a plug based on the equipment data; and
detecting the plug further based on the application of the statistical model.
20 . A non-transitory computer readable storage medium storing executable instructions that, when executed by one or more processors, cause the one or more processors to perform steps comprising:
accessing, in real-time, distance sensor data from a distance sensor coupled to a first tilling shank of a set of tilling shanks of an autonomous farming vehicle as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing an autonomous routine, the distance sensor configured to indicate a distance between the first tilling shank and a second tilling shank of the set of tilling shanks;
determining that a measure of a signal received by the distance sensor is below a threshold level, indicative of a plug in between the first tilling shank and the second tilling shank;
determining a location of the plug among the set of tilling shanks based on an identifier associated with the distance sensor coupled to the first tilling shank;
performing a modified autonomous routine of the autonomous farming vehicle to remove the plug from the set of tilling shanks at the determined location;
accessing image data as the autonomous farming vehicle pulls the set of tilling shanks through earth while performing the modified autonomous routine; and
verifying, using the image data, that the plug is absent from the set of tilling shanks at the determined location.