Sensor fusion in agricultural vehicle steering
A row steering system of an agricultural machine is provided. The row steering system includes a first sensor assembly configured to detect a first orientation of the agricultural machine relative to a path reference in a field using a first sensor configured to measure a first characteristic. The system also includes a second sensor assembly configured to detect a second orientation of the agricultural machine using a second sensor configured to measure a second characteristic. The system further includes a control module including a first evaluation module to obtain a first confidence in the detected first orientation, a second evaluation module to obtain a second confidence in the detected second orientation, and a selector module to selectively provide one or more of the detected first orientation or the detected second orientation to a machine controller of the agricultural machine based on the first and second confidences.
1. A row steering system of an agricultural machine, the row steering system comprising:
a first sensor assembly configured to detect a first orientation of the agricultural machine relative to a path reference in a field using a first sensor configured to measure a first characteristic;
a second sensor assembly configured to detect a second orientation of the agricultural machine relative to crop rows in the field using a second sensor configured to measure a second characteristic different than the first characteristic; and
one or more processors configured to:
calculate a first confidence in the detected first orientation using a combination of signal quality and line-fit quality of the detected first orientation, wherein the signal quality is determined based on differentiation of a crop or row indicator from a soil or furrow indicator achieving a differentiation threshold, and the line-fit quality is determined based on a comparison of a fitted line to calculated row positions;
calculate a second confidence in the detected second orientation using a combination of signal quality and line-fit quality of the detected second orientation; and
automatically control the agricultural machine based on the first and second confidences.
2. The row steering system of claim 1 , wherein the first sensor is an optical sensor and the second sensor is a radar sensor.
3. The row steering system of claim 1 , wherein the first and second sensors are optical sensors.
4. The row steering system of claim 1 , wherein the first and second sensors are radar sensors.
5. The row steering system of claim 1 , wherein the first sensor or the second sensor comprises at least one of an optical sensor, radar sensor, a global positioning sensor, an acoustic sensor, a LIDAR sensor, or a tactile sensor.
6. The row steering system of claim 1 , wherein the first sensor assembly is configured to couple to the agricultural machine at an elevated location relative to the path reference, and the first sensor is configured to detect the first orientation from the elevated location directed toward the path reference.
7. The row steering system of claim 6 , wherein the second sensor assembly is configured to couple to the agricultural machine at a lateral location relative to the path reference, and the second sensor is configured to detect the second orientation from the lateral location directed across the path reference.
8. The row steering system of claim 1 , wherein the first and second orientation comprise:
a translational difference between a location of the agricultural machine and the path reference; and
an angular difference between an angular orientation of the agricultural machine and the path reference.
9. The row steering system of claim 1 , wherein the one or more processors are further configured to:
weight the first and second orientations based on one or more of the respective first or second confidences;
determine a combined orientation including the weighted first and second orientations; and
selectively provide one of the detected first orientation, the detected second orientation, or the combined orientation to a machine controller.
10. The row steering system of claim 1 , wherein the one or more processors are further configured to:
compare the first confidence to the second confidence; and
selectively provide the first orientation to a machine controller responsive to the first confidence being larger than the second confidence or provide the second orientation to the machine controller responsive to the second confidence being larger than the first confidence.
11. The row steering system of claim 1 , wherein the path reference includes at least one of a guidance path, a guidance line, or one or more crop rows.
12. A system for steering an agricultural machine relative to guidance path, the system comprising:
a sensor module including:
a first sensor assembly configured to obtain a first orientation of the agricultural machine relative to the guidance path based on a first measured characteristic; and
a second sensor assembly configured to obtain a second orientation of the agricultural machine relative to the guidance path based on a second measured characteristic;
one or more processors configured to automatically control the agricultural machine, the one or more processors are configured to:
calculate a first confidence in the first orientation based on the first sensor assembly using a combination of signal quality and line-fit quality of the first orientation and calculate a second confidence in the second orientation based on the second sensor assembly using a combination of signal quality and line-fit quality of the second orientation, wherein the signal quality is determined based on differentiation of a crop or row indicator from a soil or furrow indicator achieving a differentiation threshold, and the line-fit quality is determined based on a comparison of a fitted line to calculated row positions;
generate a combined orientation of the agricultural machine based on a weighted combination of the first orientation and the second orientation;
assign first and second weights to respective first and second orientations based on one or more of the respective first or second confidences; and
generate the combined orientation using the weighted first and second orientations;
an interface configured to communicate the combined orientation; and
a machine controller configured to automatically control the agricultural machine using the combined orientation received from the interface.
13. The system of claim 12 , wherein:
the first orientation of the agricultural machine includes a first position of the agricultural machine relative to the guidance path and a first angle between the agricultural machine and the guidance path as observed with the first sensor assembly; and
the second orientation of the agricultural machine includes a second position of the agricultural machine relative to the guidance path and second angle between the agricultural machine and the guidance path as observed with the second sensor assembly.
14. The system of claim 13 , wherein the one or more processors are further configured to:
generate a composite position from the first and second positions based on the weighted first and second orientations;
generate a composite angle from the first and second angles based on the weighted first and second orientations; and
generate a composite orientation including the composite position and the composite angle.
15. The system of claim 14 , wherein the weighted first orientation and the weighted second orientation include first and second gains, respectively, and the first and second gains are normalized to sum to 1.
16. The system of claim 15 , wherein the weighted first orientation and the weighted second orientation are based on the first confidence and the second confidence, respectively.
17. The system of claim 14 , wherein the weighting module is configured to set a first gain to zero (0) and a second gain to one (1) responsive to first confidence falling below a specified threshold value.
18. The system of claim 14 , wherein the one or more processors are further configured to set a first gain to zero (0) and a second gain to one (1) responsive to the second confidence exceeding the first confidence by a threshold value.
19. The system of claim 14 , wherein the one or more processors are further configured to:
adjust the first weight of the first orientation according to the second measured characteristic of the second sensor assembly.
20. The system of claim 19 , wherein the one or more processors are further configured to decrease the first weight of the first orientation according to the second measured characteristic of the second sensor assembly indicating a decreased capability of the first sensor assembly to measure the first measured characteristic.
21. A method for controlling an agricultural machine according to guidance path, the method comprising:
obtaining a first orientation of the agricultural machine relative to the guidance path with a first sensor;
obtaining a second orientation of the agricultural machine relative to the guidance path with a second sensor;
calculating a first confidence of the first orientation using a combination of signal quality and line-fit quality of the first orientation and calculating a second confidence of the second orientation using a combination of signal quality and line-fit quality of the second orientation;
calculating the signal quality based on differentiation of a crop or row indicator from a soil or furrow indicator achieving a differentiation threshold;
calculating the line-fit quality based on a comparison of a fitted line to calculated row positions;
generating a combined orientation of the agricultural machine by:
comparing the first confidence with the second confidence;
assigning a first and second weights to the respective first and second orientations based on the comparing; and
generating the combined orientation using the weighted first and second orientations; and
automatically controlling the agricultural machine using the combined orientation.
22. The method of claim 21 , further comprising:
configuring the first sensor to couple to the agricultural machine at an elevated location relative to a path reference for detecting the first orientation from the elevated location directed toward the path reference; and
configuring the second sensor to couple to the agricultural machine at a lateral location relative to the path reference for detecting the second orientation from the lateral location directed across the path reference.
23. The method of claim 22 , wherein obtaining the first confidence comprises decreasing the first confidence relative to the second confidence responsive to a detected increase in a height of crops in the guidance path.
24. The method of claim 22 , wherein obtaining the first confidence comprises decreasing the first confidence relative to the second confidence responsive to a detected increase in a size of density of a canopy of crops in the path reference.
25. The method of claim 22 , wherein obtaining the first confidence comprises increasing the first confidence relative to the second confidence responsive to a detected curvature in the path reference.