Autonomous folding farm implement and method
There is provided an autonomous system for farm implements having a sensor system, an interface to send control signals to a power platform coupled to the farm implement, and a processing structure executing instructions. The instructions involve capturing initial sensor data from the sensor system; estimating a pose of the farm implement from the initial sensor data; generating a fold/unfold trajectory for the power platform in order to fold or unfold the farm implement; instructing the power platform using the interface to travel along the fold/unfold trajectory; receiving additional sensor data from the sensor system as the power platform travels along the fold/unfold trajectory; instructing the power platform using the interface to make adjustments to the fold/unfold trajectory based on the additional sensor data; and stopping the power platform once the farm implement reaches a folded position or an unfolded position.
1. An autonomous system for a farm implement comprising:
a sensor system applied to the farm implement, the farm implement being previously unknown to the autonomous system;
an imaging sensor capturing image data of the farm implement;
a control interface to send control signals to a power platform coupled to the farm implement;
a processing structure executing a plurality of instructions from a tangible computer-readable memory, the instructions comprise:
capturing sensor data from the sensor system;
estimating a pose of the farm implement from the image data;
observing folding or unfolding the farm implement;
continue receiving the sensor data and the image data and recording the control signals as the power platform substantively folds or unfolds the farm implement by pushing or pulling the farm implement exclusively with movement of the power platform;
determining at least one control step to fold or unfold the farm implement; and
subsequently instructing the power platform using the at least one control step to fold or unfold the farm implement.
2. The autonomous system according to claim 1 , wherein the sensor system comprises at least one of: a magnetometer, a range sensor, an inertial sensor, a digital switch, an analog potentiometer, a linear position sensor, a rotary position sensor, and any combination thereof.
3. The autonomous system according to claim 2 , wherein the range sensor is selected from at least one of: a light detection and ranging (LiDAR) sensor, a radio detection and ranging (radar) sensor, a sound navigation and ranging (sonar) sensor, microphones, and a pair of cameras.
4. The autonomous system according to claim 2 , wherein the image sensor comprises a field of view that encompasses the farm implement.
5. The autonomous system according to claim 1 , wherein the processing structure comprises at least one of: a general purpose processor, a digital signal processor (DSP), an artificial neural network (ANN), a graphics processing unit (GPU), a field programmable gate array (FPGA), and any combination thereof.
6. The autonomous system according to claim 1 , wherein the instructions further comprise: determining a power platform axis and an implement axis; generating an alignment trajectory to generally align the power platform axis with the implement axis; and instructing the power platform to travel along the alignment trajectory.
7. The autonomous system according to claim 1 , wherein the instructions further comprise:
determining at least one obstacle within an initial sensor data; generating an obstacle avoiding trajectory; and instructing the power platform to travel along the obstacle avoiding trajectory.
8. The autonomous system according to claim 1 , wherein the pose estimation comprises:
determining an initial relative position and orientation of at least one wing of the farm implement.
9. The autonomous system according to claim 8 , wherein the instructions further comprise:
sending at least one unlock signal to the power platform to unlock one of the at least one wing of the farm implement prior to the power platform traveling along a fold trajectory or an unfold trajectory; and
sending a direction signal to a direction switch to control a direction of an actuator associated with the one or the at least one wing.
10. The autonomous system according to claim 9 , wherein the instructions further comprise:
determining a wing angle of the at least one wing of the farm implement from the sensor data; and
stopping the power platform once the wing angle corresponds to a full operation angle or a fully folded angle.
11. The autonomous system according to claim 10 , wherein the instructions further comprise:
sending a locking signal to the at least one wing to lock the at least one wing of the farm implement in an operation position or a transport position.
12. The autonomous system according to claim 11 , wherein the farm implement folds or unfolds asymmetrically.
13. The autonomous system according to claim 10 , wherein the farm implement folds or unfolds symmetrically.
14. An autonomous method for unfolding or folding a farm implement, the method comprises:
applying a sensor system to the farm implement, the farm implement being previously unknown to the autonomous method;
observing a fold or unfold trajectory for a power platform to fold or unfold the farm implement by pushing or pulling the farm implement along the fold or unfold trajectory;
capturing sensor data from the sensor system;
capturing image data from an imaging sensor;
estimating a pose of the farm implement from the image data;
continue receiving the sensor data and the image data and recording at least one control signal to the power platform as the power platform exclusively folds or unfolds the farm implement with movement of the power platform;
determining at least one control step to fold or unfold the farm implement; and
subsequently instructing the power platform using the at least one control step to fold or unfold the farm implement.
15. The autonomous method according to claim 14 , further comprises:
detecting the farm implement and estimating at least one boundary of the farm implement.
16. The autonomous method according to claim 15 , wherein the at least one boundary is estimated by at least one of: a feature descriptor extraction, a deep learning process, a supervised deep learning process, a motion measurement, an optical flow, a map building, a linear optimization, and a nonlinear optimization.
17. The autonomous method according to claim 14 , further comprises:
estimating at least one state of the power platform, the farm implement, and a combination thereof.
18. The autonomous method according to claim 17 , wherein the at least one state is determined by at least one of: a geometric process, a Kalman filter, a linear optimization, a nonlinear optimization, and a moving horizon estimation.
19. The autonomous method according to claim 14 , further comprises:
generating the fold/unfold trajectory with at least one of: a common trajectory planning, a graph-based search, a search over a configuration space, a grid-based search, an interval-based search, a geometric process, an artificial potential field, a sampling-based process, a linear optimization, a nonlinear optimization, and a probabilistic roadmap.
20. The autonomous method according to claim 14 , further comprises:
determining at least one adjustment with at least one of: a Proportional-Derivative-Integral (PID), a Model Predictive Control (MPC), a linear control process, a nonlinear control process, a deep learning process, and a reinforcement learning-based process.
21. The autonomous method according to claim 14 , further comprises:
determining a type of the farm implement based on the sensor data.
22. The autonomous method according to claim 21 , further comprises:
training a machine learning process using at least one of: the sensor data, an operator input, system inputs, and system outputs to determine the type of the farm implement.
23. The autonomous method according to claim 14 , further comprises:
mapping an environment for tracking and localization of at least one of: the farm implement, the power platform, and any obstacle within the environment.