Plant treatment model training based on agricultural image interaction
Embodiments relate to training a plant treatment model. A control system may provide images of plants for display to a user. The control system may receive one or more plant treatment action preferences of the user. The one or more plant treatment action preferences include labels for the images that identify plants in the images and treatment actions to be applied to the identified plants. The control system may train the plant treatment model based on the one or more plant treatment action preferences. The trained plant treatment model is configured to, when applied to an image of plants in a field, determine treatment actions to be applied to the plants in accordance with the one or more plant treatment action preferences of the user. The control system may configure a farming machine to operate based on the trained plant treatment model.
1 . A method for training a plant treatment model, the method comprising:
providing images of plants of different sizes and types for display to and annotation by a user;
receiving one or more plant treatment action preferences of the user for a farming machine configured to perform treatment actions on plants growing in a field, the one or more plant treatment action preferences including labels for the images that identify plants in the images and treatment actions to be applied to the identified plants;
training the plant treatment model based on the one or more plant treatment action preferences of the user, the trained plant treatment model configured to, when applied to first image of one or more plants in the field, determine treatment actions to be applied to the one or more plants in accordance with the one or more plant treatment action preferences of the user,
wherein the trained plant treatment model is further configured to, when applied to a second image of multiple plants, identify a subset of the multiple plants in the second image in accordance with the one or more plant treatment action preferences of the user; and
configuring the farming machine to operate based on the trained plant treatment model.
2 . The method of claim 1 , wherein a plant identification sensitivity level of the trained plant treatment model is based on the one or more plant treatment action preferences of the user.
3 . The method of claim 1 , wherein to identify the subset of the multiple plants in the second image, the trained plant treatment model is further configured to identify weed plants with sizes in a size range in the second image and ignoring weed plants with sizes outside the size range.
4 . A method for training a plant treatment model, the method comprising:
providing images of plants of different sizes and types for display to and annotation by a user;
receiving one or more plant treatment action preferences of the user for a farming machine configured to perform treatment actions on plants growing in a field, the one or more plant treatment action preferences including labels for the images that identify plants in the images and treatment actions to be applied to the identified plants;
training the plant treatment model based on the one or more plant treatment action preferences of the user, the trained plant treatment model configured to, when applied to an image of one or more plants in the field, determine treatment actions to be applied to the one or more plants in accordance with the one or more plant treatment action preferences of the user;
configuring the farming machine to operate based on the trained plant treatment model;
receiving one or more revised plant treatment action preferences of the user; and
adjusting parameters of the trained plant treatment model based on the one or more revised plant treatment action preferences.
5 . The method of claim 4 , wherein the one or more revised plant treatment action preferences of the user are received subsequent to the user receiving indications of plant treatment actions performed by the farming machine while operating based on the trained plant treatment model.
6 . The method of claim 4 , wherein adjusting the parameters of the trained plant treatment model is performed while the farming machine is operating in the field.
7 . The method of claim 1 , wherein the labels for the images are generated based on annotations by the user.
8 . The method of claim 1 , wherein the plant treatment model includes parameters with default values, and training the plant treatment model comprises changing values of the parameters based on the labels for the images.
9 . The method of claim 1 , wherein the one or more plant treatment action preferences are generated responsive to the user annotating the provided images.
10 . A non-transitory computer-readable storage medium comprising stored instructions that, when executed by a computing device, cause the computing device to perform operations including:
providing images of plants of different sizes and types for display to and annotation by a user;
receiving one or more plant treatment action preferences of the user for a farming machine configured to perform treatment actions on plants growing in a field, the one or more plant treatment action preferences including labels for the images that identify plants in the images and treatment actions to be applied to the identified plants;
training a plant treatment model based on the one or more plant treatment action preferences of the user, the trained plant treatment model configured to, when applied to first image of one or more plants in the field, determine treatment actions to be applied to the one or more plants in accordance with the one or more plant treatment action preferences of the user,
wherein the trained plant treatment model is further configured to, when applied to a second image of multiple plants, identify a subset of the multiple plants in the second image in accordance with the one or more plant treatment action preferences of the user; and
configuring the farming machine to operate based on the trained plant treatment model.
11 . The non-transitory computer-readable storage medium of claim 10 , wherein a plant identification sensitivity level of the trained plant treatment model is based on the one or more plant treatment action preferences of the user.
12 . The non-transitory computer-readable storage medium of claim 10 , wherein to identify the subset of the multiple plants in the second image, the trained plant treatment model is further configured to identify weed plants with sizes in a size range in the second image and ignoring weed plants with sizes outside the size range.
13 . A non-transitory computer-readable storage medium comprising stored instructions that, when executed by a computing device, cause the computing device to perform operations including:
providing images of plants of different sizes and types for display to and annotation by a user;
receiving one or more plant treatment action preferences of the user for a farming machine configured to perform treatment actions on plants growing in a field, the one or more plant treatment action preferences including labels for the images that identify plants in the images and treatment actions to be applied to the identified plants;
training a plant treatment model based on the one or more plant treatment action preferences of the user, the trained plant treatment model configured to, when applied to an image of one or more plants in the field, determine treatment actions to be applied to the one or more plants in accordance with the one or more plant treatment action preferences of the user;
configuring the farming machine to operate based on the trained plant treatment model;
receiving one or more revised plant treatment action preferences of the user; and
adjusting parameters of the trained plant treatment model based on the one or more revised plant treatment action preferences.
14 . The non-transitory computer-readable storage medium of claim 13 , wherein the one or more revised plant treatment action preferences of the user are received subsequent to the user receiving indications of plant treatment actions performed by the farming machine while operating based on the trained plant treatment model.
15 . The non-transitory computer-readable storage medium of claim 13 , wherein adjusting the parameters of the trained plant treatment model is performed while the farming machine is operating in the field.
16 . The non-transitory computer-readable storage medium of claim 10 , wherein the labels for the images are generated based on annotations by the user.
17 . The non-transitory computer-readable storage medium of claim 10 , wherein the plant treatment model includes parameters with default values, and training the plant treatment model comprises changing values of the parameters based on the labels for the images.
18 . The non-transitory computer-readable storage medium of claim 10 , wherein the one or more plant treatment action preferences are generated responsive to the user annotating the provided images.