Using empirical evidence to generate synthetic training data for plant detection
Implementations are described herein for automatically generating synthetic training images that are usable as training data for training machine learning models to detect, segment, and/or classify various types of plants in digital images. In various implementations, a digital image may be obtained that captures an area. The digital image may depict the area under a lighting condition that existed in the area when a camera captured the digital image. Based at least in part on an agricultural history of the area, a plurality of three-dimensional synthetic plants may be generated. The synthetic training image may then be generated to depict the plurality of three-dimensional synthetic plants in the area. In some implementations, the generating may include graphically incorporating the plurality of three-dimensional synthetic plants with the digital image based on the lighting condition.
1. A method for generating a synthetic training image, the method implemented using one or more processors and comprising:
obtaining a digital image that captures an area, wherein the digital image depicts the area under a lighting condition that existed in the area when a camera captured the digital image;
based at least in part on an agricultural history of the area, generating a plurality of three-dimensional synthetic plants; and
generating the synthetic training image to depict the plurality of three-dimensional synthetic plants in the area, wherein the generating includes graphically incorporating the plurality of three-dimensional synthetic plants with the digital image based on the lighting condition.
2. The method of claim 1 , wherein the agricultural history of the area includes time-series data corresponding to a plurality of environmental conditions of the area, wherein the generating is based on the time-series data.
3. The method of claim 2 , wherein the plurality of environmental conditions include two or more of temperature, precipitation, sunlight exposure, fertilizer application, soil composition, pH levels, or pesticide application.
4. The method of claim 1 , wherein the agricultural history includes a plurality of environmental conditions that existed in the area during a time interval preceding capture of the digital image that captures the area.
5. The method of claim 4 , wherein the graphically incorporating includes spacing the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on the environmental conditions.
6. The method of claim 1 , wherein the graphically incorporating includes spacing the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on one or more plants already depicted in the digital image.
7. The method of claim 1 , further comprising using the synthetic training image to train a machine learning model to segment or detect, in digital images, plants of a same type as at least some of the three-dimensional synthetic plants.
8. At least one non-transitory computer-readable medium for generating a synthetic training image, wherein the medium comprises instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:
obtain a digital image that captures an area, wherein the digital image depicts the area under a lighting condition that existed in the area when a camera captured the digital image;
based at least in part on an agricultural history of the area, generate a plurality of three-dimensional synthetic plants; and
generate the synthetic training image to depict the plurality of three-dimensional synthetic plants in the area, wherein the generation includes graphical incorporation of the plurality of three-dimensional synthetic plants with the digital image based on the lighting condition.
9. The at least one non-transitory computer-readable medium of claim 8 , wherein the agricultural history of the area includes time-series data corresponding to a plurality of environmental conditions of the area, wherein the generating is based on the time-series data.
10. The at least one non-transitory computer-readable medium of claim 9 , wherein the plurality of environmental conditions include two or more of temperature, precipitation, sunlight exposure, fertilizer application, soil composition, pH levels, or pesticide application.
11. The at least one non-transitory computer-readable medium of claim 8 , wherein the agricultural history includes a plurality of environmental conditions that existed in the area during a time interval preceding capture of the digital image that captures the area.
12. The at least one non-transitory computer-readable medium of claim 11 , wherein the graphical incorporation includes spacing of the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on the environmental conditions.
13. The at least one non-transitory computer-readable medium of claim 8 , wherein the graphical incorporation includes spacing of the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on one or more plants already depicted in the digital image.
14. The at least one non-transitory computer-readable medium of claim 8 , further comprising instructions to use the synthetic training image to train a machine learning model to segment or detect, in digital images, plants of a same type as at least some of the three-dimensional synthetic plants.
15. A system for generating a synthetic training image, the system comprising one or more processors and memory storing instructions that, in response to execution of the instructions by the one or more processors, cause the one or more processors to:
obtain a digital image that captures an area, wherein the digital image depicts the area under a lighting condition that existed in the area when a camera captured the digital image;
based at least in part on an agricultural history of the area, generate a plurality of three-dimensional synthetic plants; and
generate the synthetic training image to depict the plurality of three-dimensional synthetic plants in the area, wherein the generation includes graphical incorporation of the plurality of three-dimensional synthetic plants with the digital image based on the lighting condition.
16. The system of claim 15 , wherein the agricultural history of the area includes time-series data corresponding to a plurality of environmental conditions of the area, wherein the generating is based on the time-series data.
17. The system of claim 16 , wherein the plurality of environmental conditions include two or more of temperature, precipitation, sunlight exposure, fertilizer application, soil composition, pH levels, or pesticide application.
18. The system of claim 15 , wherein the agricultural history includes a plurality of environmental conditions that existed in the area during a time interval preceding capture of the digital image that captures the area.
19. The system of claim 18 , wherein the graphical incorporation includes spacing of the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on the environmental conditions.
20. The system of claim 15 , wherein the graphical incorporation includes spacing of the plurality of three-dimensional synthetic plants from each other in the synthetic training image based on one or more plants already depicted in the digital image.