COMPUTER VISION APPROACHES FOR ENVIRONMENTALLY SUSTAINABLE AQUACULTURE
Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for environmentally sustainable aquaculture through computer vision for ectoparasite detection and medication dosing. In some implementations, actions include obtaining an image captured by an underwater camera; determining one or more fish detections and one or more ectoparasite detections based on the image; generating a filtered set of fish detections and ectoparasite detections; providing the filtered set of fish detections and ectoparasite detections to a trained model; and obtaining output of the trained model indicating an intensity of ectoparasite infection.
1 . A method comprising obtaining an image captured by an underwater camera;
determining one or more fish detections and one or more ectoparasite detections based on the image;
generating a filtered set of fish detections and ectoparasite detections;
providing the filtered set of fish detections and ectoparasite detections to a trained model; and
obtaining output of the trained model indicating an intensity of ectoparasite infection.
2 . The method of claim 1 , comprising:
generating a medication dosage based on the intensity of ectoparasite infection;
and providing an indication of the medication dosage to a medication dosing apparatus.
3 . The method of claim 1 , wherein the trained model is a linear regression mapping a number of fish detections and a number of ectoparasite detections in the filtered set of fish detections and ectoparasite detections to the intensity of ectoparasite infection.
4 . The method of claim 1 , comprising:
detecting a location of a cleaner fish; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include an ectoparasite detection satisfying a threshold distance from the location of the cleaner fish.
5 . The method of claim 1 , comprising:
detecting a location of an ectoparasite detection;
determining the location of the ectoparasite detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include the ectoparasite detection satisfying the distance threshold.
6 . The method of claim 1 , comprising:
detecting a location of a fish detection;
determining the location of the fish detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections and ectoparasite detections, wherein the filtered set of fish detections and ectoparasite detections do not include the fish detection satisfying the distance threshold.
7 . The method of claim 1 , wherein generating the filtered set of fish detections and ectoparasite detections comprises:
determining an area corresponding to a location of a first ectoparasite detection;
determining the area of the first ectoparasite detection does not overlap with areas of any fish detections; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include the first ectoparasite detection.
8 . A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining an image captured by an underwater camera;
determining one or more fish detections and one or more ectoparasite detections based on the image;
generating a filtered set of fish detections and ectoparasite detections;
providing the filtered set of fish detections and ectoparasite detections to a trained model; and
obtaining output of the trained model indicating an intensity of ectoparasite infection.
9 . The system of claim 8 , wherein the operations comprise:
generating a medication dosage based on the intensity of ectoparasite infection; and
providing an indication of the medication dosage to a medication dosing apparatus.
10 . The system of claim 8 , wherein the trained model is a linear regression mapping a number of fish detections and a number of ectoparasite detections in the filtered set of fish detections and ectoparasite detections to the intensity of ectoparasite infection.
11 . The system of claim 8 , wherein the operations comprise:
detecting a location of a cleaner fish; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include an ectoparasite detection satisfying a threshold distance from the location of the cleaner fish.
12 . The system of claim 8 , wherein the operations comprise:
detecting a location of an ectoparasite detection;
determining the location of the ectoparasite detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include the ectoparasite detection satisfying the distance threshold.
13 . The system of claim 8 , wherein the operations comprise:
detecting a location of a fish detection;
determining the location of the fish detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections and ectoparasite detections, wherein the filtered set of fish detections and ectoparasite detections do not include the fish detection satisfying the distance threshold.
14 . The system of claim 8 , wherein generating the filtered set of fish detections and ectoparasite detections comprises:
determining an area corresponding to a location of a first ectoparasite detection;
determining the area of the first ectoparasite detection does not overlap with areas of any fish detections; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include the first ectoparasite detection.
15 . A non-transitory computer storage medium encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
obtaining an image captured by an underwater camera;
determining one or more fish detections and one or more ectoparasite detections based on the image;
generating a filtered set of fish detections and ectoparasite detections;
providing the filtered set of fish detections and ectoparasite detections to a trained model; and
obtaining output of the trained model indicating an intensity of ectoparasite infection.
16 . The non-transitory computer storage medium of claim 15 , comprising:
generating a medication dosage based on the intensity of ectoparasite infection; and
providing an indication of the medication dosage to a medication dosing apparatus.
17 . The non-transitory computer storage medium of claim 15 , wherein the trained model is a linear regression mapping a number of fish detections and a number of ectoparasite detections in the filtered set of fish detections and ectoparasite detections to the intensity of ectoparasite infection.
18 . The non-transitory computer storage medium of claim 15 , comprising:
detecting a location of a cleaner fish; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include an ectoparasite detection satisfying a threshold distance from the location of the cleaner fish.
19 . The non-transitory computer storage medium of claim 15 , comprising:
detecting a location of an ectoparasite detection;
determining the location of the ectoparasite detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections, wherein the filtered set of fish detections and ectoparasite detections do not include the ectoparasite detection satisfying the distance threshold.
20 . The non-transitory computer storage medium of claim 15 , comprising:
detecting a location of a fish detection;
determining the location of the fish detection relative to a location of the underwater camera satisfies a distance threshold; and
generating the filtered set of fish detections and ectoparasite detections, wherein the filtered set of fish detections and ectoparasite detections do not include the fish detection satisfying the distance threshold.