Automated camera positioning for feeding behavior monitoring
Methods, systems, and apparatus, including computer programs encoded on computer-readable storage media, for automated camera positioning for feeding behavior monitoring. In some implementations, a system obtains an image of a scene, a spatial model that corresponds to a subfeeder, and calibration parameters of a camera, the system determines a size of the subfeeder in the image of the scene, the system selects an updated position of the camera relative to the subfeeder, the system provides the updated position of the camera relative to the subfeeder to a winch controller, and the system moves the camera to the updated position.
1. A method comprising:
obtaining, at one or more processing devices, an image of a scene that includes an aquaculture subfeeder configured to deliver a feed underwater;
obtaining, by the one or more processing devices, a spatial model that corresponds to the subfeeder;
obtaining calibration parameters of a camera that captured the image of the scene;
determining, by the one or more processing devices, and based on the spatial model, the image of the scene, and the calibration parameters of the camera, a size of the subfeeder in the image of the scene;
selecting, by the one or more processing devices, and based on the size of the subfeeder in the image of the scene, an updated position of the camera relative to the subfeeder;
generating, by the one or more processing devices, a signal configured to cause a winch controller to move the camera to the updated position; and
providing the signal to the winch controller.
2. The method of claim 1 , wherein selecting, by the one or more processing devices, and based on the size of the subfeeder in the image of the scene, the updated position of the camera comprises:
dynamically selecting the updated position of the camera relative to the subfeeder.
3. The method of claim 1 , wherein the updated position comprises a preferred position of the camera relative to the subfeeder associated with the spatial model of the subfeeder.
4. The method of claim 1 , wherein selecting, by the one or more processing devices, and based on the size of the subfeeder in the image of the scene, the updated position of the camera relative to the subfeeder, comprises:
determining a depth of the subfeeder that characterizes a distance of the camera that obtained the image of the scene from the subfeeder;
determining, based on the depth of the subfeeder, a current position of the camera relative to the subfeeder; and
selecting, based on the current position of the camera relative to the subfeeder, the updated position of the camera relative to the subfeeder.
5. The method of claim 4 , wherein determining the depth of the subfeeder that characterizes the distance of the camera that obtained the image of the scene from the subfeeder comprises:
determining a number of pixels in the image of the scene that depicts the subfeeder.
6. The method of claim 4 , wherein determining the depth of the subfeeder that characterizes the distance of the camera that obtained the image of the scene from the subfeeder comprises:
correlating the spatial model of the subfeeder within the image of the scene with the calibration parameters of the camera.
7. The method of claim 1 , wherein, in the image of the scene, the subfeeder is at least partially obscured by another object.
8. The method of claim 1 , further comprising:
determining, by the one or more processing devices, and based on the spatial model, the image of the scene, and the calibration parameters of the camera, a current position of the camera relative to the subfeeder, and
wherein selecting, by the one or more processing devices, and based on the size of the subfeeder in the image of the scene, the updated position of the camera relative to the subfeeder comprises:
selecting the updated position of the camera relative to the subfeeder such that a feed is visible within the image of the scene.
9. The method of claim 8 , wherein determining, by the one or more processing devices, and based on the spatial model, the image of the scene, and the calibration parameters of the camera, the current position of the camera relative to the subfeeder comprises:
determining that at the current position of the camera relative to the subfeeder a feed is not visible within the image of the scene.
10. A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining an image of a scene that includes an aquaculture subfeeder configured to deliver a feed underwater;
obtaining a spatial model that corresponds to the subfeeder;
obtaining calibration parameters of a camera that captured the image of the scene;
determining, based on the spatial model, the image of the scene, and the calibration parameters of the camera, a size of the subfeeder in the image of the scene;
selecting, based on the size of the subfeeder in the image of the scene, an updated position of the camera relative to the subfeeder;
generating a signal configured to cause a winch controller to move the camera to the updated position; and
providing the signal to the winch controller.
11. The system of claim 10 , wherein selecting, based on the size of the subfeeder in the image of the scene, the updated position of the camera comprises:
dynamically selecting the updated position of the camera relative to the subfeeder.
12. The system of claim 10 , wherein the updated position comprises a preferred position of the camera relative to the subfeeder associated with the spatial model of the subfeeder.
13. The system of claim 10 , wherein selecting, based on the size of the subfeeder in the image of the scene, the updated position of the camera relative to the subfeeder, comprises:
determining a depth of the subfeeder that characterizes a distance of the camera that obtained the image of the scene from the subfeeder;
determining, based on the depth of the subfeeder, a current position of the camera relative to the subfeeder; and
selecting, based on the current position of the camera relative to the subfeeder, the updated position of the camera relative to the subfeeder.
14. The system of claim 13 , wherein determining the depth of the subfeeder that characterizes the distance of the camera that obtained the image of the scene from the subfeeder comprises:
determining a number of pixels in the image of the scene that depict the subfeeder.
15. The system of claim 13 , wherein determining the depth of the subfeeder that characterizes the distance of the camera that obtained the image of the scene from the subfeeder comprises:
correlating the spatial model of the subfeeder within the image of the scene with the calibration parameters of the camera.
16. One or more non-transitory computer-readable storage medium coupled to one or more processors that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
obtaining an image of a scene that includes an aquaculture subfeeder configured to deliver a feed underwater;
obtaining a spatial model that corresponds to the subfeeder;
obtaining calibration parameters of a camera that captured the image of the scene;
determining, based on the spatial model, the image of the scene, and the calibration parameters of the camera, a size of the subfeeder in the image of the scene;
selecting, based on the size of the subfeeder in the image of the scene, an updated position of the camera relative to the subfeeder;
generating a signal configured to cause a winch controller to move the camera to the updated position; and
providing the signal to the winch controller.
17. The one or more non-transitory computer-readable storage medium of claim 16 , wherein selecting, based on the size of the subfeeder in the image of the scene, the updated position of the camera comprises:
dynamically selecting the updated position of the camera relative to the subfeeder.
18. The one or more non-transitory computer-readable storage medium of claim 16 , wherein the updated position comprises a preferred position of the camera relative to the subfeeder associated with the spatial model of the subfeeder.
19. The one or more non-transitory computer-readable storage medium of claim 16 , wherein selecting, based on the size of the subfeeder in the image of the scene, the updated position of the camera relative to the subfeeder, comprises:
determining a depth of the subfeeder that characterizes a distance of the camera that obtained the image of the scene from the subfeeder;
determining, based on the depth of the subfeeder, a current position of the camera relative to the subfeeder; and
selecting, based on the current position of the camera relative to the subfeeder, the updated position of the camera relative to the subfeeder.
20. The one or more non-transitory computer-readable storage medium of claim 19 , wherein determining the depth of the subfeeder that characterizes the distance of the camera that obtained the image of the scene from the subfeeder comprises:
determining a number of pixels in the image of the scene that depict the subfeeder.