IP Library Granted Patent US 11,266,128
Granted Patent B2
US 11,266,128 · App. 16/880,349 · Granted Mar 8, 2022

Camera controller for aquaculture behavior observation

Inventors: Zhaoying Yao (Palo Alto, CA); Tatiana Kichkaylo (Mountain View, CA); Barnaby John James (Los Gatos, CA)
Assignee: X Development LLC
A01K61/80A01K29/005H04N5/23218H04N5/23299
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,266,128
App. No.
16/880,349
Granted
Mar 8, 2022
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for controlling a camera to observe aquaculture feeding behavior. In some implementations, a method includes moving a camera to a first position, obtaining an image captured by the camera at the first position, determining a feeding observation mode, and based on the feeding observation mode and analysis of the image, determining a second position to move the camera.

Claims (61)

1. A method comprising:

moving a camera to a first position;

obtaining one or more images captured by the camera at the first position;

determining, from the one or more images, a first value representing a speed of one or more fish within an enclosure;

determining, from the one or more images, a second value representing a number of open mouths of fish;

determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding; and

determining a second position within the enclosure to move the camera based on determining that the one or more fish are likely feeding.

2. The method of claim 1 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining from the one or more images that at a location two or more of:

a density of fish satisfies a density criteria;

a horizontal swimming speed of fish satisfies a speed criteria;

a number of fish swimming vertical satisfies a vertical criteria;

a number of open mouths of fish satisfies a mouth criteria; or

a number of feed satisfies a feed criteria.

3. The method of claim 2 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining that an average horizontal swimming speeds of the fish shown in the one or more images satisfies the speed criteria, wherein the speed criteria correlates with feeding.

4. The method of claim 1 , comprising:

obtaining a second image captured by the camera at the second position;

determining, from the second image, that a number of fish swimming vertical satisfies a vertical criteria; and

determining a third position within the enclosure to move the camera.

5. A computer-readable storage device encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

moving a camera to a first position;

obtaining one or more images captured by the camera at the first position;

determining, from the one or more images, a first value representing a speed of one or more fish within an enclosure;

determining, from the one or more images, a second value representing a number of open mouths of fish;

determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding; and

determining a second position within the enclosure to move the camera based on determining that the one or more fish are likely feeding.

6. The device of claim 5 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining from the one or more images that at a location one or more of:

a density of fish satisfies a density criteria;

a horizontal swimming speed of fish satisfies a speed criteria;

a number of fish swimming vertical satisfies a vertical criteria;

a number of open mouths of fish satisfies a mouth criteria; or

a number of feed satisfies a feed criteria.

7. The device of claim 6 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining that an average horizontal swimming speeds of the fish shown in the one or more images satisfies the speed criteria, wherein the speed criteria correlates with feeding.

8. The device of claim 5 , the operations comprising:

obtaining a second image captured by the camera at the second position;

determining, from the second image, that a number of fish swimming vertical satisfies a vertical criteria; and

determining a third position within the enclosure to move the camera.

9. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

moving a camera to a first position;

obtaining one or more images captured by the camera at the first position;

determining, from the one or more images, a first value representing a speed of one or more fish within an enclosure;

determining, from the one or more images, a second value representing a number of open mouths of fish;

determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding; and

determining a second position within the enclosure to move the camera based on determining that the one or more fish are likely feeding.

10. The system of claim 9 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining from the one or more images that at a location two or more of:

a density of fish satisfies a density criteria;

a horizontal swimming speed of fish satisfies a speed criteria;

a number of fish swimming vertical satisfies a vertical criteria;

a number of open mouths of fish satisfies a mouth criteria; or

a number of feed satisfies a feed criteria.

11. The system of claim 10 , wherein determining, based on the first value representing the speed of the one or more fish within the enclosure and the second value representing the number of open mouths of fish, that the one or more fish are likely feeding comprises:

determining that an average horizontal swimming speeds of the fish shown in the one or more images satisfies the speed criteria, wherein the speed criteria correlates with feeding.

12. The system of claim 9 , the operations comprising:

obtaining a second image captured by the camera at the second position;

determining, from the second image, that a number of fish swimming vertical satisfies a vertical criteria; and

determining a third position within the enclosure to move the camera.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2020
From: YAO, ZHAOYING; KICHKAYLO, TATIANA; JAMES, BARNABY JOHN
To: X DEVELOPMENT LLC
Reel/Frame 052808/0701 →
Continuity (1)
Related Publication 20210360906A1 · Nov 25, 2021
Cited By (2)
US 12,193,418 US 12,336,514