IP Library Granted Patent US 11,825,816
Granted Patent B2
US 11,825,816 · App. 17/675,430 · Granted Nov 28, 2023

Camera controller for aquaculture behavior observation

Inventors: Zhaoying Yao (Palo Alto, CA); Tatiana Kichkaylo (Woodinville, WA); Barnaby John James (Campbell, CA)
Assignee: X Development LLC
A01K61/80A01K29/005H04N23/61H04N23/695
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,825,816
App. No.
17/675,430
Granted
Nov 28, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for controlling a camera to observe aquaculture feeding behavior. In some implementations, a method includes moving a camera to a first position, obtaining an image captured by the camera at the first position, determining a feeding observation mode, and based on the feeding observation mode and analysis of the image, determining a second position to move the camera.

Claims (58)

1. A method comprising:

moving a camera to a first depth underwater in an enclosure that encloses aquatic livestock;

obtaining a first image captured by the camera at the first depth underwater;

determining that, in the first image, feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image;

in response to determining that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image, moving the camera to a second depth underwater that is below the first depth underwater; and

obtaining a second image captured by the camera at the second depth underwater.

2. The method of claim 1 , comprising:

determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater, reducing a rate that the feed is provided to the aquatic livestock during a current feeding session.

3. The method of claim 1 , comprising:

determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater, increasing a rate that the feed is provided to the aquatic livestock in a current feeding session.

4. The method of claim 3 , comprising:

based on increasing the rate that the feed is provided to the aquatic livestock, moving the camera to a third depth underwater that is below the second depth underwater.

5. The method of claim 1 , comprising:

determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater, moving the camera to a third depth underwater that is above the second depth underwater.

6. The method of claim 1 , comprising:

moving the camera horizontally until the feed is detected in a third image from the camera,

wherein moving the camera to the first depth underwater is based on a detection of the feed in the third image.

7. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

moving a camera to a first depth underwater in an enclosure that encloses aquatic livestock;

obtaining a first image captured by the camera at the first depth underwater;

determining that, in the first image, feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image;

in response to determining that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image, moving the camera to a second depth underwater that is below the first depth underwater; and

obtaining a second image captured by the camera at the second depth underwater.

8. The system of claim 7 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater, reducing a rate that the feed is provided to the aquatic livestock during a current feeding session.

9. The system of claim 7 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater, increasing a rate that the feed is provided to the aquatic livestock in a current feeding session.

10. The system of claim 9 , the operations comprising:

based on increasing the rate that the feed is provided to the aquatic livestock, moving the camera to a third depth underwater that is below the second depth underwater.

11. The system of claim 7 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater, moving the camera to a third depth underwater that is above the second depth underwater.

12. The system of claim 7 , the operations comprising:

moving the camera horizontally until the feed is detected in a third image from the camera,

wherein moving the camera to the first depth underwater is based on a detection of the feed in the third image.

13. A computer-readable storage device encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

moving a camera to a first depth underwater in an enclosure that encloses aquatic livestock;

obtaining a first image captured by the camera at the first depth underwater;

determining that, in the first image, feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image;

in response to determining that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image, moving the camera to a second depth underwater that is below the first depth underwater; and

obtaining a second image captured by the camera at the second depth underwater.

14. The device of claim 13 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock that is sinking through the field of view of the camera and that has not yet reached a bottom of the enclosure appears in a lower portion of the image at the second depth underwater, reducing a rate that the feed is provided to the aquatic livestock during a current feeding session.

15. The device of claim 13 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not sinking below the second depth underwater and is being consumed by the aquatic livestock at the second depth underwater, increasing a rate that the feed is provided to the aquatic livestock in a current feeding session.

16. The device of claim 15 , the operations comprising:

based on increasing the rate that the feed is provided to the aquatic livestock, moving the camera to a third depth underwater that is below the second depth underwater.

17. The device of claim 13 , the operations comprising:

determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater; and

based on determining, from the second image, that the feed for the aquatic livestock is not visible at the second depth underwater, moving the camera to a third depth underwater that is above the second depth underwater.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: YAO, ZHAOYING; KICHKAYLO, TATIANA; JAMES, BARNABY JOHN
To: X DEVELOPMENT LLC
Reel/Frame 059065/0238 →
Continuity (2)
Continuation 16880349 · May 21, 2020
Related Publication 20220167596A1 · Jun 2, 2022