IP Library Granted Patent US 11,367,209
Granted Patent B2
US 11,367,209 · App. 17/078,490 · Granted Jun 21, 2022

Visual detection of haloclines

Inventor: Barnaby John James (Los Gatos, CA)
Assignee: X Development LLC
G06T7/571A01K29/00A01K61/13G06V40/10H04N7/18G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,367,209
App. No.
17/078,490
Granted
Jun 21, 2022
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for visually detecting a halocline. In some implementations, a method includes moving a camera through different depths of water within a fish enclosure, capturing, at the different depths, images of fish, determining that changes in focus in the images correspond to changes in depth that the images were captured, and based on determining that the changes in focus in the images correspond to the changes in depths that the images were captured, detecting a halocline at a particular depth.

Claims (63)

1. A method comprising:

moving a camera through different depths of water within a fish enclosure;

capturing, at the different depths, images of the fish;

determining, in each of the images of the fish that are captured at the different depths, a quantity of pixels that are out-of-focus in the image and a quantity of pixels that are in-focus in the image;

determining that, in one or more images of the fish that are associated with a particular depth, a proportion of the pixels that are out-of-focus or that are in-focus in the one or more image that are associated with the particular depth is different, by more than a threshold, than a proportion of pixels that are out-of-focus or that are in-focus, respectively, in one or more other images that are associated with a depth that is adjacent to the particular depth; and

based on determining that the proportion of pixels that is associated with the particular depth is different, by more than the threshold, than the proportion of pixels that are associated with the depth that is adjacent to the particular depth, detecting a halocline at the particular depth.

2. The method of claim 1 , wherein

the adjacent depth is above the particular depth.

3. The method of claim 2 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a top at the particular depth.

4. The method of claim 1 , wherein

the adjacent depth is below the particular depth.

5. The method of claim 4 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a bottom at the particular depth.

6. The method of claim 1 , comprising:

determining that a number of fish detected in a particular image satisfies a count criteria, wherein the quantity of pixels is determined based on determining that the number of fish satisfies a count criteria.

7. The method of claim 1 , comprising one or more of:

adjusting one or more of a feed depth that the fish are fed or a feed rate that the fish are fed based on detection of the halocline at the particular depth;

increasing sea lice mitigation based on detection of the halocline at the particular depth; or

disregarding one or more of sea lice detection or fish detection based on detection of the halocline at the particular depth.

8. The method of claim 1 , comprising:

providing a depth map that indicates a top of the halocline and a bottom of the halocline.

9. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

moving a camera through different depths of water within a fish enclosure;

capturing, at the different depths, images of the fish;

determining, in each of the images of the fish that are captured at the different depths, a quantity of pixels that are out-of-focus in the image and a quantity of pixels that are in-focus in the image;

determining that, in one or more images of the fish that are associated with a particular depth, a proportion of the pixels that are out-of-focus or that are in-focus in the one or more image that are associated with the particular depth is different, by more than a threshold, than a proportion of pixels that are out-of-focus or that are in-focus, respectively, in one or more other images that are associated with a depth that is adjacent to the particular depth; and

based on determining that the proportion of pixels that is associated with the particular depth is different, by more than the threshold, than the proportion of pixels that are associated with the depth that is adjacent to the particular depth, detecting a halocline at the particular depth.

10. The system of claim 9 , wherein

the adjacent depth is above the particular depth.

11. The system of claim 10 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a top at the particular depth.

12. The system of claim 9 , wherein

the adjacent depth is below the particular depth.

13. The system of claim 12 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a bottom at the particular depth.

14. The system of claim 9 , wherein the operations comprise:

determining that a number of fish detected in a particular image satisfies a count criteria, wherein the quantity of pixels is determined based on determining that the number of fish satisfies a count criteria.

15. The system of claim 9 , the operations comprising one or more of:

adjusting one or more of a feed depth that the fish are fed or a feed rate that the fish are fed based on detection of the halocline at the particular depth;

increasing sea lice mitigation based on detection of the halocline at the particular depth; or

disregarding one or more of sea lice detection or fish detection based on detection of the halocline at the particular depth.

16. A computer-readable storage device encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

moving a camera through different depths of water within a fish enclosure;

capturing, at the different depths, images of the fish;

determining, in each of the images of the fish that are captured at the different depths, a quantity of pixels that are out-of-focus in the image and a quantity of pixels that are in-focus in the image;

determining that, in one or more images of the fish that are associated with a particular depth, a proportion of the pixels that are out-of-focus or that are in-focus in the one or more image that are associated with the particular depth is different, by more than a threshold, than a proportion of pixels that are out-of-focus or that are in-focus, respectively, in one or more other images that are associated with a depth that is adjacent to the particular depth; and

based on determining that the proportion of pixels that is associated with the particular depth is different, by more than the threshold, than the proportion of pixels that are associated with the depth that is adjacent to the particular depth, detecting a halocline at the particular depth.

17. The computer-readable storage device of claim 16 , wherein the adjacent depth is above the particular depth.

18. The computer-readable storage device of claim 17 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a top at the particular depth.

19. The computer-readable storage device of claim 16 , wherein the adjacent depth is below the particular depth.

20. The computer-readable storage device of claim 19 , wherein detecting the halocline at the particular depth comprises:

determining that the halocline has a bottom at the particular depth.

21. The computer-readable storage device of claim 16 , wherein the operations comprise:

determining that a number of fish detected in a particular image satisfies a count criteria, wherein the quantity of pixels is determined based on determining that the number of fish satisfies a count criteria.

22. The computer-readable storage device of claim 16 , comprising one or more of:

adjusting one or more of a feed depth that the fish are fed or a feed rate that the fish are fed based on detection of the halocline at the particular depth;

increasing sea lice mitigation based on detection of the halocline at the particular depth; or

disregarding one or more of sea lice detection or fish detection based on detection of the halocline at the particular depth.

23. The computer-readable storage device of claim 16 , comprising:

providing a depth map that indicates a top of the halocline and a bottom of the halocline.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2020
From: JAMES, BARNABY JOHN
To: X DEVELOPMENT LLC
Reel/Frame 054149/0618 →
Cited By (1)
US 12,277,722