IP Library Granted Patent US 12,277,722
Granted Patent B2
US 12,277,722 · App. 17/749,613 · Granted Apr 15, 2025

Visual detection of haloclines

Inventor: Barnaby John James (Campbell, CA)
Assignee: TidalX AI Inc.
G06T7/571A01K29/00A01K61/13G06V40/10H04N7/18G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,722
App. No.
17/749,613
Granted
Apr 15, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for visually detecting a halocline. In some implementations, a method includes moving a camera through different depths of water within a fish enclosure, capturing, at the different depths, images of fish, determining that changes in focus in the images correspond to changes in depth that the images were captured, and based on determining that the changes in focus in the images correspond to the changes in depths that the images were captured, detecting a halocline at a particular depth.

Claims (52)

1. A computer-implemented method comprising:

obtaining, for each of multiple vertical positions in a water column, one or more images that were taken at the vertical position in the water column;

for each of the multiple vertical positions in the water column, determining a respective quantity of in-focus pixels and a respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

for each of the multiple vertical positions in the water column, determining a ratio that is based on the respective quantity of in-focus pixels and the respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

generating, a distribution that correlates the determined ratios with the multiple vertical positions;

determining a vertical position of a cline within the water column based at least on the generated distribution; and

adjusting operation of one or more items of aquaculture equipment based on determining the depth of the cline within the water column.

2. The method of claim 1 , wherein the cline comprises a thermocline.

3. The method of claim 1 , wherein determining a vertical position of the client within the water column comprises determining a particular vertical position in which objects in images taken at the particular vertical position appear blurrier than objects in images taken at vertical positions above or below the particular vertical position.

4. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

deploying deep feeding lights to attract fish below the cline.

5. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

deploying a subfeeder below the cline.

6. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a height of an enclosure below the cline.

7. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

activating delousing equipment near the vertical position of the cline.

8. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a maximum pellet depth for a feeder to occur at or above the vertical position of the cline.

9. The method of claim 1 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a feeding rate of a feeder based on the vertical position of the cline.

10. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that when executed by one or more processors cause the one or more processors to perform operations comprising:

obtaining, for each of multiple vertical positions in a water column, one or more images that were taken at the vertical position in the water column,

for each of the multiple vertical positions in the water column, determining a respective quantity of in-focus pixels and a respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

for each of the multiple vertical positions in the water column, determining a ratio that is based on the respective quantity of in-focus pixels and the respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

generating, a distribution that correlates the determined ratios with the multiple vertical positions;

determining a vertical position of a cline within the water column based at least on the generated distribution; and

adjusting operation of one or more items of aquaculture equipment based on determining the depth of the cline within the water column.

11. The medium of claim 10 , wherein the cline comprises a thermocline.

12. The medium of claim 10 wherein determining a vertical position of the client within the water column comprises determining a particular vertical position in which objects in images taken at the particular vertical position appear blurrier than objects in images taken at vertical positions above or below the particular vertical position.

13. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

deploying deep feeding lights to attract fish below the cline.

14. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

deploying a subfeeder below the cline.

15. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a height of an enclosure below the cline.

16. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

activating delousing equipment near the depth of the cline.

17. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a maximum pellet depth for a feeder to occur at or above the vertical position of the cline.

18. The medium of claim 10 , wherein adjusting the operation of the one or more items of aquaculture equipment comprises:

adjusting a feeding rate of a feeder based on the vertical position of the cline.

19. A system comprising:

one or more computers; and

a computer-readable medium coupled to the one or more computers having instructions stored thereon which, when executed by the one or more computers, cause the one or more computers to perform operations comprising:

obtaining, for each of multiple vertical positions in a water column, one or more images that were taken at the vertical position in the water column different depths of water;

for each of the multiple vertical positions in the water column, determining a respective quantity of in-focus pixels and a respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

for each of the multiple vertical positions in the water column, determining a ratio that is based on the respective quantity of in-focus pixels and the respective quantity of out-of-focus pixels for each of the one or more images that were taken at the vertical position in the water column;

generating, determining, based on analyzing the images that were taken at the different depths of water, a distribution that correlates the determined ratios with the multiple vertical positions of out of focus pixels across the images as a function of the depths at which the images were taken;

determining a vertical position of a cline within the water column based at least on the generated distribution corresponding to a depth at which one or more of the images were taken within the water; and

adjusting operation of one or more items of aquaculture equipment based on determining the depth of the cline within the water column.

20. The system of claim 19 , wherein the cline comprises a thermocline.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2022
From: JAMES, BARNABY JOHN
To: X DEVELOPMENT LLC
Reel/Frame 060055/0451 →
Continuity (2)
Continuation 17078490 · Oct 23, 2020
Related Publication 20220284612A1 · Sep 8, 2022
References Cited (81)
US 9489601B2 · Fairfield · 2016 [cited by examiner]
US 10852201B2 · Laycock · 2020 [cited by examiner]
US 10898999B1 · Cohen · 2021 [cited by examiner]
US 11089227B1 · James · 2021 [cited by examiner]
US 11089762B1 · Kozachenok · 2021 [cited by examiner]
US 11151737B1 · Li · 2021 [cited by examiner]
US 11367209B2 · James · 2022 [cited by examiner]
US 20090126254A1 · Yamazaki · 2009 [cited by examiner]
US 20130174792A1 · Delabbio · 2013 [cited by examiner]
US 20180275660A1 · Richardson, Jr. · 2018 [cited by examiner]
US 20190168850A1 · Tian · 2019 [cited by examiner]
US 20190340440A1 · Atwater · 2019 [cited by examiner]
US 20200288678A1 · Howe et al. · 2020 [cited by applicant]
US 20210016580A1 · Kaneko · 2021 [cited by examiner]
US 20210039757A1 · Becher · 2021 [cited by examiner]
US 20210142052A1 · James · 2021 [cited by examiner]
US 20210209351A1 · Young · 2021 [cited by examiner]
US 20210329891A1 · Kozachenok · 2021 [cited by examiner]
US 20210329892A1 · Kozachenok · 2021 [cited by examiner]
US 20220043112A1 · Stokes · 2022 [cited by examiner]
US 20220284612A1 · James · 2022 [cited by examiner]
CL 2019000039 · 2019 [cited by applicant]
CN 102687687A · 2012 [cited by examiner]
CN 103314904A · 2013 [cited by examiner]
CN 103392641A · 2013 [cited by examiner]
CN 103548721A · 2014 [cited by examiner]
CN 103636543A · 2014 [cited by examiner]
CN 103636546A · 2014 [cited by examiner]
CN 103843700A · 2014 [cited by examiner]
CN 103843702A · 2014 [cited by examiner]
CN 103843976A · 2014 [cited by examiner]
CN 103875566A · 2014 [cited by examiner]
CN 104106480A · 2014 [cited by examiner]
CN 104568846A · 2015 [cited by examiner]
CN 205664857U · 2016 [cited by examiner]
CN 104568846 · 2017 [cited by applicant]
CN 109657392A · 2019 [cited by examiner]
CN 109781768 · 2019 [cited by applicant]
CN 110763207 · 2020 [cited by applicant]
CN 110763207A · 2020 [cited by examiner]
CN 111301646 · 2020 [cited by applicant]
CN 111301646A · 2020 [cited by examiner]
CN 111357693 · 2020 [cited by applicant]
CN 111357693A · 2020 [cited by examiner]
CN 111487224 · 2020 [cited by applicant]
CN 111640139 · 2020 [cited by applicant]
CN 111640139A · 2020 [cited by examiner]
CN 111487224B · 2020 [cited by examiner]
CN 111838044A · 2020 [cited by examiner]
CN 112180435 · 2021 [cited by applicant]
CN 112180435A · 2021 [cited by examiner]
CN 212430618U · 2021 [cited by examiner]
JP 1997197043 · 1997 [cited by applicant]
JP 2018108550 · 2018 [cited by applicant]
JP 2018108550A · 2018 [cited by examiner]
JP 2019138834 · 2019 [cited by applicant]
JP 2021041338A · 2021 [cited by examiner]
KR 20210128088A · 2020 [cited by examiner]
KR 2020070623A · 2020 [cited by examiner]
NO 20160199 · 2017 [cited by applicant]
WO WO2012081990 · 2012 [cited by applicant]
WO WO2017098223 · 2017 [cited by applicant]
WO WO2017098223A1 · 2017 [cited by examiner]
WO WO2017137896 · 2017 [cited by applicant]
WO WO2018011745 · 2018 [cited by applicant]
WO WO2019180788 · 2019 [cited by applicant]
WO WO2019180788A1 · 2019 [cited by examiner]
Crosbie et al., “Effects of step salinity gradients on salmon lice larvae behavior and dispersal,” Aquaculture Environment Interactions, May 2019, 11:181-190. [cited by applicant]
Crosbie et al., “Impact of thermoclines on the vertical distribution of salmon lice larvae,” Aquaculture Environment Interactions, Jan. 2019, 12:1-10. [cited by applicant]
Dempster et al. “Submergence of Atlantic salmon ( [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2021/055022, Jan. 11, 2022, 15 pages. [cited by applicant]
Maloy et al., “A spatio-temporal recurrent network for salmon feeding action recognition from underwater videos in aquaculture,” Computers and Electronics in Agriculture, Nov. 12, 2019, 9 pages. [cited by applicant]
Odey, “AquaMesh—Design and Implementation of Smart Wireless Mesh Sensor Networks for Aquaculture,” American Journal of Networks and Communications, Jul. 2013, 8 pages. [cited by applicant]
Petrov et al., “Overview of the application of computer vision technology in fish farming,” E3S Web of Conferences, 2020, 175:02015. [cited by applicant]
Saberloon et al., “Application of Machine Vision Systems in Aquaculture with Emphasis on Fish: State-of-the-Art and Key Issues,” Reviews in Aquaculture, Dec. 2017, 9:369-387. [cited by applicant]
towardsdatascience.com [online], “Analyzing Applications of Deep Learning in Aquaculture,” Jan. 2021, retrieved on Aug. 11, 2021, retrieved from URL<https://towardsdatascience.com/analyzing-applications-of-deep-learning… [cited by applicant]
Wang, “Robust tracking of fish schools using CNN for head identification,” Multimedia Tools and Applications, Nov. 2017, 20 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2021/055022, May 4, 2023, 10 pages. [cited by applicant]
Decision to Grant Patent in Japanese Appln. No. 2023-521071, datd May 17, 2024, 5 pages (with English translation). [cited by applicant]
Office Action in Chilean Appln. No. 202301024, dated Aug. 20, 2024, 22 pages (with machine translation). [cited by applicant]
Office Action in Canadian Appln. No. 3,196,590, dated Sep. 6, 2024, 4 pages. [cited by applicant]