IP Library Granted Patent US 12,223,723
Granted Patent B2
US 12,223,723 · App. 17/391,392 · Granted Feb 11, 2025

Fish measurement station keeping

Inventors: Joel Fraser Atwater (Danville, CA); Barnaby John James (Campbell, CA); Matthew Messana (Sunnyvale, CA)
Assignee: TidalX AI Inc.
G06V20/52A01K61/10A01K61/95G06T7/20H04N23/667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,723
App. No.
17/391,392
Granted
Feb 11, 2025
Kind
B2
Abstract

A fish monitoring system deployed in a particular area to obtain fish images is described. Neural networks and machine-learning techniques may be implemented to periodically train fish monitoring systems and generate monitoring modes to capture high quality images of fish based on the conditions in the determined area. The camera systems may be configured according to the settings, e.g., positions, viewing angles, specified by the monitoring modes when conditions matching the monitoring modes are detected. Each monitoring mode may be associated with one or more fish activities, such as sleeping, eating, swimming alone, and one or more parameters, such as time, location, and fish type.

Claims (33)

1. A computer-implemented method comprising:

determining a current time of day;

providing, to a model that is trained to output a given set of output parameters for obtaining pictures of fish that are contained within a fish pen based in given input parameters, the input parameters including timing data that specifies the determined, current time of day;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

2. The method of claim 1 , wherein the input parameters include a fish type, a fish activity type, a location within the fish pen, a water current within the fish pen, or a light level within the fish pen.

3. The method of claim 1 , wherein the particular set of output parameters identifies a subset of the underwater cameras that are to be used to generate the images of the fish.

4. The method of claim 1 , wherein the particular set of output parameters identifies one or more camera angles associated with the underwater cameras that are to be used to generate the images of the fish.

5. The method of claim 1 , comprising training the model using machine learning.

6. The method of claim 1 , wherein the particular set of output of output parameters specifies a particular mode of the one or more underwater cameras, selected from among multiple modes that are pre-associated with the one or more underwater cameras.

7. The method of claim 1 , wherein configuring the one or more underwater cameras comprises adjusting an orientation of one or more of the underwater cameras with respect to the fish pen.

8. A system comprising:

one or more computing devices and one or more storage devices that store instructions which, when executed by the one or more computing devices, cause the one or more computing devices to perform operations comprising:

determining a current time of day;

providing, to a model that is trained to output a given set of output parameters for obtaining pictures of fish that are contained within a fish pen based in given input parameters, the input parameters including timing data that specifies the determined, current time of day;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

9. The system of claim 8 , wherein the input parameters include a fish type, a fish activity type, a location within the fish pen, a water current within the fish pen, or a light level within the fish pen.

10. The system of claim 8 , wherein the particular set of output parameters identifies a subset of the underwater cameras that are to be used to generate the images of the fish.

11. The system of claim 8 , wherein the particular set of output parameters identifies one or more camera angles associated with the underwater cameras that are to be used to generate the images of the fish.

12. The system of claim 8 , wherein the operations comprise training the model using machine learning.

13. The system of claim 8 , wherein the particular set of output of output parameters specifies a particular mode of the one or more underwater cameras, selected from among multiple modes that are pre-associated with the one or more underwater cameras.

14. The system of claim 8 , wherein configuring the one or more underwater cameras comprises adjusting an orientation of one or more of the underwater cameras with respect to the fish pen.

15. One or more non-transitory computer-readable storage media comprising instructions, which, when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising:

determining a current time of day;

providing, to a model that is trained to output a given set of output parameters for obtaining pictures of fish that are contained within a fish pen based in given input parameters, the input parameters including timing data that specifies the determined, current time of day;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

16. The media of claim 15 , wherein the input parameters include a fish type, a fish activity type, a location within the fish pen, a water current within the fish pen, or a light level within the fish pen.

17. The media of claim 15 , wherein the particular set of output parameters identifies a subset of the underwater cameras that are to be used to generate the images of the fish.

18. The media of claim 15 , wherein the particular set of output parameters identifies one or more camera angles associated with the underwater cameras that are to be used to generate the images of the fish.

19. The media of claim 15 , wherein the operations training the model using machine learning.

20. The media of claim 15 , wherein the particular set of output of output parameters specifies a particular mode of the one or more underwater cameras, selected from among multiple modes that are pre-associated with the one or more underwater cameras.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2021
From: ATWATER, JOEL FRASER; JAMES, BARNABY JOHN; MESSANA, MATTHEW
To: X DEVELOPMENT LLC
Reel/Frame 057054/0880 →
Continuity (3)
Continuation 16701853 · Dec 3, 2019
Continuation 15970131 · May 3, 2018
Related Publication 20210374427A1 · Dec 2, 2021
References Cited (83)
US 6097424A · Zernov · 2000 [cited by examiner]
US 6119630A · Lobsiger · 2000 [cited by examiner]
US 9541645B2 · Yamaguchi · 2017 [cited by applicant]
US 9817120B2 · Ferretti · 2017 [cited by applicant]
US 9992987B2 · Bailey · 2018 [cited by applicant]
US 10856520B1 · Kozachenok et al. · 2020 [cited by applicant]
US 11113539B2 · Atwater · 2021 [cited by examiner]
US 20060018197A1 · Burczynski et al. · 2006 [cited by applicant]
US 20100198023A1 · Yanai et al. · 2010 [cited by applicant]
US 20150302241A1 · Eineren et al. · 2015 [cited by applicant]
US 20150313199A1 · Castaneda et al. · 2015 [cited by applicant]
US 20160249036A1 · Son · 2016 [cited by applicant]
US 20170150701A1 · Gilmore et al. · 2017 [cited by applicant]
US 20180132459A1 · Baba et al. · 2018 [cited by applicant]
US 20180303073A1 · Jans · 2018 [cited by applicant]
US 20190170720A1 · Howard · 2019 [cited by examiner]
US 20190228218A1 · Barnaby et al. · 2019 [cited by applicant]
US 20200107524A1 · Messana et al. · 2020 [cited by applicant]
US 20200155882A1 · Tohidi et al. · 2020 [cited by applicant]
US 20200288678A1 · Howe et al. · 2020 [cited by applicant]
CL 2019000039A1 · 2019 [cited by applicant]
CN 102297865B · 2013 [cited by applicant]
CN 104113739A · 2014 [cited by examiner]
CN 204229274U · 2015 [cited by applicant]
CN 105719424A · 2016 [cited by applicant]
CN 107135988A · 2017 [cited by applicant]
CN 107423745 · 2017 [cited by applicant]
CN 108040948 · 2018 [cited by applicant]
CN 207870096 · 2018 [cited by applicant]
EP 2244934 · 2010 [cited by applicant]
EP 3484283 · 2019 [cited by applicant]
JP 1997251192 · 1997 [cited by applicant]
JP 2002171853 · 2002 [cited by applicant]
JP 2017181766 · 2017 [cited by examiner]
NO 300401 · 1997 [cited by applicant]
NO 20160199 · 2017 [cited by applicant]
NO 345829 · 2019 [cited by applicant]
WO WO1990007874 · 1990 [cited by applicant]
WO WO1997019587 · 1997 [cited by applicant]
WO WO2009008733 · 2009 [cited by applicant]
WO WO2009067025 · 2009 [cited by examiner]
WO WO2009097057 · 2009 [cited by applicant]
WO WO2012081990 · 2012 [cited by applicant]
WO WO2014098614A1 · 2014 [cited by examiner]
WO WO2014179482 · 2014 [cited by applicant]
WO WO2016023071 · 2016 [cited by applicant]
WO WO2017137896 · 2017 [cited by applicant]
WO WO2018011744 · 2018 [cited by applicant]
WO WO2018011745 · 2018 [cited by applicant]
WO WO2019002881 · 2019 [cited by applicant]
WO WO2019121851 · 2019 [cited by applicant]
WO WO2019188506 · 2019 [cited by applicant]
WO WO2019232247 · 2019 [cited by applicant]
WO WO2020046524 · 2020 [cited by applicant]
WO WO2020072438 · 2020 [cited by applicant]
WO WO2020132031 · 2020 [cited by applicant]
WO WO2021006744 · 2021 [cited by applicant]
WO WO2021030237 · 2021 [cited by applicant]
WO WO2022010815 · 2022 [cited by applicant]
Office action Chile Appln. No. 202001744, dated Sep. 27, 2021, 13 pages (with English summary). [cited by applicant]
PCT International Preliminary Report on Patentability in International Appln. No. PCT/US2019/028743, dated Nov. 3, 2020, 8 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2019/028743, dated Jul. 31, 2019, 33 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2021/016387, dated May 3, 2021, 14 pages. [cited by applicant]
Extended Search Report in European Appln. No. 22151132.2, dated May 2, 2022, 10 pages. [cited by applicant]
Decision to Grant a Patent in Japanese Appln. No. 2020-531499, dated Jun. 29, 2022, 5 pages (with English translation). [cited by applicant]
International Search Report and Written Opinion in International AppIn No. PCT/US2022/022837, dated Aug. 2, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/018651, dated Jun. 22, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/021683, dated Jun. 27, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International AppIn No. PCT/US2022/022250, dated Jul. 6, 2022, 15 pages. [cited by applicant]
International Search Report and Written Opinion in International AppIn No. PCT/US2022/022492, dated Jun. 28, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022589, dated Jul. 7, 2022, 12 pages. [cited by applicant]
International Search Report and Written Opinion in International AppIn No. PCT/US2022/023831, dated Jul. 8, 2022, 13 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln No. PCT/US2020/059829, dated May 27, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2020/059829, dated Feb. 25, 2021, 18 pages. [cited by applicant]
Meidell et al., “FishNet: A Unified Embedding for Salmon Recognition,” Thesis for Master's degree in Artificial Intelligence, Norwegian University of Science and Technology, Jun. 2019, 86 pages. [cited by applicant]
Moskvyak et al., “Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings,” CoRR, Feb. 2019, arXiv:1902.10847v1, 12 pages. [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated May 19, 2022, 4 pages. [cited by applicant]
Qiu et al., “Improving Transfer Learning and Squeeze-and-Excitation Networks for Small-Scale Fine-Grained Fish Image Classification,” IEEE ACCESS, Dec. 2018, 6(31):78503-78512. [cited by applicant]
Stein et al., “Consistent melanophore spot patterns allow long-term individual recognition of Atlantic salmon Salmo Salar,” Journal of Fish Biology, Nov. 2017, 91(6):1699-1712. [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated Mar. 21, 2023, 5 pages. [cited by applicant]
Office Action in European Appln. No. 19727154.7, dated Feb. 22, 2023, 8 pages. [cited by applicant]
Office Action in European Appln. No. 19727154.7, dated Oct. 2, 2023, 7 pages. [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated Jan. 8, 2024, 6 pages. [cited by applicant]