IP Library Granted Patent US 12,190,592
Granted Patent B2
US 12,190,592 · App. 18/315,408 · Granted Jan 7, 2025

Fish measurement station keeping

Inventors: Joel Fraser Atwater (Danville, CA); Barnaby John James (Campbell, CA); Matthew William Messana (Sunnyvale, CA)
Assignee: TidalX AI Inc.
G06V20/52A01K61/10A01K61/95G06T7/20H04N23/667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,592
App. No.
18/315,408
Granted
Jan 7, 2025
Kind
B2
Abstract

A fish monitoring system deployed in a particular area to obtain fish images is described. Neural networks and machine-learning techniques may be implemented to periodically train fish monitoring systems and generate monitoring modes to capture high quality images of fish based on the conditions in the determined area. The camera systems may be configured according to the settings, e.g., positions, viewing angles, specified by the monitoring modes when conditions matching the monitoring modes are detected. Each monitoring mode may be associated with one or more fish activities, such as sleeping, eating, swimming alone, and one or more parameters, such as time, location, and fish type.

Claims (33)

1. A computer-implemented method comprising:

receiving information indicative of a particular type of fish activity, selected from among multiple types of fish activity, for which pictures are to be obtained;

providing information indicative of the particular type of fish activity, selected from among the multiple types of fish activity, to a machine-learning model that is trained to output, for a given type of fish activity and a set of one or more input parameters, a set of output parameters for obtaining pictures of fish engaging in the given fish activity within a fish pen;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

2. The method of claim 1 , wherein the input parameters include a fish type, a location within the fish pen, a water current within the fish pen, or a light level within the fish pen.

3. The method of claim 1 , wherein the particular set of output parameters identifies a subset of the underwater cameras that are to be used to generate the images of the fish.

4. The method of claim 1 , wherein the particular set of output parameters identifies one or more camera angles associated with the underwater cameras that are to be used to generate the images of the fish.

5. The method of claim 1 , wherein the output parameters identifies one or more of location, area topology, timing, lighting, depth, salinity, current, or temperature, associated with the particular type of fish activity within the fish pen.

6. The method of claim 1 , wherein the particular set of output of output parameters specifies a particular mode of the one or more underwater cameras, selected from among multiple modes that are pre-associated with the one or more underwater cameras.

7. The method of claim 1 , wherein configuring the one or more underwater cameras comprises adjusting a location or an orientation of one or more of the underwater cameras within the fish pen.

8. The method of claim 1 , wherein the multiple types of fish activity include sleeping, feeding, swimming separately from a school, or moving according to a particular movement pattern.

9. The method of claim 1 , wherein the information indicative of the particular type of fish activity is selected from among the multiple types of fish activity via a user-input.

10. A system comprising:

one or more computing devices and one or more storage devices that store instructions which, when executed by the one or more computing devices, cause the one or more computing devices to perform operations comprising:

receiving information indicative of a particular type of fish activity, selected from among multiple types of fish activity, for which pictures are to be obtained;

providing information indicative of a of the particular type of fish activity, selected from among the multiple types of fish activity, to a machine-learning model that is trained to output, for a given type of fish activity and a set of one or more input parameters, a set of output parameters for obtaining pictures of fish engaging in the given fish activity within a fish pen;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

11. The system of claim 10 , wherein the input parameters include a fish type, a location within the fish pen, a water current within the fish pen, or a light level within the fish pen.

12. The system of claim 10 , wherein the particular set of output parameters identifies a subset of the underwater cameras that are to be used to generate the images of the fish.

13. The system of claim 10 , wherein the particular set of output parameters identifies one or more camera angles associated with the underwater cameras that are to be used to generate the images of the fish.

14. The system of claim 10 , wherein the output parameters identifies one or more of location, area topology, timing, lighting, depth, salinity, current, or temperature, associated with the particular type of fish activity within the fish pen.

15. The system of claim 10 , wherein the particular set of output of output parameters specifies a particular mode of the one or more underwater cameras, selected from among multiple modes that are pre-associated with the one or more underwater cameras.

16. The system of claim 10 , wherein configuring the one or more underwater cameras comprises adjusting a location or an orientation of one or more of the underwater cameras within the fish pen.

17. The system of claim 10 , wherein the multiple types of fish activity include sleeping, feeding, swimming separately from a school, or moving according to a particular movement pattern.

18. The system of claim 10 , wherein the information indicative of the particular type of fish activity is selected from among the multiple types of fish activity via a user-input.

19. One or more non-transitory computer-readable storage media comprising instructions, which, when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising:

receiving information indicative of a particular type of fish activity, selected from among multiple types of fish activity, for which pictures are to be obtained;

providing information indicative of the particular type of fish activity, selected from among the multiple types of fish activity, to a machine-learning model that is trained to output, for a given type of fish activity and a set of one or more input parameters, a set of output parameters for obtaining pictures of fish engaging in the given fish activity within a fish pen;

obtaining, from the model, a particular set of output parameters; and

configuring one or more underwater cameras based on the particular set of output parameters.

20. The storage media of claim 19 , wherein configuring the one or more underwater cameras comprises adjusting a location or an orientation of one or more of the underwater cameras within the fish pen.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: ATWATER, JOEL FRASER; JAMES, BARNABY JOHN; MESSANA, MATTHEW
To: X DEVELOPMENT LLC
Reel/Frame 063607/0123 →
Continuity (4)
Continuation 17391392 · Aug 2, 2021
Continuation 16701853 · Dec 3, 2019
Continuation 15970131 · May 3, 2018
Related Publication 20230368538A1 · Nov 16, 2023
References Cited (84)
US 9541645B2 · Yamaguchi · 2017 [cited by applicant]
US 9817120B2 · Ferretti · 2017 [cited by applicant]
US 9992987B2 · Bailey · 2018 [cited by applicant]
US 10856520B1 · Kozachenok et al. · 2020 [cited by applicant]
US 11113539B2 · Atwater et al. · 2021 [cited by applicant]
US 20060018197A1 · Burczynski et al. · 2006 [cited by applicant]
US 20100198023A1 · Yanai et al. · 2010 [cited by applicant]
US 20150302241A1 · Eineren et al. · 2015 [cited by applicant]
US 20150313199A1 · Castaneda et al. · 2015 [cited by applicant]
US 20160249036A1 · Son · 2016 [cited by applicant]
US 20170150701A1 · Gilmore et al. · 2017 [cited by applicant]
US 20180132459A1 · Baba et al. · 2018 [cited by applicant]
US 20180303073A1 · Jans · 2018 [cited by applicant]
US 20190228218A1 · Barnaby et al. · 2019 [cited by applicant]
US 20200077629A1 · Tanaka · 2020 [cited by applicant]
US 20200107524A1 · Messana et al. · 2020 [cited by applicant]
US 20200155882A1 · Tohidi et al. · 2020 [cited by applicant]
US 20200288678A1 · Howe et al. · 2020 [cited by applicant]
US 20200337274A1 · Howe · 2020 [cited by applicant]
US 20210374427A1 · Atwater et al. · 2021 [cited by applicant]
CL 2019000039A1 · 2019 [cited by applicant]
CN 102297865B · 2013 [cited by applicant]
CN 104113739 · 2014 [cited by applicant]
CN 204229274U · 2015 [cited by applicant]
CN 105719424A · 2016 [cited by applicant]
CN 107135988A · 2017 [cited by applicant]
CN 107423745A · 2017 [cited by examiner]
CN 108040948 · 2018 [cited by applicant]
CN 207870096 · 2018 [cited by examiner]
EP 2244934 · 2010 [cited by applicant]
EP 3484283 · 2019 [cited by applicant]
JP 1997251192 · 1997 [cited by applicant]
JP 2002171853 · 2002 [cited by applicant]
JP 2017181766 · 2017 [cited by applicant]
JP 2017181766A · 2017 [cited by examiner]
NO 300401 · 1997 [cited by applicant]
NO 20160199 · 2017 [cited by applicant]
NO 345829 · 2019 [cited by applicant]
WO WO1990007874 · 1990 [cited by applicant]
WO WO1997019587 · 1997 [cited by applicant]
WO WO2009008733 · 2009 [cited by applicant]
WO WO2009067025 · 2009 [cited by applicant]
WO WO2009097057 · 2009 [cited by applicant]
WO WO2012081990 · 2012 [cited by applicant]
WO WO2014098614 · 2014 [cited by applicant]
WO WO2014179482 · 2014 [cited by applicant]
WO WO2016023071 · 2016 [cited by applicant]
WO WO2017137896 · 2017 [cited by applicant]
WO WO2018011744 · 2018 [cited by applicant]
WO WO2018011745 · 2018 [cited by applicant]
WO WO2019002881 · 2019 [cited by applicant]
WO WO2019121851 · 2019 [cited by applicant]
WO WO2019188506 · 2019 [cited by applicant]
WO WO2019232247 · 2019 [cited by applicant]
WO WO2020046524 · 2020 [cited by applicant]
WO WO2020072438 · 2020 [cited by applicant]
WO WO2020132031 · 2020 [cited by applicant]
WO WO2021006744 · 2021 [cited by applicant]
WO WO2021030237 · 2021 [cited by applicant]
WO WO2022010815 · 2022 [cited by applicant]
Decision to Grant a Patent in Japanese Appln. No. 2020-531499, dated Jun. 29, 2022, 5 pages (with English translation). [cited by applicant]
Extended Search Report in European Appln. No. 22151132.2, dated May 2, 2022, 10 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln No. PCT/US2020/059829, dated May 27, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022837, dated Aug. 2, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2020/059829, dated Feb. 25, 2021, 18 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/018651, dated Jun. 22, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/021683, dated Jun. 27, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/022250, dated Jul. 6, 2022, 15 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/022492, dated Jun. 28, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/022589, dated Jul. 7, 2022, 12 pages. [cited by applicant]
International Search Report and Written Opinion International Appln No. PCT/US2022/023831, dated Jul. 8, 2022, 13 pages. [cited by applicant]
Meidell et al., “FishNet: A Unified Embedding for Salmon Recognition,” Thesis for Master's degree in Artificial Intelligence, Norwegian University of Science and Technology, Jun. 2019, 86 pages. [cited by applicant]
Moskvyak et al., “Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings,” CoRR, Feb. 2019, arXiv:1902.10847v1, 12 pages. [cited by applicant]
Office action Chile Appln. No. 202001744, dated Sep. 27, 2021, 13 pages (with English summary). [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated Mar. 21, 2023, 5 pages. [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated May 19, 2022, 4 pages. [cited by applicant]
Office Action in European Appln. No. 19727154.7, dated Feb. 22, 2023, 8 pages. [cited by applicant]
PCT International Preliminary Report on Patentability in International Appln. No. PCT/US2019/028743, dated Nov. 3, 2020, 8 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2019/028743, dated Jul. 31, 2019, 33 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2021/016387, dated May 3, 2021, 14 pages. [cited by applicant]
Qiu et al., “Improving Transfer Learning and Squeeze-and-Excitation Networks for Small-Scale Fine-Grained Fish Image Classification,” IEEE Access, Dec. 2018, 6(31):78503-78512. [cited by applicant]
Stein et al., “Consistent melanophore spot patterns allow long-term individual recognition of Atlantic salmon Salmo Salar,” Journal of Fish Biology, Nov. 2017, 91(6):1699-1712. [cited by applicant]
Office Action in European Appln. No. 19727154.7, dated Oct. 2, 2023, 7 pages. [cited by applicant]
Office Action in Canadian Appln. No. 3,087,370, dated Jan. 8, 2024, 6 pages. [cited by applicant]