IP Library Granted Patent US 12,254,712
Granted Patent B2
US 12,254,712 · App. 17/716,797 · Granted Mar 18, 2025

Monocular underwater camera biomass estimation

Inventors: Julia Black Ling (Redwood City, CA); Laura Valentine Chrobak (Menlo Park, CA)
Assignee: TidaIX AI Inc.
G06V40/10G06T7/62G06Q50/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,712
App. No.
17/716,797
Granted
Mar 18, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for monocular underwater camera biomass estimation. In some implementations, an exemplary method includes obtaining an image of a fish captured by a monocular underwater camera; providing the image of the fish to a depth perception model; obtaining output of the depth perception model indicating a depth-enhanced image of the fish data in the image; determining a biomass value estimate of the fish based on the output; and determining an action based on one or more biomass values estimates including the biomass value estimate of the fish.

Claims (58)

1. A method comprising:

obtaining an image of a fish captured by a monocular underwater camera;

providing the image of the fish to a depth perception model;

generating, by the depth perception model, an output including a depth-enhanced image of the fish;

determining a biomass estimate of the fish based on the output depth-enhanced image of the fish; and

performing an action based on one or more biomass estimates including the biomass estimate of the fish.

2. The method of claim 1 , comprising:

determining, based on the depth-enhanced image of the fish, a data set including a value that indicates a length between a first point on the fish and a second point on the fish.

3. The method of claim 2 , wherein determining the biomass value of the fish comprises:

providing the data set including the value that indicates the length between the first point on the fish and the second point on the fish to a model trained to predict biomass; and

generating, by the model trained to predict biomass, an output including the biomass value of the fish.

4. The method of claim 2 , comprising:

detecting the first point and the second point on the fish.

5. The method of claim 4 , wherein detecting the first and second points comprise:

providing the depth-enhanced image of the fish to a model trained to detect feature points on a fish body.

6. The method of claim 1 , comprising:

detecting the fish within the image using a model trained to detect fish.

7. The method of claim 1 , wherein the action comprises:

adjusting a feeding system providing feed to the fish.

8. The method of claim 1 , wherein the action comprises:

sending data including the biomass estimate to a user device, wherein the data is configured to, when displayed on the user device, present a user of the user device with a visual representation of the biomass estimate.

9. The method of claim 1 , comprising:

obtaining data from the monocular underwater camera indicating a current operation status of the monocular underwater camera; and

in response to obtaining the image of the fish and the data from the monocular underwater camera, providing the image of the fish to the depth perception model.

10. The method of claim 1 , wherein determining the action comprises:

determining to adjust a position or operation of an item of motorized equipment.

11. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

obtaining an image of a fish captured by a monocular underwater camera;

providing the image of the fish to a depth perception model;

generating, by the depth perception model, an output including a depth-enhanced image of the fish;

determining a biomass estimate of the fish based on the output depth-enhanced image of the fish; and

performing an action based on one or more biomass estimates including the biomass estimate of the fish.

12. The non-transitory, computer-readable medium of claim 11 , comprising:

determining, based on the depth-enhanced image of the fish, a data set including a value that indicates a length between a first point on the fish and a second point on the fish.

13. The non-transitory, computer-readable medium of claim 12 , wherein determining the biomass value of the fish comprises:

providing the data set including the value that indicates the length between the first point on the fish and the second point on the fish to a model trained to predict biomass; and

generating, by the model trained to predict biomass, an output including the biomass value of the fish.

14. The non-transitory, computer-readable medium of claim 12 , comprising:

detecting the first point and the second point on the fish.

15. The non-transitory, computer-readable medium of claim 14 , wherein detecting the first and second points comprise:

providing the depth-enhanced image of the fish to a model trained to detect feature points on a fish body.

16. The non-transitory, computer-readable medium of claim 11 , comprising:

detecting the fish within the image using a model trained to detect fish.

17. The non-transitory, computer-readable medium of claim 11 , wherein the action comprises:

adjusting a feeding system providing feed to the fish.

18. The non-transitory, computer-readable medium of claim 11 , wherein the action comprises:

sending data including the biomass estimate to a user device, wherein the data is configured to, when displayed on the user device, present a user of the user device with a visual representation of the biomass estimate.

19. The non-transitory, computer-readable medium of claim 11 , comprising:

obtaining data from the monocular underwater camera indicating a current operation status of the monocular underwater camera; and

in response to obtaining the image of the fish and the data from the monocular underwater camera, providing the image of the fish to the depth perception model.

20. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising:

obtaining an image of a fish captured by a monocular underwater camera;

providing the image of the fish to a depth perception model;

generating, by of the depth perception model, an output including a depth-enhanced image of the fish;

determining a biomass estimate of the fish based on the output depth-enhanced image of the fish; and

performing an action based on one or more biomass estimates including the biomass estimate of the fish.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2022
From: LING, JULIA BLACK; CHROBAK, LAURA VALENTINE
To: X DEVELOPMENT LLC
Reel/Frame 060094/0744 →
Continuity (1)
Related Publication 20230326226A1 · Oct 12, 2023
References Cited (31)
US 10191489B1 · Rapoport · 2019 [cited by examiner]
US 10856520B1 · Kozachenok · 2020 [cited by examiner]
US 11244191B2 · Yao · 2022 [cited by examiner]
US 20040199275A1 · Berckmans · 2004 [cited by examiner]
US 20060018197A1 · Burczynski · 2006 [cited by examiner]
US 20110196661A1 · Spicola · 2011 [cited by examiner]
US 20130223693A1 · Chamberlain · 2013 [cited by examiner]
US 20180289334A1 · De Brouwer · 2018 [cited by examiner]
US 20180365246A1 · Laster · 2018 [cited by examiner]
US 20190228218A1 · James · 2019 [cited by examiner]
US 20190340440A1 · Atwater · 2019 [cited by examiner]
US 20200113158A1 · Rishi · 2020 [cited by examiner]
US 20200175700A1 · Zhang · 2020 [cited by examiner]
US 20200202542A1 · Takhirov · 2020 [cited by examiner]
US 20200288678A1 · Howe · 2020 [cited by examiner]
US 20200372265A1 · Ko · 2020 [cited by examiner]
US 20210150747A1 · Liu · 2021 [cited by examiner]
US 20210183052A1 · Ikeda · 2021 [cited by examiner]
US 20210192187A1 · Kim · 2021 [cited by examiner]
US 20210319578A1 · Casser · 2021 [cited by examiner]
US 20210321593A1 · Ma · 2021 [cited by examiner]
US 20210368748A1 · Barnaby et al. · 2021 [cited by applicant]
US 20220000079A1 · Ming et al. · 2022 [cited by applicant]
US 20220230310A1 · Xie · 2022 [cited by examiner]
US 20220398704A1 · Sun · 2022 [cited by examiner]
US 20230337636A1 · Shmigelsky · 2023 [cited by examiner]
WO WO2019232247A1 · 2019 [cited by examiner]
WO WO2022010815 · 2022 [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2023/017970, dated Sep. 25, 2023, 18 pages. [cited by applicant]
International Invitation to Pay Additional Fees in International Appln. No. PCT/US2023/017970, dated Aug. 2, 2023, 13 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2023/017970, dated Oct. 8, 2024, 11 pages. [cited by applicant]