IP Library Granted Patent US 12,185,701
Granted Patent B2
US 12,185,701 · App. 18/319,246 · Granted Jan 7, 2025

Self-calibrating ultrasonic removal of ectoparasites from fish

Inventors: Grace Calvert Young (Mountain View, CA); Matthew Aaron Knoll (Mountain View, CA); Bryce Jason Remesch (San Jose, CA); Peter Kimball (Mountain View, CA)
Assignee: TidalX AI Inc.
A01K61/13A01M29/18G01N29/00G06V40/10G01N29/34G01N29/36G01N29/44G06T7/00H04R2217/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,185,701
App. No.
18/319,246
Granted
Jan 7, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for self-calibrating ultrasonic removal of sea lice. In some implementations, a method includes generating, by transducers distributed in a sea lice treatment station, a first set of ultrasonic signals, detecting a second set of ultrasonic signals in response to propagation of the first set of ultrasonic signals through water, determining propagation parameters of the sea lice treatment station based on the second set of ultrasonic signals that were detected, obtaining an image of a sea louse on a fish in the sea lice treatment station, determining, from the image, a location of the sea louse in the sea lice treatment station, and generating a third set of ultrasonic signals that focuses energy at the sea louse.

Claims (62)

1. A computer-implemented method, comprising:

generating, by ultrasonic transducers distributed in a sea lice treatment station, a first set of ultrasonic signals;

detecting, using the ultrasonic transducers, a second set of ultrasonic signals in response to propagation of the first set of ultrasonic signals through water in the sea lice treatment station;

determining propagation parameters of the sea lice treatment station based on the second set of ultrasonic signals that were detected; and

generating a third set of ultrasonic signals that focus energy at a sea louse, wherein the third set of ultrasonic signals are determined based on the propagation parameters.

2. The computer-implemented method of claim 1 , comprising:

determining a location of the sea louse;

determining, using the propagation parameters, an energy limit for the location of the sea louse and

generating the third set of ultrasonic signals based on the propagation parameters that include the energy limit for the location of the sea louse.

3. The method of claim 2 wherein determining, the energy limit for the location of the sea louse, comprises:

determining whether the location of the sea louse is on a particular portion of a fish, where different portions of the fish correspond to different energy limits.

4. The method of claim 1 comprising:

determining that at least one obstruction exists between the ultrasonic transducers and the sea louse; and

in response to determining that at least one obstruction exists between the ultrasonic transducers and the sea louse, altering the propagation parameters.

5. The method of claim 4 , wherein altering the propagation parameters comprises focusing energy of the third set of ultrasonic signals at the sea louse at a reduced power level.

6. The method of claim 1 comprising:

altering the propagation parameters of the ultrasonic signals; and:

generating ultrasonic signals that do not generate a side lobe, where ultrasonic energy is focused at a location.

7. The method of claim 1 comprising:

detecting, using the ultrasonic transducers and the first set of ultrasonic signals, an orientation of a fish; and

generating, by the ultrasonic transducers and using the orientation of the fish, a set of ultrasonic signals that focuses energy at adipose and dorsal fins of the fish.

8. A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

generating, by ultrasonic transducers distributed in a sea lice treatment station, a first set of ultrasonic signals;

detecting, using the ultrasonic transducers, a second set of ultrasonic signals in response to propagation of the first set of ultrasonic signals through water in the sea lice treatment station;

determining propagation parameters of the sea lice treatment station based on the second set of ultrasonic signals that were detected; and

generating a third set of ultrasonic signals that focus energy at the sea a sea louse, wherein the third set of ultrasonic signals are determined based on the propagation parameters.

9. The system of claim 8 , the operations comprising:

determining a location of the sea louse;

determining, using stored propagation parameters, an energy limit for the location of the sea louse; and

generating the third set of ultrasonic signals based on the propagation parameters that include the energy limit for the location of the sea louse.

10. The system of claim 9 wherein determining, using stored propagation parameters, an energy limit for the location of the sea louse, comprises:

determining whether the location of the sea louse is on a particular portion of a fish, where different portions of the fish have different energy limits.

11. The system of claim 8 , the operations comprising:

determining whether obstructions exist between the ultrasonic transducers and the sea louse; and

in response to determining whether obstructions exist between the ultrasonic transducers and the sea louse, altering the propagation parameters, so that a set of ultrasonic signals focuses energy at the sea louse.

12. The system of claim 11 , the operations comprising:

in response to determining whether obstructions exist between the ultrasonic transducers and the sea louse, altering the propagation parameters, so that the set of ultrasonic signals focuses energy at the sea louse at a reduced power level.

13. The system of claim 8 , the operations comprising:

altering the propagation parameters of the ultrasonic signals; and:

generating ultrasonic signals that do not generate a side lobe, where ultrasonic energy is focused at a location.

14. The system of claim 8 , the operations comprising:

detecting, using the ultrasonic transducers and the first set of ultrasonic signals, an orientation of a fish; and

generating, by the ultrasonic transducers and using the orientation of the fish, a set of ultrasonic signals that focuses energy at adipose and dorsal fins of the fish.

15. One or more non-transitory computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

generating, by ultrasonic transducers distributed in a sea lice treatment station, a first set of ultrasonic signals;

detecting, using the ultrasonic transducers, a second set of ultrasonic signals in response to propagation of the first set of ultrasonic signals through water in the sea lice treatment station;

determining propagation parameters of the sea lice treatment station based on the second set of ultrasonic signals that were detected; and

generating a third set of ultrasonic signals that focus energy at a sea louse, wherein the third set of ultrasonic signals are determined based on the propagation parameters.

16. The computer storage media of claim 15 , the operations comprising:

determining a location of the sea louse;

determining, using stored propagation parameters, an energy limit for the location of the sea louse; and

generating the third set of ultrasonic signals based on the propagation parameters that include the energy limit for the location of the sea louse.

17. The computer storage media of claim 16 , wherein determining, using stored propagation parameters, an energy limit for the location of the sea louse, comprises:

determining whether the location of the sea louse is on a particular portion of a fish, where different portions of the fish have different energy limits.

18. The computer storage media of claim 15 , the operations comprising:

determining whether obstructions exist between the ultrasonic transducers and the sea louse; and

in response to determining whether obstructions exist between the ultrasonic transducers and the sea louse, altering the propagation parameters, so that a set of ultrasonic signals focuses energy at the sea louse.

19. The computer storage media of claim 18 , the operations comprising:

in response to determining whether obstructions exist between the ultrasonic transducers and the sea louse, altering the propagation parameters, so that the set of ultrasonic signals focuses energy at the sea louse at a reduced power level.

20. The computer storage media of claim 15 , the operations comprising:

altering the propagation parameters of the ultrasonic signals; and:

generating ultrasonic signals that do not generate a side lobe, where ultrasonic energy is focused at a location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2023
From: YOUNG, GRACE CALVERT; KNOLL, MATTHEW AARON; REMESCH, BRYCE JASON; KIMBALL, PETER
To: X DEVELOPMENT LLC
Reel/Frame 063677/0366 →
Continuity (4)
Continuation 17971503 · Oct 21, 2022
Continuation 17132874 · Dec 23, 2020
Related Publication 20240130334A1 · Apr 25, 2024
Related Publication 20240224952A9 · Jul 11, 2024
References Cited (121)
US 7393323B2 · Vago · 2008 [cited by applicant]
US 7377905B2 · Vago · 2008 [cited by applicant]
US 7413552B2 · Vago · 2008 [cited by applicant]
US 9072281B2 · Beck · 2015 [cited by applicant]
US 10849317B2 · Alevy · 2020 [cited by applicant]
US 10856520B1 · Kozachenok et al. · 2020 [cited by applicant]
US 11490601B2 · Young · 2022 [cited by applicant]
US 11690359B2 · Young · 2023 [cited by examiner]
US 20170094950A1 · Alevy · 2017 [cited by examiner]
US 20170150701A1 · Gilmore et al. · 2017 [cited by applicant]
US 20190228218A1 · Barnaby et al. · 2019 [cited by applicant]
US 20190340440A1 · Atwater et al. · 2019 [cited by applicant]
US 20200107524A1 · Messana et al. · 2020 [cited by applicant]
US 20200155882A1 · Tohidi et al. · 2020 [cited by applicant]
US 20200288678A1 · Howe et al. · 2020 [cited by applicant]
US 20230067723A1 · Young · 2023 [cited by examiner]
US 20230189766A1 · Young · 2023 [cited by examiner]
CA 2859955A1 · 2013 [cited by examiner]
CA 3045347A1 · 2018 [cited by examiner]
CL 2019000039A1 · 2019 [cited by applicant]
CN 108040948 · 2018 [cited by applicant]
EP 2244934 · 2010 [cited by applicant]
EP 2962556 · 2016 [cited by applicant]
EP 3484283 · 2019 [cited by applicant]
EP 3346850 · 2020 [cited by applicant]
GB 2309621 · 1997 [cited by applicant]
GB 2584166A · 2020 [cited by examiner]
JP 2002171853 · 2002 [cited by applicant]
JP 2013518583 · 2013 [cited by applicant]
NO 300401 · 1997 [cited by applicant]
NO 20160199 · 2017 [cited by applicant]
WO WO90007574 · 1990 [cited by examiner]
WO WO9417657A1 · 1994 [cited by examiner]
WO WO97019857 · 1997 [cited by examiner]
WO WO2009008733 · 2009 [cited by applicant]
WO WO2009097057 · 2009 [cited by applicant]
WO WO2011115496 · 2011 [cited by applicant]
WO WO2012081990 · 2012 [cited by applicant]
WO WO2013095153 · 2013 [cited by applicant]
WO WO2014179482 · 2014 [cited by applicant]
WO WO2017044985 · 2017 [cited by applicant]
WO WO2017137896 · 2017 [cited by applicant]
WO WO2018011744 · 2018 [cited by applicant]
WO WO2018011745 · 2018 [cited by applicant]
WO WO2018115826 · 2018 [cited by applicant]
WO WO2019002881 · 2019 [cited by applicant]
WO WO2019121851 · 2019 [cited by applicant]
WO WO2019121900 · 2019 [cited by applicant]
WO WO2019188506 · 2019 [cited by applicant]
WO WO2019232247 · 2019 [cited by applicant]
WO WO2019245722 · 2019 [cited by applicant]
WO WO2020046524 · 2020 [cited by applicant]
WO WO2020048945 · 2020 [cited by applicant]
WO WO2020132031 · 2020 [cited by applicant]
WO WO2021006744 · 2021 [cited by applicant]
WO WO2021030237 · 2021 [cited by applicant]
WO WO2021188292 · 2021 [cited by applicant]
WO WO2022010815 · 2022 [cited by applicant]
WO WO2020072438 · 2022 [cited by applicant]
Extended Search Report in European Appln. No. 22151132.2, dated May 2, 2022, 10 pages. [cited by applicant]
[No Author Listed], “2020 The State of World Fisheries and Aquaculture,” Food and Agriculture Organization of the United Nations, 2020, 224 pages. [cited by applicant]
Aunsmo et al., “Accuracy and precision of harvest stock estimation in Atlantic salmon farming,” Aquaculture, Mar. 2013, 369(399):113-118. [cited by applicant]
Aunsmo et al., “Field validation of growth models used in Atlantic salmon farming,” Aquaculture, Mar. 2014, 428(429):249-257. [cited by applicant]
Bani et al., “Histological and ultrastructural effects of ultrasound-induced cavitation on human skin adipose tissue,” Plastic and Reconstructive Surgery Global Open, Sep. 2013, 1(6). [cited by applicant]
Boldt et al., “Development of stereo camera methodologies to improve pelagic fish biomass estimates and inform ecosystem management in marine waters,” Fisheries Research, 2018, 198:66-77. [cited by applicant]
Bravo et al., “Coinfection of Caligus lalandei and Benedenia seriolae on the yellowtail kingfish Seriola lalandi farmed in a net cage in northern Chile,” Latin american journal of aquatic research, 2017, 45(4):852-7. [cited by applicant]
Costello et al., “The future of food from the sea, ” Nature, Dec. 2020, 588:95-100. [cited by applicant]
Crippa et al., “Food systems are responsible for a third of global anthropogenic GHG emissions,” Nature Food, Mar. 2021, 2:198-209. [cited by applicant]
fishfarmingexpert.com [online], “Turning ultrasound and infrared on sea lice,” Dec. 13, 2017, retrieved on Aug. 1, 2022, retrieved from URL<https://www.fishfarmingexpert.com/article/a-lethal-bubble-bath-for-sea-lice/>, … [cited by applicant]
Flickr.com [online], “Anatomy of [cited by applicant]
Fore et al., “Precision fish farming: A new framework to improve production in aquaculture,” Biosystems Engineering, Nov. 2017, 173:176-193. [cited by applicant]
Fry et al., “Feed conversion efficiency in aquaculture: do we measure it correctly?,” Environ. Res. Lett., Feb. 2018, 13:024017. [cited by applicant]
Harvey et al., “The accuracy and precision of underwater measurements of length and maximum body depth of southern bluefin tuna ( [cited by applicant]
Hilborn et al., “The environmental cost of animal source foods,” Front Ecol Environ, 2018, 16(6):329-335. [cited by applicant]
Hockaday et al., “Using truss networks to estimate the biomass of Oreochromis niloticus, and to investigate shape characteristics,” Journal of Fish Biology, May 2000, 57:981-1000. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2020/059829, dated May 27, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/018651, dated Jun. 22, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/021683, dated Jun. 27, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022250, dated Jul. 6, 2022, 15 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022492, dated Jun. 28, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022589, dated Jul. 7, 2022, 12 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/022837, dated Aug. 2, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln No. PCT/US2022/023831, dated Jul. 8, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2020/059829, dated Feb. 25, 2021, 18 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2021/057576, dated Feb. 3, 2022, 15 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2022/036772, dated Nov. 22, 2022, 15 pages. [cited by applicant]
IntraFish.com [online], “Belgian, Norwegian companies join forces to battle salmon farming's sea lice scourge,” Sep. 30, 2019, retrieved on Jun. 17, 2022, retrieved from URL<https://www.intrafish.com/aquaculture/belgian… [cited by applicant]
Kang et al., “A Study on the Search of Optimal Aquaculture farm condition based on Machine Learning,” The Journal of The Institute of Internet, Broadcasting and Communication, Apr. 2017, 17(2):135-140. [cited by applicant]
Macleod et al., “Quantifying and mitigating greenhouse gas emissions from global aquaculture,” FAO Fisheries and Aquaculture Technical Paper, Mar. 2019, 626:50 pages. [cited by applicant]
Maloy et al., “A spatio-temporal recurrent network for salmon feeding action recognition from underwater videos in aquaculture,” Computers and Electronics in Agriculture, Nov. 12, 2019, 9 pages. [cited by applicant]
MarineSpecies.org [online], “Benedenia seriolae,” 1934, retrieved on Feb. 8, 2021, retrieved from URL<http://www.marinespecies.org/aphia.php?p=taxdetails&id=414341>, 3 pages. [cited by applicant]
Meidell et al., “FishNet: A Unified Embedding for Salmon Recognition,” Thesis for Master's degree in Artificial Intelligence, Norwegian University of Science and Technology, Jun. 2019, 86 pages. [cited by applicant]
Moskvyak et al., “Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings,” CoRR, Feb. 2019, arXiv:1902.10847v1, 12 pages. [cited by applicant]
Murray et al., “Using the H-index to assess disease priorities for salmon aquaculture,” Preventive Veterinary Medicine, Apr. 2016, 126:199-207. [cited by applicant]
Odey, “AquaMesh—Design and Implementation of Smart Wireless Mesh Sensor Networks for Aquaculture,” American Journal of Networks and Communications, Jul. 2013, 8 pages. [cited by applicant]
Parker et al., “Fuel use and greenhouse gas emissions of world fisheries,” Nature Climate Change, Apr. 2018, 8:333-337. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2020/059829, dated Feb. 25, 2021, 18 pages. [cited by applicant]
PCT International Search Report and Written Opinion in International Appln. No. PCT/US2021/020460, dated Jun. 16, 2021, 13 pages. [cited by applicant]
Pérez et al., “Automatic measurement of fish size using stereo vision,” 2018 IEEE International Instrumentation and Measurement Technology Conference, May 2018, 6 pages. [cited by applicant]
Petrov et al., “Overview of the application of computer vision technology in fish farming,” E3S Web of Conferences, 2020, 175:02015. [cited by applicant]
Pettersen et al., “Detection and classification of lepeophterius salmonis (krøyer, 1837) using underwater hyperspectral imaging,” Aquacultural Engineering, Nov. 2019, 87:102025. [cited by applicant]
Qiu et al., “Improving Transfer Learning and Squeeze-and-Excitation Networks for Small-Scale Fine-Grained Fish Image Classification,” IEEE Access, Dec. 2018, 6(31):78503-78512. [cited by applicant]
Rahman et al., “Developing an Ensembled Machine Learning Prediction Model for Marine Fish and Aquaculture Production,” Sustainability, 2021, 13:9124. [cited by applicant]
Saberloon et al., “Application of Machine Vision Systems in Aquaculture with Emphasis on Fish: State-of-the-Art and Key Issues,” Reviews in Aquaculture, Dec. 2017, 9:369-387. [cited by applicant]
Shafait et al., “Towards automating underwater measurement of fish length: a comparison of semi-automatic and manual stereovideo measurements,” ICES Journal of Marine Science, 2017, 12 pages. [cited by applicant]
Sintef.no [online], “Jumping salmon removes lice,” Nov. 23, 2011, retrieved on Jun. 17, 2022, retrieved from URL<https://www.sintef.no/en/latest-news/2011/jumping-salmon-removes-lice/>, 9 pages. [cited by applicant]
Stein et al., “Consistent melanophore spot patterns allow long-term individual recognition of Atlantic salmon Salmo Salar,” Journal of Fish Biology, Nov. 2017, 91(6):1699-1712. [cited by applicant]
Svendsen et al., “Effect of ultrasonic cavitation on small and large organisms for water disinfection during fish transport,” Aquaculture Research, Dec. 2017, 49(7):1166-1175. [cited by applicant]
thefishsite.com [online], “Turning ultrasound and infrared on sea lice,” Nov. 23, 2020, retrieved on Aug. 1, 2022, retrieved from URL<https://thefishsite.com/articles/turning-ultrasound-and-infrared-on-sealice#:˜:text=I… [cited by applicant]
Topaz et al., “Possible long-term complications in ultrasound-assisted lipoplasty induced by sonoluminescence, sonochemistry, and thermal effect,” Aesthetic surgery journal, Jan. 1998, 18(1):19-24. [cited by applicant]
towardsdatascience.com [online], “Analyzing Applications of Deep Learning in Aquaculture,” Jan. 2021, retrieved on Aug. 11, 2021, retrieved from URL<https://towardsdatascience.com/analyzing-applications-of-deep-learning… [cited by applicant]
Troell et al., “Does aquaculture add resilience to the global food system?,” PNAS, Sep. 2014, 111(37):13257-13263. [cited by applicant]
Wang et al., “Advances in low-frequency ultrasound combined with microbubbles in targeted tumor therapy,” Journal of Zhejiang University—Science B, Apr. 2019, 20(4):291-9. [cited by applicant]
Wang, “Robust tracking of fish schools using CNN for head identification,” Multimedia Tools and Applications, Nov. 2017, 20 pages. [cited by applicant]
www.era-learn.eu [online], “Project: Ultrasonic and physical elimination of Caligidae sea lice from salmon fish farms,” May 11, 2018, retrieved on Aug. 1, 2022, retrieved from URL<https://www.era-learn.eu/network-inform… [cited by applicant]
www.fishfarmermagazine.com [online], “GenusWave gives salmon a fighting chance against sea lice,” Oct. 16, 2020, retrieved on Aug. 1, 2022, retrieved from URL<https://www.fishfarmermagazine.com/news/genuswave-gives-salm… [cited by applicant]
Yang et al., “Deep learning for smart fish farming: applications, opportunities and challenges,” Reviews in Aquaculture, 2021, 13(1):66-90. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/US2021/057576, dated Jul. 6, 2023, 9 pages. [cited by applicant]
Office Action in European Appln. No. 21815040.7, dated Feb. 6, 2024, 6 pages. [cited by applicant]
Office Action in Japanese Appln. No. 2023-522379, dated Jun. 17, 2024, 6 pages (with English translation). [cited by applicant]
Office Action in Chilean Appln. No. 202301175, dated Sep. 30, 2024, 24 pages (with English translation). [cited by applicant]