IP Library › Granted Patent US 12,610,935
Granted Patent B2
US 12,610,935 · App. 17/496,563 · Granted Apr 28, 2026

Smart mosquito trap for mosquito classification

Inventors: Sriram Chellappan (Tampa, FL); Stephen Edward Saddow (Land O Lakes, FL); Ryan Marc Carney (Temple Terrace, FL); Brandon Wolfram (Seffner, FL); Mark Weston (Tampa, FL)
Assignee: University of South Florida
A01M1/026A01M1/023G06N3/04G06N3/08G06V10/95G06V20/00H04R1/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,610,935
App. No.
17/496,563
Granted
Apr 28, 2026
Kind
B2
Abstract

An insect trap includes a combination of one or more components used to classify the insect according to a genus and species. The trap includes an imaging device, a digital microphone, and passive infrared sensors at the entrance of the trap to sense wing-beat frequencies and size of the insect (to identify entry of a mosquito). A lamb-skin membrane, filled with an insect attractant such as carbon dioxide mixed with gas air inside, mimics human skin so that the insect can rest on the membrane and even pierce the membrane as if a blood meal is available. An imaging device such as a passive infrared sensor or a camera gathers image data of the insect. The insect may be a mosquito.

Claims (34)

1 . An apparatus to catch an insect and gather identifying data regarding the insect, the apparatus comprising:

a lamb-skin membrane body positioned within a membrane enclosure configured to mimic human skin and support the insect thereon, wherein the lamb-skin membrane body is fillable with a carbon dioxide gas attractant and porous to allow the carbon dioxide gas attractant to slowly leak out, the lamb-skin membrane body connected to a brass puck comprising a cartridge heater for heating the brass puck, wherein the brass puck is positioned in proximity to an inlet opening for directing the insect to perch on the lamb-skin membrane body and seek the carbon dioxide gas attractant disposed within the lamb-skin membrane body;

a plurality of imaging devices having respective fields of view that encompass the lamb-skin membrane body;

a microphone having a user-adjustable frequency range for increased or decreased sensitivity positioned within the apparatus and configured to obtain audio signals;

an active infrared sensor positioned at the inlet opening, wherein data obtained from the active infrared sensor is used to trigger the microphone to obtain the audio signals;

at least one sensor on an external surface of the apparatus configured to capture ambient environmental data including at least one of temperature, air pressure, altitude, humidity, latitude, longitude, time, CO 2 concentration and ambient light conditions; and

a processor operatively coupled to the plurality of imaging devices, the processor being operably connected to computerized memory storing computer-executable instructions which when executed by the processor, cause the processor to:

receive the audio signals from the microphone;

calculate a frequency signal corresponding to a wingbeat frequency of the insect;

responsive to determining that the wingbeat frequency is within a predetermined frequency range, trigger, via the active infrared sensor, the plurality of imaging devices to obtain images of the insect from a plurality of different angles,

determine a size of the insect based on a wing-beat frequency determined from the audio signals,

determine at least one anatomical component of the insect from the obtained images;

classify, using a machine learning classifier, the insect into a genus and species based, at least in part, on the determined size of the insect and the at least one determined anatomical component,

store insect data and the ambient environmental data in the computerized memory, and

responsive to detecting that the insect cannot be identified, generate an alert and transfer at least a portion of the stored data including the insect data and the ambient environmental data to a digital repository,

wherein the data is used to generate a set of training images for training one or more machine learning algorithms to identify the insect.

2 . The apparatus of claim 1 , wherein the membrane enclosure surrounds the lamb-skin membrane body to trap the insect within the membrane enclosure.

3 . The apparatus of claim 2 , further comprising an enclosed chamber connected to the membrane enclosure with an exit opening and configured to house the insect after the data has been stored.

4 . The apparatus of claim 1 , wherein the brass puck is connected to a source of carbon dioxide, and wherein the carbon dioxide enters the lamb-skin membrane body through the inlet opening.

5 . The apparatus of claim 1 , wherein the brass puck defines a recess for placement of additional insect attractants.

6 . The apparatus of claim 1 , wherein the plurality of imaging devices comprises a passive infrared sensor (PIR).

7 . The apparatus of claim 1 , wherein the plurality of imaging devices comprises a camera.

8 . The apparatus of claim 1 , further comprising a plurality of enclosed chambers connected to the membrane enclosure via respective exit openings and configured to house mosquitoes in respective ones of the plurality of enclosed chambers according to a mosquito taxonomy.

9 . The apparatus of claim 1 , wherein the computerized memory has computer-executable instructions stored thereon that, when executed by the processor, cause the processor to classify the insect using at least one neural network algorithm applied to image data obtained from the plurality of imaging devices.

10 . The apparatus of claim 8 , further comprising a funnel connected to the membrane enclosure to direct the insect into the apparatus.

11 . The apparatus of claim 1 , wherein the computerized memory has computer-executable instructions stored thereon that, when executed by the processor, cause the processor to:

determine the at least one determined anatomical component using at least one of a mask region-based convolutional neural network and a pixel-wise segmentation operation.

12 . The apparatus of claim 1 , wherein the computerized memory has computer-executable instructions stored thereon that, when executed by the processor, cause the processor to further:

output, to an application executing on a mobile device that is in electronic communication with the processor, at least a portion of the stored data for display.

13 . The apparatus of claim 1 , further comprising metal plate within the apparatus operatively coupled to a Peltier module configured to freeze the insect.

14 . The apparatus of claim 1 , wherein the processor is configured to determine the at least one anatomical component of the insect from the obtained images by:

identifying body pixels from the image data;

converting the body pixels into a selected color space data set; and

identifying textural features from the selected color space data set.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2022
From: CHELLAPPAN, SRIRAM; SADDOW, STEPHEN EDWARD; CARNEY, RYAN MARC; WOLFRAM, BRANDON; WESTON, MARK
To: UNIVERSITY OF SOUTH FLORIDA
Reel/Frame 061343/0631 →
Continuity (2)
Provisional Application 63198254 · Oct 7, 2020
Related Publication 20220104474A1 · Apr 7, 2022
References Cited (63)
US 5382422A · Dieguez · 1995 [cited by examiner]
US 6653971B1 · Guice · 2003 [cited by examiner]
US 6953814B2 · Reifenrath · 2005 [cited by examiner]
US 7028269B1 · Cohen-Solal · 2006 [cited by examiner]
US 8705017B2 · Hyde · 2014 [cited by examiner]
US 10278368B1 · Peeters et al. · 2019 [cited by applicant]
US 10963742B2 · Chellappan et al. · 2021 [cited by applicant]
US 11048928B1 · Chellappan et al. · 2021 [cited by applicant]
US 11771073B2 · Smith · 2023 [cited by examiner]
US 20060028345A1 · Lee · 2006 [cited by examiner]
US 20070157508A1 · Chang · 2007 [cited by examiner]
US 20090153659A1 · Landwehr · 2009 [cited by examiner]
US 20160212984A1 · Fang · 2016 [cited by examiner]
US 20160366872A1 · Olson · 2016 [cited by examiner]
US 20170112116A1 · Ji · 2017 [cited by examiner]
US 20170273290A1 · Jay · 2017 [cited by examiner]
US 20180084772A1 · Peeters · 2018 [cited by examiner]
US 20180093288A1 · Tillotson · 2018 [cited by examiner]
US 20180206473A1 · Massaro · 2018 [cited by examiner]
US 20180279598A1 · Hur · 2018 [cited by examiner]
US 20190159439A1 · Oller · 2019 [cited by examiner]
US 20200245604A1 · CHerukumalli · 2020 [cited by examiner]
US 20200293887A1 · De Brouwer · 2020 [cited by examiner]
US 20200349668A1 · Desnoyer · 2020 [cited by examiner]
US 20210287674A1 · Unruh · 2021 [cited by examiner]
US 20210397407A1 · Eubank · 2021 [cited by examiner]
US 20210400943A1 · Cherukumalli · 2021 [cited by examiner]
US 20230210101A1 · Nguyen · 2023 [cited by examiner]
CN 108935388A · 2018 [cited by examiner]
WO WO2014024052A1 · 2014 [cited by examiner]
Choosing the best light source for your fluorescence experiment. Scientifica. (2024). https://www.scientifica.uk.com/learning-zone/choosing-the-best-light-source-for-your-experiment (Year: 2024). [cited by examiner]
Atef Ali Kloub, The importance of learning identification of larvae and adult mosquitoes. https://juniperpublishers.com/jojnhc/pdf/ JOJNHC.MS. ID.555636.pdf. [cited by applicant]
Chen, Y., Why, A., Batista, G., Mafra-Neto, A. & Keogh, E. Flying insect detection and classification with inexpensive sensors. J. Vis. Exp. (JoVE) e52111 (2014). [cited by applicant]
Dai, J., He, K. & Sun, J. Instance-aware semantic segmentation via multi-task network cascades. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 3150-3158 (2016). [cited by applicant]
De Los Reyes, A. M. M., Reyes, A. C. A., Torres, J. L., Padilla, D. A. & Villaverde, J. Detection of aedes aegypti mosquito by digital image processing techniques and support vector machine. In 2016 IEEE Region 10 Confe… [cited by applicant]
Dharmasiri, A. G. et al. First record of anopheles stephensi in Sri Lanka: a potential challenge for prevention of malaria reintroduction. Malaria J. 16, 326 (2017). [cited by applicant]
Dutta, A. & Zisserman, A. The VGG image annotator (via). arXiv preprint arXiv:1904.10699 (2019). [cited by applicant]
Favret, C. & Sieracki, J. M. Machine vision automated species identification scaled towards production levels. Syst. Entomol. 41, 133-143 (2016). [cited by applicant]
Floore, T. A., Harrison, B. A. & Eldridge, B. F. The anopheles (anopheles) crucians subgroup in the united states (diptera: Culicidae) (Tech. Rep, Walter Reed Army Inst Of Research Washington Dc Department Of Entomology… [cited by applicant]
Fuchida, M., Pathmakumar, T., Mohan, R. E., Tan, N. & Nakamura, A. Vision-based perception and classification of mosquitoes using support vector machine. Appl. Sci. 7, 51 (2017). [cited by applicant]
Girshick, R. Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision 1440-1448 (2015). [cited by applicant]
Glyshaw, P. & Wason, E. Anopheles quadrimaculatus. https://animaldiversity.org / accounts/Anopheles_quadrimaculatus/edu/mosquito-guide/species-identification- table/species-identification-table-adult/. [cited by applicant]
He, K., Gkioxari, G., Dollár, P. & Girshick, R. Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision 2961-2969 (2017). [cited by applicant]
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770-778 (2016). [cited by applicant]
IFAS. Florida medical entomology laboratory. https://fmel.ifas.ufl.edu/mosquito-guide/species-identification-table/species-identification-table-adult/. [cited by applicant]
IFAS. Florida medical entomology laboratory. https://fmel.ifas.ufl.edu/publication/buzz-words/buzz-words-archive/is-it-culex-tarsalis-or-culex-coronator/. [cited by applicant]
Li, Y., Qi, H., Dai, J., Ji, X. & Wei, Y. Fully convolutional instance-aware semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2359-2367 (2017). [cited by applicant]
Lin, T.-Y. et al. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2117-2125 (2017). [cited by applicant]
Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Dollár, P. Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision, 2980-2988 (2017). [cited by applicant]
Lin, Tsung-Yi, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. “Microsoft coco: Common objects in context.” In European conference on computer vision, pp. 7… [cited by applicant]
Mask RCNN code. https://github.com/matterport/Mask_RCNN. [cited by applicant]
Minakshi, M. et al. Automating the surveillance of mosquito vectors from trapped specimens using computer vision techniques. In ACM COMPASS (ACM, 2020). [cited by applicant]
Minakshi, M., Bharti, P. & Chellappan, S. Leveraging smart-phone cameras and image processing techniques to classify mosquito species. In Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Sys… [cited by applicant]
Mukundarajan, H., Hol, F. J., Castillo, E. A., Newby, C. & Prakash, M. Using mobile phones as acoustic sensors for the surveillance of spatio-temporal mosquito ecology (2016). [cited by applicant]
Park, J., Kim, D. I., Choi, B., Kang, W. & Kwon, H. W. Classification and morphological analysis of vector mosquitoes using deep convolutional neural networks. Sci. Rep. 10, 1-12 (2020). [cited by applicant]
Pinheiro, P. O., Collobert, R. & Dollár, P. Learning to segment object candidates. In Advances in Neural Information Processing Systems 1990-1998 (2015). [cited by applicant]
Ravi, P., Syam, U. & Kapre, N. Preventive detection of mosquito populations using embedded machine learning on low power iot platforms. In Proceedings of the 7th Annual Symposium on Computing for Development, 1-10 (2016… [cited by applicant]
Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems 91-99 (2015). [cited by applicant]
Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 234-241 (Springer, 2015… [cited by applicant]
Stauffer, C. & Grimson, W. E. L. Adaptive background mixture models for real-time tracking. In Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on., vol. 2, 246-252 (IEEE, 1999). [cited by applicant]
Stewart, Matthew Ph.D. Simple Introduction to Convolutional Neural Networks in Towards Data Science posted on-line Feb. 26, 2019 located at https://towardsdatascience.com/simple-introduction-to-convolutional-neural-netw… [cited by applicant]
Vasconcelos, D., Nunes, N., Ribeiro, M., Prandi, C. & Rogers, A. Locomobis: a low-cost acoustic-based sensing system to monitor and classify mosquitoes. In 2019 16th IEEE Annual Consumer Communications & Networking Conf… [cited by applicant]
International Search report and Written Opinion issued for Application No. PCT/US2021/053995, dated Feb. 2, 2022. [cited by applicant]