IP Library › Granted Patent US 12,239,105
Granted Patent B2
US 12,239,105 · App. 17/904,422 · Granted Mar 4, 2025

Method and apparatus for determining an index of insect biodiversity, an insect sensor and a system of insect sensors

Inventors: Klas Rydhmer (Malmö, SE); Thomas Nikolajsen (Slangerup, DK); Laurence Still (Copenhagen S, DK); Mikkel Brydegaard Sörensen (Lund, SE); Flemming Bent Rasmussen (Frederiksberg, DK); Alfred Gösta Victor Strand (Malmö, SE)
Assignee: FaunaPhotonics Agriculture & Environmental A/S
A01K29/00G06V10/762G06V40/10H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,239,105
App. No.
17/904,422
Granted
Mar 4, 2025
Kind
B2
Abstract

An apparatus for determining an index of insect biodiversity comprises a plurality of optical insect sensor devices configured to be individually positioned within a geographic area and a data processing system. Each sensor device is configured to monitor insect activity within a detection volume by detecting light from the detection volume, and to output detector data indicative of one or more optically detected attributes associated with respective detected insect detection events. Each insect detection event is indicative of one or more insects being present in the detection volume. The data processing system is configured to receive detector data from respective ones of the plurality of optical insect sensor devices. The detector data is indicative of one or more optically detected attributes associated with respective detected insect detection events. The system computes, from the received detector data, an index of insect biodiversity indicative of insect biodiversity within the geographic area.

Claims (57)

1. An apparatus for determining an index of insect biodiversity, comprising:

a plurality of insect sensor devices configured to be individually positioned within a geographic area, each of the plurality of insect sensor devices configured to:

monitor insect activity within a detection volume extending outside the insect sensor device, and

output detector data indicative of one or more detected attributes associated with respective detected insect detection events, each insect detection event being indicative of one or more insects being present in the detection volume;

a data processing system communicatively coupled to the plurality of insect sensor devices and configured to:

receive the detector data from respective ones of the plurality of insect sensor devices, the detector data being indicative of one or more detected attributes associated with respective detected insect detection events, and

compute, from the received detector data, an index of insect biodiversity indicative of insect biodiversity within the geographic area,

wherein the detected insect detection events are taxonomically unclassified and wherein the data processing system is configured to compute the index of insect biodiversity directly from the detected attributes associated with the taxonomically unclassified detection events.

2. An apparatus according to claim 1 , wherein the plurality of insect sensor devices is a plurality of insect sensor devices, each configured to monitor insect activity within a detection volume extending outside the insect sensor device by detecting light from the detection volume, and wherein the one or more detected attributes are one or more optically detected attributes.

3. An apparatus for determining an index of insect biodiversity, comprising:

one or more insect sensor devices configured to be individually positioned within a geographic area, each of the one or more insect sensor devices configured to:

monitor insect activity within a detection volume to detect one or more insect detection events, each insect detection event being indicative of one or more insects being present in the detection volume, and

output detector data indicative of one or more detected attributes associated with respective detected insect detection events,

a data processing system communicatively coupled to the one or more insect sensor devices and configured to:

receive the detector data from the one or more optical-insect sensor devices, the detector data being indicative of one or more detected attributes associated with respective detected insect detection events, wherein the detected insect detection events are taxonomically unclassified, and

compute an index of insect biodiversity directly from the detected attributes associated with the taxonomically unclassified detection events.

4. An apparatus according to claim 3 , wherein the data processing system is configured to compute the index of insect biodiversity as a measure of variability of the detected attributes associated with respective detected insect detection events.

5. An apparatus according to claim 4 , wherein the data processing system is configured to compute the measure of variability by performing a statistical analysis of the detected attributes, the statistical analysis being a multi-variate analysis associated with respective detected insect detection events.

6. An apparatus according to claim 4 , wherein the data processing system is configured to compute the measure of variability at least by performing a clustering of the detected insect detection events according to at least the detected attributes associated with the respective detected insect detection events.

7. An apparatus according to claim 3 , wherein the data processing system is configured to compute the index of insect biodiversity based on a mathematical model, the mathematical model being a trained machine learning model trained by supervised learning that directly maps the detected attributes associated with respective detected insect detection events to an index of insect biodiversity.

8. An apparatus according to claim 3 , wherein each insect sensor device of the plurality of insect sensor devices is calibrated based on a common detector reference.

9. An apparatus according to claim 3 , wherein each insect sensor device is an optical insect sensor device configured to output calibrated detector data based on a set of wavelength-specific detectivity data indicative of a wavelength-specific detectivity of each optical insect sensor device in respect of one or more predetermined calibration objects within the detection volume at respective wavelengths.

10. An apparatus according to claim 3 , wherein the detected attributes are optically detected attributes and include one or more attributes selected from the group of:

a detected trajectory of movement of an insect inside the detection volume;

a detected speed of movement of an insect inside the detection volume;

one or more detected wing beat frequencies;

a melanisation ratio;

an insect glossiness.

11. An apparatus according to claim 3 , further comprising one or more environmental sensor devices configured to sense environmental data indicative of an environmental condition of the geographic area; and wherein the data processing system is configured to receive the environmental data and to compute the index of insect biodiversity from the received detector data and from the sensed environmental data.

12. An apparatus according to claim 3 , wherein each insect sensor device is an optical insect sensor device and comprises:

an illumination module configured to illuminate the detection volume with illumination light comprising light at a first wavelength band modulated at a first modulation frequency;

a detector module comprising a detector configured to detect light from the detection volume; and

a processing unit configured to receive sensor signals from the detector module and configured to filter the received sensor signal to extract a first sensor signal modulated at the first modulation frequency and, based on the first sensor signal, to detect at least one insect in the detection volume and to determine at least one optically detectable attribute of the detected insect.

13. An apparatus according to claim 3 , wherein the one or more insect sensor devices are one or more optical insect sensor devices and wherein the one or more detected attributes are one or more optically detected attributes.

14. An apparatus according to claim 3 , wherein the detection volume is an enclosure-free space allowing unrestricted movement of living airborne insects into and out of the space.

15. An apparatus according to claim 3 , the data processing system is configured to compute the index of insect biodiversity as a measure of variability of the detected attributes associated with respective detected insect detection events and/or based on a mathematical model, the mathematical model including a trained machine learning model.

16. An insect sensor device for detecting insects in a detection volume, the insect sensor device comprising:

an illumination module configured to illuminate the detection volume with illumination light comprising light at a first wavelength band modulated at a first modulation frequency;

a detector module comprising a detector configured to detect light from the detection volume; and

a processing unit configured to:

receive sensor signals from the detector module and configured to filter the received sensor signal to extract a first sensor signal modulated at the first modulation frequency

based on the first sensor signal, detect one or more insect detection events, each insect detection event being indicative of at least one insect in the detection volume and to determine at least one optically detectable attribute of the detected insect associated with respective detected insect detection events, wherein the detected insect detection events are taxonomically unclassified, and

compute an index of insect biodiversity directly from a plurality the detected attributes associated with the taxonomically unclassified detection events.

17. An insect sensor device according to claim 16 , wherein the illumination light further comprises light at a second wavelength band, different from the first wavelength band, modulated at a second modulation frequency, different from the first modulation frequency, wherein the processing unit is further configured to filter the received sensor signal to extract a second sensor signal modulated at the second modulation frequency and, based on the first and second sensor signals, to detect at least one insect in the detection volume and to determine at least one optically detectable attribute of the detected insect.

18. An insect sensor device according to claim 16 , wherein the illumination module comprises an array of light-emitting devices.

19. An insect sensor device according to claim 18 , wherein the illumination module comprises a corresponding array of lenses for directing the light from the respective light-emitting devices as a diverging beam along an illumination direction.

20. An insect sensor device according to claim 16 , wherein the processing unit comprises one or more lock-in amplifiers for extracting the first sensor signal.

21. A system of insect sensors, comprising:

a plurality of insect sensor devices configured to be individually positioned within a geographic area, each of the plurality of insect sensor devices configured to:

monitor insect activity within a three-dimensional detection volume extending outside the insect sensor device, wherein the detection volume is an enclosure-free void allowing unrestricted movement of living airborne insects into and out of the void, and

output detector data indicative of one or more detected attributes associated with respective detected insect detection events, each insect detection event being indicative of one or more insects being present in the detection volume, and

a data processing system communicatively coupled to the plurality of insect sensor devices and configured to:

receive detector data from respective ones of the plurality of insect sensor devices, the detector data being indicative of one or more detected attributes associated with respective detected insect detection events, wherein the detected insect detection events are taxonomically unclassified, and

compute an index of insect biodiversity directly from a plurality the detected attributes associated with the taxonomically unclassified detection events.

22. A system according to claim 21 ,

wherein the plurality of insect sensor devices is a plurality of insect sensor devices, each configured to monitor insect activity within a three-dimensional detection volume extending outside the insect sensor device by detecting light from the detection volume, and wherein the one or more detected attributes are one or more optically detected attributes.

23. A system according to claim 21 , wherein each insect sensor device comprises a detector module and a processing unit, the processing unit being configured to receive and process sensor signals from the detector module, and wherein the detector modules and/or the signal processing performed by the processing units of the respective insect sensor devices is calibrated according to a detector reference that is uniform across the plurality of insect sensor devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2024
From: NIKOLAJSEN, THOMAS; RYDHMER, KLAS; STILL, LAURENCE; SØRENSEN, MIKKEL BRYDEGAARD; RASMUSSEN, FLEMMING BENT; STRAND, ALFRED GÖSTA VICTOR
To: FAUNAPHOTONICS AGRICULTURE & ENVIRONMENTAL A/S
Reel/Frame 069187/0730 →
Priority Claims (1)
EP 20158120 · Feb 19, 2020 · regional
Continuity (1)
Related Publication 20230106933A1 · Apr 6, 2023
References Cited (32)
US 5956463A · Patrick · 1999 [cited by applicant]
US 9585376B2 · Park · 2017 [cited by applicant]
US 9635840B2 · Reckhaus · 2017 [cited by examiner]
US 10002416B2 · Mannar et al. · 2018 [cited by applicant]
US 20050025357A1 · Landwehr · 2005 [cited by applicant]
US 20090153659A1 · Landwehr · 2009 [cited by examiner]
US 20160245916A1 · Weber-Grabau · 2016 [cited by examiner]
US 20180007343A1 · Send · 2018 [cited by examiner]
US 20190034736A1 · Bisberg · 2019 [cited by examiner]
US 20190082650A1 · Lepek et al. · 2019 [cited by applicant]
US 20200113142A1 · Coleman et al. · 2020 [cited by applicant]
CN 111028309A · 2020 [cited by applicant]
CN 111192256A · 2020 [cited by applicant]
CN 112488244A · 2021 [cited by applicant]
WO 2004009575A1 · 2004 [cited by applicant]
WO WO2017182440A1 · 2017 [cited by applicant]
WO 2018019857A1 · 2018 [cited by applicant]
WO 2019244156A1 · 2019 [cited by applicant]
WO 2020043841A1 · 2020 [cited by applicant]
WO 2020043853A1 · 2020 [cited by applicant]
WO 2021051150A1 · 2021 [cited by applicant]
WO 2021165479A1 · 2021 [cited by applicant]
International Search Report and Written Opinion of International Searching Authority for International Patent Application No. PCT/EP2021/054181, mailed Mar. 19, 2021 (12 pages). [cited by applicant]
European Patent Office, Extended Search Report for Application No. 20158120.4, dated Aug. 4, 2020 (8 pages). [cited by applicant]
Monteiro, L. S. et al.; “High Diversity of Drosophilidae in High-Altitude Wet Forests in Northeastern Brazil”; Neotropical Entomology, vol. 45, No. 3, pp. 265-273; Sociedad Entomologica do Brasil, Sao Paolo, Brasil; Mar… [cited by applicant]
Kirsch, P. et al.; “Fast-ID: Flight signature recordings of aedes and Culex mosquitoes for automated species identification and vector surveillance”; American Journal of Tropical Medicine and Hygiene; Jan. 2007 (2 pages… [cited by applicant]
Hallman, C. A. et al.; “More than 75 percent decline over 27 years in total flying insect biomass in protected areas”; PLoS ONE 12 (10): e0185809; Oct. 18, 2017; retrieved from http://doi.org/10.1371/journal.pone.018580… [cited by applicant]
OECD (2019); [cited by applicant]
Underwood, E. et al.; “Pollinator Initiatives in EU Member States: Success Factors and Gaps”, report for European Commission under contract for provision of technical support related to Target 2 of the EU Biodiversity S… [cited by applicant]
Runemark, A. et al.; “Rare Events in Remote Dark-Field Spectroscopy: An Ecological Case Study of Insects”: IEEE Journal of Selected Topics in Quantum Electronics, vol. 18, No. 5, pp. 1573-1582; Sep./Oct. 2012; 1077-260X… [cited by applicant]
Alem Gebru, et al., “Multiband modulation spectroscopy for the determination of sex and species of mosquitoes in flight,” J. Biophotonics, 2018; 11:e201800014, https://doi.org/10.1002/jbio.201800014. [cited by applicant]
E.Puig, et al., “Assessment of crop insect damage using unmanned aerial systems: A machine learning approach,” 21st International Congress on Modelling and Simulation, Gold Coast, Australia Nov. 29 to Dec. 4, 2015; www.… [cited by applicant]