IP Library › Granted Patent US 12,270,802
Granted Patent B2
US 12,270,802 · App. 16/114,916 · Granted Apr 8, 2025

Agricultural machine with resonance vibration response detection

Inventors: Mahesh N. Bhanu (Magarpatta, IN); Benjamin M. Smith (Falls Church, VA); Noel W. Anderson (Fargo, ND)
Assignee: Deere & Company
G01N33/0098A01B79/005B64U20/87G01N21/29G01N29/348G01N29/4409G05D1/0246B64U2101/30B64U2101/40G01N2223/612
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,270,802
App. No.
16/114,916
Granted
Apr 8, 2025
Kind
B2
Abstract

An agricultural machine includes a vibration stimulation source configured to generate a vibration stimulation signal directed toward plant matter and a sensor system configured to sense electromagnetic radiation reflected from the plant matter, generate a first signal based on the sensed electromagnetic radiation, and generate a second signal indicative of a resonant vibration response of the plant matter, that is in response to the vibration stimulation signal. The agricultural machine includes a plant evaluation system configured to, based on the first and second signals, generate plant characterization data indicative of one or more physical characteristics of the plant matter, and a control system configured to generate an action signal based on the plant characterization data.

Claims (63)

1. An agricultural machine comprising:

a stimulation source configured to generate a vibration stimulation signal, transmitted through air, that mechanically stimulates plant matter on a field;

a sensor system configured to:

sense electromagnetic radiation reflected from the plant matter;

generate a first signal based on the sensed electromagnetic radiation; and

sense a physical response of the plant matter to the vibration stimulation signal;

a plant evaluation system configured to:

obtain prior response data indicative of at least one of structure or condition of a particular plant species;

generate first and second plant characterization data based on:

the sensed physical response of the plant matter to the mechanical stimulation of the plant matter, and

the first signal, wherein

the first plant characterization data identities that a particular plant is of the particular plant species,

the second plant characterization data identities an additional physical characteristic of the particular plant, in addition to plant species, and

one or more of the first plant characterization data and the second plant characterization data is generated based on correlating the sensed physical response with the prior response data; and

a control system configured to generate an action signal based on one or more of the first and second plant characterization data.

2. The agricultural machine of claim 1 , wherein the control stem is configured to send the action signal to at least one of:

a display device, wherein the action signal controls the display device to display an indication of one or more of the first and second plant characterization data;

a storage device, wherein the action signal controls the storage device to store an indication of one or more of the first and second plant characterization data; or

a controllable machine subsystem, wherein the action signal controls the controllable machine subsystem to perform an agricultural operation relative to the plant matter.

3. The agricultural machine of claim 1 , wherein the control system is configured to send the action signal to a controllable spraying subsystem to perform a spraying operation that applies an agricultural substance to at least a portion of the plant matter.

4. The agricultural machine of claim 1 , wherein the physical response comprises a resonant vibration response, and the first plant characterization data is generated based on at least one of a magnitude or a gradient of the resonant vibration response.

5. The agricultural machine of claim 1 , wherein the plant evaluation system is configured to generate the second plant characterization data based on correlating the sensed physical response with the prior response data.

6. The agricultural machine of claim 1 , wherein the additional physical characteristic indicates a yield of the particular plant.

7. The agricultural machine of claim 1 , wherein the additional physical characteristic indicates a health of the particular plant.

8. The agricultural machine of claim 1 , wherein the plant evaluation system is configured to distinguish between a plurality of plants of the particular plant species, and generate plant characterization data indicative of different sets of characteristics of each plant in the plurality of plants.

9. The agricultural machine of claim 1 , wherein the vibration stimulation signal comprises an acoustic wave, and the physical response comprises a vibration response.

10. The agricultural machine of claim 1 , wherein the control system is configured to send the action signal to a controllable machine subsystem configured to perform a harvesting operation.

11. The agricultural machine of claim 1 , wherein the sensor system comprises:

an imaging sensor configured to capture one or more images of the plant matter by sensing the electromagnetic radiation; and

a laser vibrometer configured to sense the physical response of the plant matter.

12. The agricultural machine of claim 11 , wherein the first signal is based on an image of the plant matter, and the physical response of the plant matter is determined based on a time series of images of the plant matter.

13. The agricultural machine of claim 1 , wherein the agricultural machine comprises at least one of a drone or a handheld computing device.

14. The agricultural machine of claim 6 , wherein the plant evaluation system is configured to determine, based on the first signal, at least one of:

a shape of the particular plant, a location of the particular plant, or a color of the particular plant;

and further comprising:

a location sensor configured to generate an indication of a geographical location of the particular plant; and

a geographical correlation component that correlates the first plant characterization data to the geographical location.

15. A method performed by an agricultural machine, the method comprising:

generating, by a stimulation source associated with the agricultural machine, a mechanical wave, transmitted through air, that mechanically stimulates plant matter on a field;

sensing electromagnetic radiation reflected from the plant matter;

generating, a first signal based on the sensed electromagnetic radiation;

determining, based on the first signal, at least one of a shape of the plant matter, a location of the plant matter, or a color of the plant matter;

detecting a physical response of the plant matter to the mechanical wave;

generating first plant characterization data that identifies a particular plant species of a particular plant in the plant matter based on correlating the detected physical response of the plant matter with prior response data correlated to the particular plant species, the prior response data being indicative of at least one of structure or condition of the particular plant species;

generating second plant characterization data based on correlating the detected physical response of the plant matter with the prior response data, wherein the second plant characterization data is indicative of at least one of:

a plant health, a plant yield, or a number of plants of the particular plant species; and

generating an action signal based on at least one of the first plant characterization data or the second plant characterization data.

16. The method of claim 15 , wherein the physical response is detected based on at least one of:

an output from a laser vibrometer that senses the plant matter; or

one or more images of the plant matter captured by an imaging sensor.

17. The method of claim 15 , wherein the first signal is based on a first image of the plant matter, and the physical response is detected based on a time series of images of the plant matter.

18. The method of claim 15 , wherein

the physical response comprises a resonant vibration response, and

the first plant characterization data is generated based on correlating at least one of a magnitude or a gradient of the resonant vibration response with the prior response data.

19. An agricultural machine comprising:

an acoustic source configured to generate an acoustic wave, transmitted though air, that mechanically stimulates plant matter on a field;

at least one processor; and

memory storing instructions executable by the at least one processor, wherein the instructions when executed, configure the agricultural machine to:

detect a physical response of the plant matter, that is in response to the acoustic wave;

identify prior response data indicative of at least one of structure or condition of a particular plant species;

generate first plant characterization data that identifies a plant species of a particular plant in the plant matter based on correlating the detected physical response with the prior response data;

generate second plant characterization data that identifies an additional physical characteristic of the particular plant, in addition to plant species, wherein one or more of the first plant characterization data or the second plant characterization data is generated based on correlating the detected physical response with the prior response data; and

generate an action signal based on one or more of the first plant characterization data of the second plant characterization data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2018
From: BHANU, MAHESH N.; SMITH, BENJAMIN M.; ANDERSON, NOEL W.
To: DEERE & COMPANY
Reel/Frame 046727/0751 →
Continuity (1)
Related Publication 20200072809A1 · Mar 5, 2020
References Cited (36)
US 5152401A · Affeldt, Jr. · 1992 [cited by examiner]
US 7165451B1 · Brooks · 2007 [cited by examiner]
US 9740208B2 · Sugumaran et al. · 2017 [cited by applicant]
US 9963817B2 · McLean et al. · 2018 [cited by applicant]
US 20070039389A1 · Brooks · 2007 [cited by examiner]
US 20090158848A1 · Brooks · 2009 [cited by examiner]
US 20090217758A1 · Loeser · 2009 [cited by examiner]
US 20140154729A1 · Leyns · 2014 [cited by examiner]
US 20150245554A1 · Redden · 2015 [cited by applicant]
US 20160000008A1 · Scholer · 2016 [cited by examiner]
US 20170031365A1 · Sugumaran et al. · 2017 [cited by applicant]
US 20170071188A1 · Rees · 2017 [cited by examiner]
US 20170228118A1 · Sugumaran et al. · 2017 [cited by applicant]
US 20180153084A1 · Calleija · 2018 [cited by examiner]
US 20190191631A1 · Regan · 2019 [cited by examiner]
US 20190350140A1 · Werner · 2019 [cited by examiner]
WO WO2018073481A1 · 2018 [cited by applicant]
Rolf J.Korneliussen, Acoustic identification of marine species using a feature library, Dec. 2016 (Year: 2016). [cited by examiner]
Hartwig Schulz, Qualitative and Quantitative FT-Raman Analysis of Plants, Dec. 6, 2013 (Year: 2013). [cited by examiner]
Iris Brémaud, Mechanical damping of wood as related to species classification: a preliminary survey, Apr. 5, 2013 (Year: 2013). [cited by examiner]
Search Report issued in counterpart EP Application No. 19192523.9, dated Jan. 29, 2020 (7 pages). [cited by applicant]
F.J. ′Pi nera-Chaveza, et al. “Avoiding lodging in irrigated spring wheat. I. Stem and root structural requirements”, Journal homepage: www.elsevier.com/locate/fcr, Bearing a date of Jun. 30, 2016, 12 pages. [cited by applicant]
Motoaki Sano et al. “Estimation of water stress of plant by vibration measurement of leaf using acoustic radiation force”, Acoust. Sci. & Tech. 36, 3 (Bearing a date of 2015), 6 pages. [cited by applicant]
Laser-Doppler Vibrometer Measurements of Leaves, https://link.springer.com/chapter/10.1007/978-3-642-83611-4_1, 6 pages. Springer Nature Switzerland AG. Part of Springer Nature. Bearing a date of 1990. [cited by applicant]
M.J.M. Martens “Laser-Doppler Vibrometer Measurements of Leaves” H.-F. Linskens et al. (eds.), Physical Methods in Plant Sciences © Springer-Verlag Berlin Heidelberg 1990. 2 pages. [cited by applicant]
Classifying plants with ultrasonic sensing. Neil Lindsay Harper and Phillip John MCKerrow, www.araa.asn.au/acra/acra1999/papers/paper31.pd, 6 pages 1999. [cited by applicant]
Manukain et al. “Plant Health Sensing”, Fall 1987, 34 pages. [cited by applicant]
Dionisio Andújar et al., “An Ultrasonic System for Weed Detection in Cereal Crops”, www.mdpi.com/journal/sensors, ISSN 1424-8220, Published: Dec. 13, 2012, 15 pages. [cited by applicant]
Davis, Abe “New Video Technology That Reveals An Object's Hidden Properties” Videohttps://www.ted.com/talks/abe_davis_new_video_technology_that reveals_an_object_s_hidden_properties Ted2015| Bearing a date of Mar. 2015. [cited by applicant]
Elgharib et al., “Video Magnification in Presence of Large Motion” Qatar Computing Research Institute MIT CSAIL 9 pages. 2015. [cited by applicant]
Polytec, “Introduction to 3-D Scanning Vibrometry”, https.//www.youtube.com/watch?v=YWwZU2hgjs8, dated Feb. 25, 2009. [cited by applicant]
Rubinstein, Michael, “See invisible motion, hear silent sounds. Cool? Creepy? We can't decide”, https://www.youtube.com/watch?v=fHfhorJnAEI&t, Dec. 23, 2014. [cited by applicant]
Magal, C. et al. “The Role of Leaf Structure In Vibration Propagation”, 7 pages. 2000. [cited by applicant]
Physical Methods in Plant Sciences, 1990, 112 pages. [cited by applicant]
Nakagawa et al. “Basic study on the detection of the water stress in plant using ultrasonic sound source”. Proceedings of Symposium on Ultrasonic Electronics vol. 36, Nov. 5-7, 2015, 2 pages. [cited by applicant]
“Ag Leader”, retrieved at <http://www.agleader.com/products/directcommand/optrx-crop-sensors>, Available at least as of Aug. 27, 2018, 92 pages. [cited by applicant]