IP Library Granted Patent US 12,201,048
Granted Patent B2
US 12,201,048 · App. 17/669,020 · Granted Jan 21, 2025

Obtaining and augmenting agricultural data and generating an augmented display showing anomalies

Inventors: Cary S. Hubner (Geneseo, IL); Noel W. Anderson (Fargo, ND); Brandon M. McDonald (Johnston, IA); Nathan Ogden (Mahomet, IL); Brittany Sprabery (Woodinville, WA); Sean A. Mahrt (Le Claire, IA); Sarah L. Schinckel (Ankeny, IA); Mark D. Moran (Urbana, IL)
Assignee: Deere & Company
A01B79/005A01B79/02G05D1/0044G06F3/0482G06F3/0485G06F3/167G06T19/006H04W4/185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,048
App. No.
17/669,020
Granted
Jan 21, 2025
Kind
B2
Abstract

A geographic position of an agricultural machine is captured. Agricultural data is received that corresponds to a geographic position. Georeferenced visual indicia are displayed that are indicative of the received agricultural data.

Claims (68)

1. A computer-implemented method, comprising:

displaying, on a display device, a display of an agricultural surface;

receiving georeferenced intercropping data that is georeferenced to the agricultural surface and identifies a plurality of individual planting locations of intercropped plants, the intercropped plants comprising a first plurality of plants planted on the agricultural surface and a second plurality of plants planted on the agricultural surface;

obtaining plant species data representing a first plant species of the first plurality of plants and a second plant species of the second plurality of plants; and

generating an enhanced display on the display device by enhancing the display of the agricultural surface with a first visual plant species indicator indicative of the first plant species at one or more individual planting locations of the first plurality of plants and a second visual plant species indicator indicative of the second plant species at one or more individual planting locations of the second plurality of plants.

2. The computer-implemented method of claim 1 wherein the intercropped plants comprise at least some plants, of the second plurality of plants, planted in geographic areas on the agricultural surface that reside between at least some plants of the first plurality of plants.

3. The computer-implemented method of claim 1 , and further comprising:

obtaining one or more metrics corresponding to one or more planting locations of the plurality of individual planting locations of the intercropped plants; and

enhancing the display of the agricultural surface by displaying a representation of the one or more metrics on the display.

4. The computer-implemented method of claim 3 , wherein the one or more metrics comprise:

a first metric for the first plant species, and

a second metric for the second plant species, the second metric comprising a different type of metric than the first metric.

5. The computer-implemented method of claim 3 , wherein

the one or more metrics comprise a per-plant metric for a particular plant at a particular plant location on the agricultural surface, and

generating an enhanced display comprises displaying a representation of the per-plant metric at a position on the display that corresponds to the particular plant location on the agricultural surface.

6. The computer-implemented method of claim 3 wherein

the one or more metrics comprise a location-specific sustainability metric corresponding to a geographic location on the agricultural surface, and

generating an enhanced display comprises displaying a sustainability metric indicator, indicative of the location-specific sustainability metric, at a position on the display that corresponds to the geographic location on the agricultural surface.

7. The computer-implemented method of claim 6 wherein the location-specific sustainability metric comprises at least one of:

a crop input carbon footprint, a carbon sequestration value, or a difference between the crop input carbon footprint and the carbon sequestration value.

8. The computer-implemented method of claim 3 wherein

the one or more metrics comprise a crop tillage effect metric indicative of a location-specific crop tillage effect corresponding to a geographic location on the agricultural surface, and

generating an enhanced display comprises displaying a crop tillage effect indicator, indicative of the crop tillage effect metric, at a position on the display that corresponds to the geographic location on the agricultural surface.

9. The computer-implemented method of claim 1 wherein

the first plant species comprises a first crop species,

the second plant species comprises a second crop species,

the georeferenced intercropping data is indicative of a geographic location of a particular plant of the first crop species and a geographic location of a particular plant of the second crop species, and

generating an enhanced display comprises:

identifying a first visual representation corresponding to the particular plant of the first crop species;

identifying a second visual representation corresponding to the particular plant of the second crop species;

displaying the first visual representation at a first position on the display that corresponds to the geographic location of the particular plant of the first crop species; and

displaying the second visual representation at a second position on the display that corresponds to the geographic location of the particular plant of the second crop species.

10. The computer-implemented method of claim 9 and further comprising:

detecting a user selection input selecting the first crop species; and

enhancing the display by displaying, at the geographic location of the second crop species, a replacement display that replaces display of the second visual representation.

11. The computer-implemented method of claim 10 wherein enhancing the display comprises:

displaying, at the geographic location of the second crop species, a display indicative of the location of the second crop species in a non-emergent state.

12. The computer-implemented method of claim 10 wherein enhancing the display comprises:

displaying, at the geographic location of the second crop species, a simulated display of the location of the second crop species without the second crop species.

13. The computer-implemented method of claim 1 , wherein some or all of the first plurality of plants and the second plurality of plants are in a non-emergent state.

14. The computer-implemented method of claim 13 , wherein some or all of the first plurality of plants and the second plurality of plants comprise seeds.

15. An agricultural system, comprising:

at least one processor; and

a data store storing computer executable instructions which, when executed by the at least one processor cause the at least one processor to perform steps comprising:

displaying, on a display device, a display of an agricultural surface;

receiving georeferenced intercropping data that corresponds geographically to the agricultural surface and identifies a plurality of individual planting locations of intercropped plants, the intercropped plants comprising a first plurality of plants of a first plant species planted on the agricultural surface and a second plurality of plants of a second plant species planted on the agricultural surface, wherein at least some plants, of the second plurality of plants, are planted in geographic areas on the agricultural surface that reside between at least some plants of the first plurality of plants; and

generating an enhanced display on the display device by enhancing the display of the agricultural surface with visual indicia, the visual indicia being indicative of the georeferenced intercropping data.

16. The agricultural system of claim 15 wherein receiving georeferenced intercropping data comprises:

generating individual plant treatment location data indicative of a treatment applied relative to individual plant locations of the intercropped plants, and wherein generating an enhanced display comprises displaying, as the visual indicia, treatment indicators, indicative of the individual plant treatment location data.

17. The agricultural system of claim 15 wherein

the first plant species comprises a first crop species,

the second plant species comprises a second crop species, and

generating an enhanced display comprises:

identifying a first visual representation corresponding to the first crop species;

identifying a second visual representation corresponding to the second crop species;

displaying the first visual representation at a first position on the display that corresponds a geographic location of the first crop species; and

displaying the second visual representation at a second position on the display that corresponds a geographic location of the second crop species.

18. The agricultural system of claim 15 wherein receiving georeferenced intercropping data comprises:

generating a per-plant metric for a particular plant at a particular individual plant location, and wherein generating an enhanced display comprises displaying, as the visual indicia, the per-plant metric at the individual plant locations.

19. An agricultural system, comprising:

at least one processor; and

a data store storing computer executable instructions which, when executed by the at least one processor cause the at least one processor to perform steps comprising:

displaying, on a display device, a display of an agricultural surface;

receiving georeferenced intercropping plant data indicative of a plant characteristic of a plurality of different crop species, in a pre-emergent state, planted on the agricultural surface and corresponding geographically to the agricultural surface; and

generating an enhanced display on the display device by enhancing the display of the agricultural surface with visual indicia, the visual indicia being indicative of the georeferenced intercropping plant data.

20. The agricultural system of claim 19 wherein the plurality of different crop species include a first crop species and a second crop species and wherein the data store stores computer executable instructions which, when executed by the at least one processor cause the at least one processor to perform steps further comprising:

detecting a user selection input selecting the first crop species; and

enhancing the display by displaying, at a geographic location of the second crop species, a replacement display that replaces the display of the second crop species.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2022
From: HUBNER, CARY S.; ANDERSON, NOEL W.; MCDONALD, BRANDON M.; OGDEN, NATHAN; SPRABERY, BRITTANY; MAHRT, SEAN A.; SCHINCKEL, SARAH L.; MORAN, MARK D.
To: DEERE & COMPANY
Reel/Frame 058986/0913 →
Continuity (2)
Provisional Application 63231870 · Aug 11, 2021
Related Publication 20230048683A1 · Feb 16, 2023
References Cited (81)
US 6553312B2 · Upadhyaya et al. · 2003 [cited by applicant]
US 7362738B2 · Taube et al. · 2008 [cited by applicant]
US 8321365B2 · Anderson · 2012 [cited by applicant]
US 9282693B2 · Anderson · 2016 [cited by applicant]
US 9668420B2 · Anderson et al. · 2017 [cited by applicant]
US 9740208B2 · Sugumaran et al. · 2017 [cited by applicant]
US 10127725B2 · Kohler et al. · 2018 [cited by applicant]
US 10242499B2 · Bryson et al. · 2019 [cited by applicant]
US 10577103B2 · Cantrell et al. · 2020 [cited by applicant]
US 10638667B2 · Regan et al. · 2020 [cited by applicant]
US 10664518B2 · McKinnon et al. · 2020 [cited by applicant]
US 10666856B1 · Ruechker · 2020 [cited by applicant]
US 10679056B2 · Zemenchik · 2020 [cited by applicant]
US 10719709B2 · Zemenchik · 2020 [cited by applicant]
US 10740987B2 · Scott et al. · 2020 [cited by applicant]
US 10761544B2 · Anderson et al. · 2020 [cited by applicant]
US 10806074B2 · Zemenchik · 2020 [cited by applicant]
US 10808074B2 · Zemenchik · 2020 [cited by applicant]
US 10820478B1 · Ferrari et al. · 2020 [cited by applicant]
US 10885675B1 · Shulman et al. · 2021 [cited by applicant]
US 10888399B2 · Kopelman et al. · 2021 [cited by applicant]
US 10896218B2 · Reyes Martinez et al. · 2021 [cited by applicant]
US 10930065B2 · Grant et al. · 2021 [cited by applicant]
US 10957036B2 · Stueve et al. · 2021 [cited by applicant]
US 20150187109A1 · Mentzer · 2015 [cited by applicant]
US 20170088147A1 · Tentinger et al. · 2017 [cited by applicant]
US 20170090196A1 · Hendron · 2017 [cited by applicant]
US 20170131718A1 · Matsumura et al. · 2017 [cited by applicant]
US 20180224802A1 · Vasavada et al. · 2018 [cited by applicant]
US 20180271027A1 · Funabashi · 2018 [cited by applicant]
US 20190141883A1 · Zemenchik · 2019 [cited by applicant]
US 20190228224A1 · Guo et al. · 2019 [cited by applicant]
US 20190244428A1 · Greenberg et al. · 2019 [cited by applicant]
US 20200107490A1 · Zemenchik · 2020 [cited by applicant]
US 20200146203A1 · Deng · 2020 [cited by applicant]
US 20200150848A1 · Deng · 2020 [cited by applicant]
US 20200230633A1 · Serrat et al. · 2020 [cited by applicant]
US 20200281110A1 · McNichols et al. · 2020 [cited by applicant]
US 20200329632A1 · Yagyu et al. · 2020 [cited by applicant]
US 20200352088A1 · Arnett et al. · 2020 [cited by applicant]
US 20210045362A1 · Gritzman et al. · 2021 [cited by applicant]
US 20210084805A1 · Cozza et al. · 2021 [cited by applicant]
US 20210089027A1 · Dasika · 2021 [cited by applicant]
US 20210185885A1 · Sibley et al. · 2021 [cited by applicant]
US 20210243939A1 · Strnad et al. · 2021 [cited by applicant]
US 20220132828A1 · Kwak et al. · 2022 [cited by applicant]
US 20220256764A1 · Henry et al. · 2022 [cited by applicant]
US 20230000015A1 · Herrmann et al. · 2023 [cited by applicant]
US 20230028706A1 · Watson et al. · 2023 [cited by applicant]
US 20230112376A1 · Strnad et al. · 2023 [cited by applicant]
US 20230136009A1 · Faers et al. · 2023 [cited by applicant]
US 20230343090A1 · Khait et al. · 2023 [cited by applicant]
US 20230371492A1 · Houis · 2023 [cited by applicant]
CN 107181323A · 2017 [cited by applicant]
CN 108257145 · 2018 [cited by applicant]
DE 102019114667A1 · 2020 [cited by applicant]
EP 3418956A4 · 2018 [cited by applicant]
JP 2871609 · 1999 [cited by applicant]
JP 6512463 · 2019 [cited by applicant]
WO WO2012142395A1 · 2012 [cited by applicant]
WO 2017024358A1 · 2017 [cited by applicant]
WO 2017061281A1 · 2017 [cited by applicant]
WO 2018048708A1 · 2018 [cited by applicant]
WO 2019000325 · 2019 [cited by applicant]
WO 20006236A1 · 2020 [cited by applicant]
WO WO2021081428A1 · 2021 [cited by applicant]
Extended European Search Report and Written Opinion issued in European Patent Application No. 22182494.9, dated Dec. 2, 2022, in 07 pages. [cited by applicant]
Extended European Search Report and Written Opinion issued in European Patent Application No. 22182493.1, dated Nov. 24, 2022, in 07 pages. [cited by applicant]
Extended European Search Report and Written Opinion issued in European Patent Application No. 22182492.3, dated Dec. 1, 2022, in 07 pages. [cited by applicant]
U.S. Appl. No. 17/669,027 Final Office Action dated Feb. 8, 2024, 99 pages. [cited by applicant]
https://www.youtube.com/watch?v=Pu5pXadjtFc&t=3333s, 43:00-53:00 minutes—submitted as a transcript. Hyundai x CES | Hyundai Press Conference at CES 2022 61,669 views Streamed live on Jan. 4, 2022. [cited by applicant]
Hridja, Augmented Reality In Agriculture, Dec. 26, 2019, https://www.queppelin.com/augmented-reality-in-agriculture/, 11 pages. [cited by applicant]
Aimee Chanthadavong. AI and gamification being used to help Aussie farmers reduce spray drift impact. May 2, 2021, 5 pages. [cited by applicant]
Farmwise.io website, Apr. 28, 2021, 6 pages. [cited by applicant]
https://www.agritecture.com/blog/2018/11/27/the-hidden-potential-of-augmented-reality-in-farming, Nov. 27, 2018, 5 pages. [cited by applicant]
https://www.precisionplanting.com/products/product/smartdepth, Accessed on Feb. 2, 2022. 10 pages. [cited by applicant]
https://www.farmworks.com/files/manuals/FW_View_English.pdf, Accessed on Feb. 2, 2022, 52 pages. [cited by applicant]
https://www.ssequip.com/pdf/20-20-seed-sense-overview.pdf, Accessed on Feb. 2, 2022, 6 pages. [cited by applicant]
Suprem et al. “A review on application of technology systems, standards and interfaces for agriculture and food sector”, Computer Standards & Interfaces vol. 35, Issue 4, Jun. 2013, pp. 355-364. [cited by applicant]
U.S. Appl. No. 17/669,027 Non Final Office Action dated Aug. 10, 2023, 51 pages. [cited by applicant]
U.S. Appl. No. 17/669,030 Non-Final Office Action dated Jul. 12, 2024, 64 pages. [cited by applicant]