IP Library › Granted Patent US 12,221,214
Granted Patent B1
US 12,221,214 · App. 18/465,874 · Granted Feb 11, 2025

Drone-based payload management

Inventors: Patrick Soon-Shiong (Los Angeles, CA); John Wiacek (Culver City, CA); Nicholas J. Witchey (Laguna Hills, CA)
Assignee: Nant Holdings IP, LLC
B64D1/16B64U10/16B64U20/70B64U2101/45B64U2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,221,214
App. No.
18/465,874
Granted
Feb 11, 2025
Kind
B1
Abstract

A drone-based payload management system includes at least one drone and a drone controller, the drone(s) having first and second payload bays configured to store first and second payloads, respectively. The drone controller may be coupled with the payload bays and may comprise at least one processor and at least one computer readable memory. The memory(ies) may store software instructions executable by the processor(s) to perform operations including obtaining a location of the drone(s) while the drone(s) is deployed, determining a ground attribute value of a ground surface associated with the location, deriving, based on the ground attribute value, a payload ratio of a first amount of the first payload relative to a second amount of the second payload, and causing the first and second payload bays to release the first amount of the first payload and the second amount of the second payload respectively according to the payload ratio.

Claims (50)

1. A drone-based payload management system comprising:

at least one drone, the at least one drone having a first payload bay and a second payload bay, wherein the first payload bay is configured to store a first payload and the second payload bay is configured to store a second payload; and

a drone controller coupled with the first and second payload bays and comprising at least one processor and at least one computer readable memory, the at least one computer readable memory storing software instructions executable by the at least one processor to perform operations comprising:

obtaining a location of the at least one drone while the at least one drone is deployed;

determining a ground attribute value of a ground surface associated with the location;

deriving, based on the ground attribute value, a payload ratio of a first amount of the first payload relative to a second amount of the second payload;

causing the first and second payload bays to release the first amount of the first payload and the second amount of the second payload respectively according to the payload ratio; and,

after the first and second payload bays have released at least a portion of the first and second amounts, determining a dispersion of one or both of the first and second payloads on the ground surface, the dispersion being an area of actual payload delivery on the ground surface where the one or both of the first and second payloads has been delivered, the dispersion being determined using one or more cameras.

2. The system of claim 1 , wherein the ground attribute value adheres to a ground attribute namespace or ontology.

3. The system of claim 1 , wherein the ground attribute value quantifies one or more attributes selected from the group consisting of: a chemical attribute, an elevation attribute, a slope attribute, a physical attribute, an optical attribute, and a geographical attribute.

4. The system of claim 1 , wherein the at least one drone comprises at least one unmanned aerial vehicle (UAV).

5. The system of claim 1 , wherein at least one of the first amount and the second amount comprises an amount released per unit time or per unit area.

6. The system of claim 1 , wherein the ground attribute value is derived at least in part from an image descriptor.

7. The system of claim 1 , wherein the payload ratio is derived from the ground attribute value via one or more selected from the group consisting of: a lookup table, a function, and a machine learning model.

8. The system of claim 1 , wherein one or both of the first and second payload bays comprises a controllable payload aperture coupled with the drone controller.

9. The system of claim 1 , wherein the location comprises one or more selected from the group consisting of: a geolocation, a zip code, a geofenced area, a Schneider 2 (S2) cell, a grid location, a stationary location, a relative location, a landmark, a simultaneous localization and mapping (SLAM) location, a visual simultaneous localization and mapping (vSLAM) location, a wireless triangulation point, and a position relative to one or more beacons.

10. The system of claim 1 , wherein said obtaining comprises obtaining a location of the at least one drone while the at least one drone is in flight.

11. The system of claim 1 , wherein the first and second amounts are measured by weight.

12. The system of claim 1 , wherein the first and second amounts are measured by volume.

13. The system of claim 1 , wherein the payload ratio is in the range of 1:100 to 1:1.

14. The system of claim 1 , wherein one or both of the first and second payloads comprises seeds.

15. The system of claim 1 , wherein one or both of the first and second payloads comprises spores.

16. The system of claim 1 , wherein one or both of the first and second payloads comprises one or more payloads selected from the group consisting of: fertilizers, insecticides, liquids, powders, slurries, conditioners, worms, biologics, and Mycorrhizal fungi.

17. The system of claim 1 , wherein the second payload comprises calcium carbonate.

18. The system of claim 17 , wherein the second payload comprises oolitic aragonite.

19. The system of claim 1 , further comprising one or more sensors,

wherein the ground attribute value is determined based on an output of at least one sensor from among the one or more sensors.

20. The system of claim 19 , wherein the one or more sensors includes one or more types of sensors selected from the group consisting of: a GPS sensor, an accelerometer, a LIDAR sensor, a RADAR sensor, a camera, a thermometer, a magnetometer, a gyroscope, an inertial measurement unit (IMU), and a spectrometer.

21. The system of claim 19 , wherein the one or more sensors is provided in the at least one drone.

22. The system of claim 1 , wherein the ground attribute value is determined in real-time from a digital representation of the ground surface.

23. The system of claim 1 , wherein the operations further comprise causing one or both of the first and second payload bays to conduct a test release of a portion of the first and second amounts prior to the release of a remainder of the first amount and the second amount, the dispersion being determined based on the test release.

24. The system of claim 1 , wherein said determining the dispersion includes measuring a time from release to when one or both of the first and second payloads reaches the ground.

25. The system of claim 1 , wherein the operations further comprise adjusting release of one or both of the first and second payloads based on the dispersion.

26. The system of claim 1 , wherein the at least one drone further has a third payload bay.

27. The system of claim 1 , wherein the at least one drone comprises a fleet of two or more drones.

28. The system of claim 1 , wherein the first payload bay and the second payload bay are included in the same drone from among the at least one drone.

29. The system of claim 1 , wherein the at least one drone comprises at least one autonomous drone.

30. The system of claim 1 , wherein the ground attribute value is determined at least in part by reference to a previously characterized attribute of the ground surface associated with the location.

31. A drone-based payload management method comprising:

obtaining a location of at least one drone while the at least one drone is deployed, the at least one drone having a first payload bay and a second payload bay, wherein the first payload bay is configured to store a first payload and the second payload bay is configured to store a second payload;

determining a ground attribute value of a ground surface associated with the location;

deriving, based on the ground attribute value, a payload ratio of a first amount of the first payload relative to a second amount of the second payload;

causing the first and second payload bays to release the first amount of the first payload and the second amount of the second payload respectively according to the payload ratio; and

after the first and second payload bays have released at least a portion of the first and second amounts, determining a dispersion of one or both of the first and second payloads on the ground surface, the dispersion being an area of actual payload delivery on the ground surface where the one or both of the first and second payloads has been delivered, the dispersion being determined using one or more cameras.

32. A computer program product comprising one or more non-transitory program storage media on which are stored instructions executable by one or more processors or programmable circuits to perform operations for drone-based payload management, the operations comprising:

obtaining a location of at least one drone while the at least one drone is deployed, the at least one drone having a first payload bay and a second payload bay, wherein the first payload bay is configured to store a first payload and the second payload bay is configured to store a second payload;

determining a ground attribute value of a ground surface associated with the location;

deriving, based on the ground attribute value, a payload ratio of a first amount of the first payload relative to a second amount of the second payload;

causing the first and second payload bays to release the first amount of the first payload and the second amount of the second payload respectively according to the payload ratio; and

after the first and second payload bays have released at least a portion of the first and second amounts, determining a dispersion of one or both of the first and second payloads on the ground surface, the dispersion being an area of actual payload delivery on the ground surface where the one or both of the first and second payloads has been delivered, the dispersion being determined using one or more cameras.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2023
From: NANTWORKS, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 065772/0426 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2023
From: SOON-SHIONG, PATRICK
To: NANT HOLDINGS IP, LLC
Reel/Frame 064934/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2023
From: WITCHEY, NICHOLAS J.; WIACEK, JOHN
To: NANTWORKS, LLC
Reel/Frame 064889/0063 →
References Cited (65)
US 8862285B2 · Wong et al. · 2014 [cited by applicant]
US 9382003B2 · Burema · 2016 [cited by examiner]
US 9852644B2 · Salnikov · 2017 [cited by examiner]
US 10315759B2 · Nemovi et al. · 2019 [cited by applicant]
US 10434451B2 · Witchey · 2019 [cited by applicant]
US 11136243B1 · Soon-Shiong et al. · 2021 [cited by applicant]
US 11181516B2 · Sutton · 2021 [cited by examiner]
US 11210573B2 · Wiacek et al. · 2021 [cited by applicant]
US 11219852B2 · Witchey · 2022 [cited by applicant]
US 11235874B2 · Jones · 2022 [cited by examiner]
US 11440659B2 · Lin · 2022 [cited by examiner]
US 20090007485A1 · Holland · 2009 [cited by examiner]
US 20140303814A1 · Burema · 2014 [cited by examiner]
US 20150302305A1 · Rupp · 2015 [cited by examiner]
US 20160307448A1 · Salnikov · 2016 [cited by examiner]
US 20180158179A1 · Sauder · 2018 [cited by examiner]
US 20180184637A1 · Erickson · 2018 [cited by examiner]
US 20190071177A1 · Zvara · 2019 [cited by examiner]
US 20200122827A1 · Nemovi et al. · 2020 [cited by applicant]
US 20200184214A1 · Casas · 2020 [cited by examiner]
US 20200193589A1 · Peshlov · 2020 [cited by examiner]
US 20200308015A1 · Myers et al. · 2020 [cited by applicant]
US 20210088337A1 · Koubaa · 2021 [cited by applicant]
US 20210180270A1 · Meherg et al. · 2021 [cited by applicant]
US 20210182978A1 · Nissing · 2021 [cited by examiner]
US 20210230815A1 · Meherg et al. · 2021 [cited by applicant]
US 20210253249A1 · Bian · 2021 [cited by examiner]
US 20210321601A1 · Ledebuhr · 2021 [cited by examiner]
US 20220185464A1 · Gharib et al. · 2022 [cited by applicant]
US 20220212792A1 · Gharib et al. · 2022 [cited by applicant]
US 20220227489A1 · Ol et al. · 2022 [cited by applicant]
US 20220297822A1 · Ol et al. · 2022 [cited by applicant]
CN 115158646A · 2022 [cited by examiner]
KR 101694636 · 2017 [cited by applicant]
KR 102504386 · 2023 [cited by applicant]
WO 2020219974 · 2020 [cited by applicant]
WO 2021123951 · 2021 [cited by applicant]
WO WO2022061771A1 · 2022 [cited by examiner]
WO 2022125132 · 2022 [cited by applicant]
WO 2022150833 · 2022 [cited by applicant]
WO 2022159951 · 2022 [cited by applicant]
WO 2022198225 · 2022 [cited by applicant]
WO WO2024028200A1 · 2024 [cited by examiner]
Chandler, David L., “Tackling counterfeit seeds with ‘unclonable’ labels”, retrieved from https://phys.org/news/2023-03-tackling-counterfeit-seeds-unclonable.html, Mar. 22, 2023, Massachusetts Institute of Technology, 3… [cited by applicant]
Habte, Lulit et al., “Synthesis, Characterization and Mechanism Study of Green Aragonite Crystals from Waste Biomaterials as Calcium Supplement”, Sustainability 2020, 12, 5062, http://www.mdpi.com/journal/sustainability… [cited by applicant]
Asabere, Stephen Boahen et al., “Urbanization Leads to Increases in pH, Carbonate, and Soil Organic Matter Stocks of Arable Soils of Kumasi, Ghana (West Africa)”, Frontiers in Environmental Science, Oct. 12, 2018, vol. … [cited by applicant]
Vanderklift, Mathew A. et al. “Using Propagules to Restore Coastal Marine Ecosystems,” Frontiers in Marine Science, Sep. 15, 2020, vol. 7, Article 724, 15 pages. [cited by applicant]
Murison, Malek, “Surprising Facts About Spraying Drones,” https://enterprise-insights.dji.com/blog/spraying-drones-surprising-facts, Dec. 6, 2021, DJI Enterprise, 8 pages. [cited by applicant]
Courtman, C. et al., “Selenium concentration of maize grain in South Africa and possible factors influencing the concentration”, South African Journal of Animal Science 2012, 42 (Issue 5, Supplement 1), pp. 454-458, Sou… [cited by applicant]
DJI Official Website, “AGRAS T20P SPECS”, https://www.dji.com/t20p/specs, retrieved Jun. 19, 2023, 6 pages. [cited by applicant]
“Introducing the Lancaster 5—Your Premium Enterprise Drone”, https://www.precisionhawk.com/blog/media/topic/lancaster-5, Apr. 15, 2016, PrecisionHawk, 4 pages. [cited by applicant]
“Hercules (EA-30X) Technical Specifications”, https://www.eavisionag.com/hercules-ea-30x_p14.html?page=2, retrieved Jun. 19, 2023, Suzhou Eavision Robotic Technologies Co., Ltd., 1 page. [cited by applicant]
“DJI Smartfarm Web”, https://ag.dji.com/smartfarm-web, retrieved Jun. 19, 2023, 6 pages. [cited by applicant]
HG Robotics, “Vetal Tallsitter VTOL Fly Longer and Cover More”, retrieved Jun. 19, 2023, 8 pages. [cited by applicant]
XAG, “XA XP 2020 Agricultural Drone Specs”, https://www.xa.com/en/xp2020/specs, retrieved Jun. 19, 2023, 10 pages. [cited by applicant]
Olick, Diana, “DroneSeed uses swarms of drones to reseed forests after devastating wildfires”, https://www.cnbc.com/2022/06/28/droneseed-uses-swarms-of-drones-to-reseed-forests-after-wildfires.html, Jun. 28, 2022, CNBC,… [cited by applicant]
Signé, Landry et al., “How Africa's new Free Trade Area will turbocharge the continent's agriculture industry”, https://www.weforum.org/agenda/2023/03/how-africa-s-free-trade-area-will-turbocharge-the-continent-s-agricu… [cited by applicant]
XAG, “P Series Plant Protection UAS Specs P30 2019”, https://www.xa.com/en/pseries/p30specs, retrieved Jun. 19, 2023, 2 pages. [cited by applicant]
XAG, “XAG P40 Agricultural Drone Specs”, https://www.xa.com/en/p40/p40specs, retrieved Jun. 19, 2023, 4 pages. [cited by applicant]
XAG, “p100 Specs”, https://www.xa.com/en/p100/p100specs, retrieved Jun. 19, 2023, 6 pages. [cited by applicant]
XAG, “XAG V40 Agricultural Drone Specs”, https://www.xa.com/en/v40/v40specs, retrieved Jun. 1, 2023, 9 pages. [cited by applicant]
TOPTECHTOPIC, “Top 5 Agricultural Drones—Amazing Modern Agriculture”, https://www.youtube.com/watch?v=yrfKPmMz0Zo, Apr. 16, 2022, 4 pages. [cited by applicant]
Caskey, Paul, “Drone Mapping & Scouting—AGVUE Technologies”, 2018 Mid-Atlantic Fruit & Vegetable Convention: Proceedings for the vegetable, potato, greenhouse, small fruit & general sessions, Jan. 30, 2018, pp. 186-187,… [cited by applicant]
Croner, Justin, “EC Mapping: Why Should We Do This?”, 2018 Mid-Atlantic Fruit & Vegetable Convention: Proceedings for the vegetable, potato, greenhouse, small fruit & general sessions, Jan. 30, 2018, pp. 188-189, Pennsy… [cited by applicant]
Non-Final Office Action in U.S. Appl. No. 18/946,285 mailed on Dec. 16, 2024. [cited by applicant]