IP Library Granted Patent US 12,195,031
Granted Patent B2
US 12,195,031 · App. 17/654,247 · Granted Jan 14, 2025

Systems and methods for dynamic data mining during data collection missions

Inventors: Kevin Swanson (Detriot, MI); Christopher Attard (Saline, MI); Matthew Puchalski (Pittsburgh, PA); Daniel Swartz (Pittsburgh, PA)
Assignee: Volkswagen Group of America Investments, LLC
B60W60/00B60W50/06G06F16/26G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,195,031
App. No.
17/654,247
Granted
Jan 14, 2025
Kind
B2
Abstract

Disclosed herein are systems, methods, and computer program products for controlling data collection by resources. The methods comprise: receiving real-world data collected by the resources in accordance with data collection mission (DCM) parameters; receiving user defined DCM goal(s); updating goal(s) for DCM mission(s) based on the real-world data and the user defined DCM goal(s); modifying the data DCM parameter(s) based on the updated goal(s) and which ones of the resources are still available for DCMs; and causing data collection operations (which are currently being performed by the resource(s)) to change in accordance with the modified DCM parameter(s).

Claims (37)

1. A method for controlling data collection by a plurality of resources, comprising:

receiving, by a computing device, real-world data collected by the plurality of resources in accordance with data collection mission parameters, the data collection mission parameters comprising at least one of a first parameter being a target object type and a second parameter being a number of target objects for the target object type for which data is to be collected;

receiving, by the computing device, a user defined data collection mission goal;

updating, by the computing device, a goal for a data collection mission based on the real-world data and the user defined data collection mission goal, the goal being collection of data associated with a particular target object type of a plurality of different target object types;

modifying, by the computing device, at least one of the first and second parameters of the data collection mission parameters based on the updated goal for the data collection mission and which ones of the plurality of resources are still available for data collection missions; and

causing, by the computing device, data collection operations which are currently being performed by at least one of the plurality of resources to change in accordance with the at least one parameter of the data collection mission parameters which was modified.

2. The method according to claim 1 , further comprising using the real-world data collected by the plurality of resources to (i) train a machine learning model to detect objects in perception data or (ii) generate a map.

3. The method according to claim 2 , further comprising using at least one of the machine learning model or map to control movement of an autonomous vehicle.

4. The method according to claim 1 , wherein the goal for the data collection mission is updated by generating at least one value representing a difference between one of the first and second parameters of the data collection mission parameters and a third parameter specified in the user defined data collection mission goals.

5. The method according to claim 4 , further comprising generating a score based on the at least one value.

6. The method according to claim 5 , wherein the at least one value is weighted relative to at least one other value representing a difference between a fourth parameter of the data collection mission parameters and a fifth parameter specified in the user defined data collection mission goals.

7. The method according to claim 5 , further comprising generating a prioritization of the plurality of different target object types based on the score.

8. The method according to claim 7 , further comprising dividing target objects between the plurality of resources based on at least the prioritization.

9. The method according to claim 8 , wherein the at least one of the first and second parameters of the data collection mission parameters is modified in accordance with the dividing.

10. A system, comprising:

a processor;

a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for controlling data collection by a plurality of resources, wherein the programming instructions comprise instructions to:

receive real-world data collected by the plurality of resources in accordance with data collection mission parameters, the data collection mission parameters comprising at least one of a first parameter being a target object type and a second parameter being a number of target objects for the target object type for which data is to be collected;

receive a user defined data collection mission goal;

update a goal for a data collection mission based on the real-world data and the user defined data collection mission goal, the goal being collection of data associated with a particular target object type of a plurality of different target object types;

modify at least one of the first and second parameters of the data collection mission parameters based on the updated goal for the data collection mission and which ones of the plurality of resources are still available for data collection missions; and

cause data collection operations which are currently being performed by at least one of the plurality of resources to change in accordance with the at least one parameter of the data collection mission parameters which was modified.

11. The system according to claim 10 , wherein the goal for the data collection mission is updated by generating at least one value representing a difference between one of the first and second parameters of the data collection mission parameters and a third parameter specified in the user defined data collection mission goals.

12. The system according to claim 11 , wherein the programming instructions comprise instructions to generate a score based on at least one of the at least one value and a total number of targets for all target object types for which data is be collected.

13. The system according to claim 12 , wherein the at least one value is weighted relative to at least one other value representing a difference between a fourth parameter of the data collection mission parameters and a fifth parameter specified in the user defined data collection mission goals.

14. The system according to claim 12 , wherein the programming instructions comprise instructions to:

generate a prioritization of a plurality of different target object types based on the score;

divide target objects between the plurality of resources based on at least the prioritization; and

modify at least one of the first and second parameters of the data collection mission parameters in accordance with how the target objects are divided between the plurality of resources.

15. The system according to claim 10 , wherein the programming instructions comprise instructions to use the real-world data collected by the plurality of resources to (i) train a machine learning model to detect objects in perception data or (ii) generate a map.

16. The system according to claim 15 , wherein the programming instructions comprise instructions to use at least one of the machine learning model or map to control movement of an autonomous vehicle.

17. A non-transitory computer-readable medium that stores instructions that is configured to, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

receiving real-world data collected by the plurality of resources in accordance with data collection mission parameters, the data collection mission parameters comprising at least one of a first parameter being a target object type and a second parameter being a number of target objects for the target object type for which data is to be collected;

receiving a user defined data collection mission goal;

updating a goal for a data collection mission based on the real-world data and the user defined data collection mission goal, the goal being collection of data associated with a particular target object type of a plurality of different target object types;

modifying at least one of the first and second parameters of the data collection mission parameters based on the updated goal for the data collection mission and which ones of the plurality of resources are still available for data collection missions; and

causing data collection operations which are currently being performed by at least one of the plurality of resources to change in accordance with the at least one parameter of the data collection mission parameters which was modified.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2024
From: ARGO AI, LLC
To: VOLKSWAGEN GROUP OF AMERICA INVESTMENTS, LLC
Reel/Frame 069177/0099 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2022
From: SWANSON, KEVIN; ATTARD, CHRISTOPHER; PUCHALSKI, MATTHEW; SWARTZ, DANIEL
To: ARGO AI, LLC
Reel/Frame 059218/0756 →
Continuity (1)
Related Publication 20230286529A1 · Sep 14, 2023
References Cited (83)
US 6850153B1 · Murakami et al. · 2005 [cited by applicant]
US 9194168B1 · Lu et al. · 2015 [cited by applicant]
US 10073449B1 · Sait · 2018 [cited by applicant]
US 11228613B2 · Chang · 2022 [cited by examiner]
US 11397622B2 · Kiraly · 2022 [cited by applicant]
US 20030034873A1 · Chase · 2003 [cited by applicant]
US 20060218085A1 · Schuchardt · 2006 [cited by applicant]
US 20060265235A1 · Schuchardt · 2006 [cited by applicant]
US 20080097731A1 · Lanes · 2008 [cited by applicant]
US 20140108080A1 · Mitchell · 2014 [cited by applicant]
US 20140156327A1 · Cai · 2014 [cited by applicant]
US 20150074013A1 · Schoonmaker et al. · 2015 [cited by applicant]
US 20150142518A1 · Farinha · 2015 [cited by applicant]
US 20150294403A1 · Chu et al. · 2015 [cited by applicant]
US 20160301698A1 · Katara et al. · 2016 [cited by applicant]
US 20160321665A1 · Thomas · 2016 [cited by applicant]
US 20170132421A1 · Unitt · 2017 [cited by applicant]
US 20170339031A1 · Hu · 2017 [cited by examiner]
US 20180003512A1 · Lynch · 2018 [cited by examiner]
US 20180004202A1 · Onaga et al. · 2018 [cited by applicant]
US 20180025304A1 · Fisher · 2018 [cited by applicant]
US 20180188042A1 · Chen · 2018 [cited by applicant]
US 20180211541A1 · Rakah et al. · 2018 [cited by applicant]
US 20180216942A1 · Wang · 2018 [cited by examiner]
US 20180356239A1 · Marco · 2018 [cited by applicant]
US 20180356837A1 · Lisewski · 2018 [cited by applicant]
US 20190009794A1 · Toyoda · 2019 [cited by examiner]
US 20190035282A1 · Feguson · 2019 [cited by applicant]
US 20190120640A1 · Ho et al. · 2019 [cited by applicant]
US 20190179336A1 · Colijn et al. · 2019 [cited by applicant]
US 20190222986A1 · Aitken · 2019 [cited by applicant]
US 20190228375A1 · Laury et al. · 2019 [cited by applicant]
US 20190266897A1 · Turato · 2019 [cited by applicant]
US 20190318028A1 · Cao · 2019 [cited by applicant]
US 20200033847A1 · Way · 2020 [cited by applicant]
US 20200089221A1 · Bilous · 2020 [cited by applicant]
US 20200116509A1 · Sakaguchi · 2020 [cited by examiner]
US 20200116515A1 · Chadha et al. · 2020 [cited by applicant]
US 20200118075A1 · Yang et al. · 2020 [cited by applicant]
US 20200128101A1 · Meng · 2020 [cited by applicant]
US 20200160709A1 · Ramot · 2020 [cited by applicant]
US 20200173808A1 · Beaurepaire et al. · 2020 [cited by applicant]
US 20200191589A1 · Tamai et al. · 2020 [cited by applicant]
US 20200209002A1 · Hou et al. · 2020 [cited by applicant]
US 20200241869A1 · Niemiec · 2020 [cited by applicant]
US 20200314089A1 · Iasynetskyi · 2020 [cited by applicant]
US 20200334637A1 · Turner · 2020 [cited by applicant]
US 20200344470A1 · Shen · 2020 [cited by applicant]
US 20200365015A1 · Nguyen · 2020 [cited by applicant]
US 20200372428A1 · Liu et al. · 2020 [cited by applicant]
US 20200380629A1 · Monteil et al. · 2020 [cited by applicant]
US 20200386558A1 · DeLizio · 2020 [cited by applicant]
US 20200396227A1 · Fan et al. · 2020 [cited by applicant]
US 20210033416A1 · Vladimerou · 2021 [cited by examiner]
US 20210035450A1 · Gao · 2021 [cited by applicant]
US 20210074163A1 · Robeson · 2021 [cited by applicant]
US 20210090025A1 · Bolton · 2021 [cited by applicant]
US 20210192405A1 · Bristow · 2021 [cited by applicant]
US 20210192962A1 · Bristow · 2021 [cited by applicant]
US 20210224413A1 · Gulas · 2021 [cited by applicant]
US 20210233390A1 · Georgiou · 2021 [cited by examiner]
US 20210241625A1 · Elisha · 2021 [cited by applicant]
US 20210309248A1 · Choe · 2021 [cited by examiner]
US 20220057810A1 · Ha · 2022 [cited by applicant]
US 20220058309A1 · Safira · 2022 [cited by applicant]
US 20220063662A1 · Sprunk · 2022 [cited by examiner]
US 20220292451A1 · Massey · 2022 [cited by applicant]
US 20220365530A1 · Foster · 2022 [cited by applicant]
US 20220412764A1 · Wu · 2022 [cited by applicant]
US 20230015884A1 · Cao · 2023 [cited by applicant]
US 20230290966A1 · Foster · 2023 [cited by applicant]
US 20230085943A1 · Karri · 2023 [cited by applicant]
US 20230086061A1 · Srivastava et al. · 2023 [cited by applicant]
US 20230156464A1 · Faccin · 2023 [cited by applicant]
US 20230205181A1 · Kishikawa · 2023 [cited by applicant]
WO WO2019153082A1 · 2019 [cited by examiner]
WO 2019213415A1 · 2019 [cited by applicant]
WO 2020228949A1 · 2020 [cited by applicant]
PCT/ISA/220 and PCT/ISA/237, International Search Report and Written Opinion for PCT/US2022/070560 dated Jun. 23, 2022, 15 pages. [cited by applicant]
Tanner, S. et al., On-board data mining, Jul. 30, 2009. [cited by applicant]
International Search Report and Writen Opinion for PCT/US2023/063542 dated May 30, 2023, 13 pages. [cited by applicant]
Distributed Multi-AUV Coordination in Naval Mine Countermeasure Missions Sanem Sariel, Tucker Balch and Jason Stack Jan. 30, 2006. [cited by applicant]
Karamanis et al., Vehicle redistribution in ride-sourcing market using convex minimum cost flows, 2021. [cited by applicant]