IP Library Granted Patent US 11,892,857
Granted Patent B2
US 11,892,857 · App. 16/893,852 · Granted Feb 6, 2024

Distributed data sampling

Inventors: John Hayes (Mountain View, CA); Volkmar Uhlig (Cupertino, CA); Akash J. Sagar (Redwood City, CA)
Assignee: GHOST AUTONOMY INC.
G05D1/0287G01C21/3453G05B13/029G05D1/0011G05D1/0088G06F16/245G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,892,857
App. No.
16/893,852
Granted
Feb 6, 2024
Kind
B2
Abstract

Distributed data sampling, including: receiving a sampling target; generating, based on one or more sensors, sampled data; determining, based on the sampling target, a value for the sampled data; and determining, based on the value for the sampled data, whether to provide the sampled data to a remotely disposed computing device.

Claims (43)

1. A method for distributed data sampling, comprising:

receiving, by a vehicle, a sampling target, wherein the sampling target comprises a first multidimensional value comprising a first plurality of values associated with sensor data and a second plurality values indicating targeted driving actions, wherein the second plurality of values include a position of a steering wheel and at least one of: an amount of brake applied or an amount of acceleration applied;

generating, by the vehicle, a plurality of portions of sampled data, wherein generating the plurality of portions of sampled data comprises:

generating, for each portion of the sampled data, using one or more sensors of the vehicle, a portion of sensor data; and

generating, for each portion of the sampled data, data indicating driving actions input to the vehicle from a driver when a corresponding portion of the sensor data was generated, wherein the data indicating the driving actions corresponds to the second plurality of values of the sampling target;

wherein each portion of the sampled data is expressed as a second multidimensional value;

determining, of each portion of the sampled data, a degree of similarity between a respective portion of the sampled data and the sampling target, wherein the degree of similarity is based on both the portion of the sensor data and the data indicating the driving actions for the respective portion of the sampled data, wherein the degree of similarity comprises a distance in multidimensional space between the first multidimensional value of the sampling target and the second multidimensional value of the respective portion of the sampled data;

generating a selected set of sampled data comprising a first subset of the plurality of portions of sampled data having degrees of similarity exceeding a threshold;

providing, from the vehicle via a network, the selected set to a remotely disposed computing device; and

deleting, from storage of the vehicle, a remainder of the plurality of portions of sampled data not included in the selected set without providing the remainder to the remotely disposed computing device.

2. The method of claim 1 , further comprising:

determining a cost associated with each portion of the sampled data; and

including, in the selected set, a second subset from the plurality of portions of sampled data having degrees of similarity falling below the threshold and costs falling below another threshold.

3. The method of claim 2 , further comprising optimizing the cost associated with each portion of the sampled data.

4. The method of claim 2 , wherein the cost for each portion of the sampled data is based on one or more of a processing cost for each portion of the sampled data, a transmission cost for each portion of the sampled data, and/or a storage cost for each portion of the sampled data.

5. An apparatus for distributed data sampling, the apparatus configured to perform steps comprising:

receiving, by a vehicle, a sampling target, wherein the sampling target comprises a first multidimensional value comprising a first plurality of values associated with sensor data and a second plurality values indicating targeted driving actions, wherein the second plurality of values include a position of a steering wheel and at least one of: an amount of brake applied or an amount of acceleration applied;

generating, by the vehicle, a plurality of portions of sampled data, wherein generating the plurality of portions of sampled data comprises:

generating, for each portion of the sampled data, using one or more sensors of the vehicle, a portion of sensor data; and

generating, for each portion of the sampled data, data indicating driving actions input to the vehicle from a driver when a corresponding portion of the sensor data was generated, wherein the data indicating the driving actions corresponds to the second plurality of values of the sampling target;

wherein each portion of the sampled data is expressed as a second multidimensional value;

determining, of each portion of the sampled data, a degree of similarity between a respective portion of the sampled data and the sampling target, wherein the degree of similarity is based on both the portion of the sensor data and the data indicating the driving actions for the respective portion of the sampled data, wherein the degree of similarity comprises a distance in multidimensional space between the first multidimensional value of the sampling target and the second multidimensional value of the respective portion of the sampled data;

generating a selected set of sampled data comprising a first subset of the plurality of portions of sampled data having degrees of similarity exceeding a threshold;

providing, from the vehicle via a network, the selected set to a remotely disposed computing device; and

deleting, from storage of the vehicle, a remainder of the plurality of portions of sampled data not included in the selected set without providing the remainder to the remotely disposed computing device.

6. The apparatus of claim 5 , wherein the steps further comprise:

determining a cost associated with each portion of the sampled data; and

including, in the selected set, a second subset from the plurality of portions of sampled data having degrees of similarity falling below the threshold and costs falling below another threshold.

7. The apparatus of claim 6 , wherein the steps further comprise optimizing the cost associated with each portion of the sampled data.

8. The apparatus of claim 6 , wherein the cost for each portion of the sampled data is based on one or more of a processing cost for each portion of the sampled data, a transmission cost for each portion of the sampled data, and/or a storage cost for each portion of the sampled data.

9. The method of claim 1 , wherein the sampling target identifies one or more visual objects.

10. The method of claim 9 , wherein the degree of similarity between the respective portion of the sampled data and the sampling target is based on whether or not the one or more visual objects identified in the sampling target are detected in the respective portion of the sampled data.

11. A method, comprising:

receiving, by a vehicle, a sampling target, wherein the sampling target comprises a first multidimensional value comprising a first plurality of values associated with sensor data and a second plurality values indicating targeted driving actions, wherein the second plurality of values include a position of a steering wheel and at least one of: an amount of brake applied or an amount of acceleration applied;

generating, by the vehicle, a plurality of portions of sampled data, wherein generating the plurality of portions of sampled data comprises:

generating, for each portion of the sampled data using one or more cameras of the vehicle, image data; and

generating, for each portion of the sampled data, data indicating one or more driving actions input to the vehicle from a driver when corresponding portion of the image data was generated, wherein the data indicating the driving actions corresponds to the second plurality of values of the sampling target;

wherein each portion of the sampled data is expressed as a second multidimensional value;

calculating, based on both the image data and the data indicating the one or more driving actions, for each portion of the sampled data, a degree of similarity between a respective portion of the sampled data and the sampling target, wherein the degree of similarity comprises a distance in multidimensional space between the first multidimensional value of the sampling target and the second multidimensional value of the respective portion of the sampled data;

determining that each degree of similarity for a subset of the sampled data meets or exceeds a threshold;

providing, responsive to each degree of similarity for the subset of the sampled data meeting or exceeding the threshold, from the vehicle via a network, the subset of the sampled data to a remotely disposed computing device instead of deleting the subset of the sampled data; and

deleting, from storage of the vehicle, a remainder of the plurality of portions of sampled data not included in the subset without providing the remainder to the remotely disposed computing device.

12. The method of claim 9 , wherein the sampling target indicates one or more distances corresponding to the one or more visual objects.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2024
From: GHOST AUTONOMY, INC.
To: APPLIED INTUITION, INC.
Reel/Frame 068982/0647 →
CHANGE OF NAME Recorded Aug 8, 2022
From: GHOST LOCOMOTION INC.
To: GHOST AUTONOMY INC.
Reel/Frame 061118/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2020
From: HAYES, JOHN; UHLIG, VOLKMAR; SAGAR, AKASH J.
To: GHOST LOCOMOTION INC.
Reel/Frame 052851/0875 →
Continuity (1)
Related Publication 20210382499A1 · Dec 9, 2021