Edge processing of sensor data using a neural network to reduce data traffic on a communication network
View Patent ↗Methods, systems, and apparatuses related to edge processing of sensor data using a neural network to reduce network traffic to and/or from a server. In one approach, a cloud server processes sensor data from a vehicle using an artificial neural network (ANN). The ANN has several layers. Based on analyzing at least one characteristic of the sensor data received from the vehicle and/or a context associated with processing the sensor data, the cloud server determines to send one or more of the layers of the ANN for edge processing on the vehicle itself. In other cases, the cloud server decides to send the one or more layers to an edge server device located on a communication path between the vehicle and the cloud server. The edge processing reduces network data traffic.
1 . A system comprising:
at least one memory configured to store an artificial neural network (ANN) having a plurality of trained portions including a first portion; and
at least one processing device configured to:
receive first sensor data from at least one sensing device of a vehicle;
store the first sensor data in the memory;
generate a first output from the ANN using the first sensor data as an input; and
select, based on the first output, the first portion of the ANN to send to the vehicle, wherein the first portion is selected based on a type or characteristic of the first sensor data;
wherein the first sensor data is a first input vector.
2 . The system of claim 1 , wherein the ANN comprises a plurality of layers, and the first portion is one or more of the layers.
3 . The system of claim 1 , wherein the first portion is selected based on determining a probability that the vehicle will upload third sensor data from the at least one sensing device for processing using the ANN.
4 . The system of claim 1 , wherein the first sensor data corresponds to an image collected by an image sensor of the vehicle.
5 . The system of claim 1 , wherein the processing device is further configured to: receive, from a computing device, an intermediate result, wherein the computing device is configured to provide the intermediate result based on processing the first sensor data, and wherein the intermediate result comprises at least one of an identification of an object in an image, or a classification of the object.
6 . The system of claim 5 , wherein the intermediate result is a first output vector.
7 . The system of claim 1 , wherein the processing device is further configured to perform processing of third sensor data from the vehicle using the first portion based on determining whether the third sensor data will be used as an input to the ANN in processing by the processing device.
8 . The system of claim 5 , wherein the at least one processing device is further configured to:
provide, by processing the intermediate result using a second portion of the ANN, an output.