System for facilitating multi-level stream-based edge analytics in multi modal communication and method thereof

1 . A device for facilitating multi-level stream-based edge analytics in multi-modal communication, comprising:

a memory;

an input/output (I/O) interface communicatively coupled with the memory; and

a processing unit communicatively coupled with the memory and the I/O interface, the processing unit configured to:

receive a plurality of data streams related to a multimodal application from one or more data sources via the I/O interface;

generate at least one primary data stream and at least one secondary data stream by processing the received plurality of data streams based on type of the multimodal application and on input requirements received from an edge analytic server, wherein the primary data stream is sufficient to perform the edge analytics at the edge analytic server, wherein the secondary data stream provides additional information to enhance the edge analytics at the edge analytic server;

determine bandwidth requirements for transmission of each of the at least one primary data stream and at least one secondary data stream;

select one or more network interfaces from a plurality of network interfaces to transmit the at least one primary data stream based on traffic characteristics including at least latency and uplink speed of the plurality of network interfaces and the bandwidth requirements; and

transmit the at least one primary data stream to the edge analytic server for the edge analytics via the selected one or more network interfaces and transmit the at least one secondary data stream to the edge analytic server for aggregation with the at least one primary data stream to perform advanced edge analytics, the secondary data stream being transmitted without meeting a latency requirement.

2 . The device of claim 1 , wherein the plurality of data streams comprises at least one of: video data stream, audio data stream, and haptic data stream.

3 . The device of claim 1 , wherein the one or more data sources comprises one or more of: at least one camera, at least one microphone, at least one temperature sensor, and at least one actuator.

4 . The device of claim 1 , wherein the type of the multimodal application comprises at least one of: remote care, remote detonation, remote operation, remote maintenance, and remote firefighting,

wherein the at least one primary data stream and at least one secondary data stream are generated by processing the received plurality of data streams based on input requirements of the edge analytic server to perform the edge analytics based on the type of the multimodal application.

5 . The device of claim 1 , wherein the primary data stream comprises one or more of: low-resolution video data stream, medium resolution video data stream, high-resolution video data stream, low sample rate audio data stream, medium sample rate audio data stream, high sample rate audio data stream and haptic data stream.

6 . A method of facilitating multi-level stream-based edge analytics in multi-modal communication, comprising:

receiving a plurality of data streams related to a multimodal application from one or more data sources;

generating at least one primary data stream and at least one secondary data stream by processing the received plurality of data streams based on a type of the multimodal application and on input requirements received from an edge analytic server, wherein the primary data stream is sufficient to perform the edge analytics at the edge analytic server, and wherein the secondary data stream provides additional information to enhance the edge analytics at the edge analytic server;

determining bandwidth requirements for transmission of each of the at least one primary data stream and at least one secondary data stream;

selecting one or more network interfaces from a plurality of network interfaces to transmit the at least one primary data stream based on traffic characteristics including at least latency and uplink speed of the plurality of network interfaces and the bandwidth requirements; and

transmitting the at least one primary data stream to the edge analytic server for the edge analytics via the selected one or more network interfaces and transmitting the at least one secondary data stream to the edge analytic server for aggregation with the at least one primary data stream to perform advanced edge analytics, the secondary data stream being transmitted without meeting a latency requirement.

7 . The method of claim 6 , wherein the plurality of data streams comprises at least one of: video data stream, audio data stream, and haptic data stream.

8 . The method of claim 6 , wherein the type of the multimodal application comprises at least one of: remote care, remote detonation, remote operation, remote maintenance, and remote firefighting,

wherein the at least one primary data stream and at least one secondary data stream are generated by processing the received plurality of data streams based on input requirements of the edge analytic server to perform the edge analytics based on the type of the multimodal application.

9 . The method of claim 6 , wherein the primary data stream comprises one or more of: low-resolution video data stream, medium resolution video data stream, high-resolution video data stream, low sample rate audio data stream, medium sample rate audio data stream, high sample rate audio data stream and a haptic data stream.

10 . A system for multi-level stream-based edge analytics in multi-modal communication, comprises:

an edge analytic server; and

a client device configured to communicate with the edge analytic server, via one or more network interfaces, wherein the client device comprises:

a memory;

an input/output (I/O) interface communicatively coupled with the memory; and

a processing unit communicatively coupled with the memory and the I/O interface, the processing unit configured to:

receive a plurality of data streams related to a multimodal application from one or more data sources via the I/O interface;

generate at least one primary data stream and at least one secondary data stream by processing the received plurality of data streams based on a type of the multimodal application and on input requirements received from the edge analytic server, wherein the primary data stream is sufficient to perform the edge analytics at the edge analytic server, and wherein the secondary data stream provides additional information to enhance the edge analytics at the edge analytic server;

determine bandwidth requirements for transmission of each of the at least one primary data stream and at least one secondary data stream;

select one or more network interfaces from a plurality of network interfaces to transmit the at least one primary data stream based on traffic characteristics including at least latency and uplink speed of the plurality of network interfaces and the bandwidth requirements; and

transmit the at least one primary data stream to the edge analytic server for the edge analytics via the selected one or more network interfaces, and transmit the at least one secondary data stream to the edge analytic server for aggregation with the at least one primary data stream to perform advanced edge analytics, the secondary data stream being transmitted without meeting a latency requirement,

wherein the edge analytic server is configured to:

receive the at least one primary data stream from the client device; and

perform the edge analytics on the received at least one primary data stream.

11 . The system of claim 10 , wherein the edge analytic server is configured to:

receive the at least one secondary data stream from the client device;

aggregate the at least one primary data stream and at least one secondary data stream; and

perform advanced edge analytics on the aggregated data streams.