Method and system for performing a storage tier operation on video data using a data processing unit
A method for processing video data is performed by a data processing unit (DPU). The method includes obtaining, by the DPU of an edge device, video data; processing the video data to obtain video data chunks and video processing engine outcomes; generating storage tier metadata based on the video data chunks and the video processing engine outcomes; associating the storage tier metadata with the video data chunks; and storing the storage tier metadata and the video data chunks in the appropriate storage based on the storage tier metadata.
1. A method for processing video data, the method comprising:
obtaining, by a data processing unit (DPU) of an edge device, video data;
processing the video data to obtain video data chunks and video processing engine outcomes;
generating storage tier metadata based on the video data chunks and the video processing engine outcomes;
associating the storage tier metadata with the video data chunks; and
storing the storage tier metadata and the video data chunks in the appropriate storage based on the storage tier metadata.
2. The method of claim 1 , wherein storing the storage tier metadata and the video data chunks comprises:
storing the storage tier metadata in persistent storage of the edge device; and
storing the video data chunks and a copy of the storage tier metadata in appropriate storages of a backup storage based on the storage tier metadata, wherein the backup storage comprises primary storage, secondary storage, and archival storage.
3. The method of claim 2 , wherein the storage tier metadata specifies whether a video data chunk is to be stored in the primary storage, the secondary storage, or the archival storage.
4. The method of claim 1 , wherein processing the video data comprises applying at least one data analytics models to the video data.
5. The method of claim 4 , wherein the at least one data analytics model generates the video data chunks and the video processing engine outcomes.
6. The method of claim 1 , wherein the video data comprises at least one selected from a group consisted of:
video data obtained from a video camera; and
video data stored in a backup storage.
7. The method of claim 6 , wherein the video camera is connected to the edge device with a local connection and the backup storage is connected to the edge device with a non-local connection.
8. A system for processing video data, comprising:
a backup storage operatively connected to an edge device comprising:
primary storage,
secondary storage, and
archival storage;
a video camera operatively connected to the edge device and configured to generate video data;
the edge device comprising a data processing unit (DPU), wherein the DPU is configured to perform a method, the method comprising:
obtaining, by a data processing unit (DPU) of an edge device, video data;
processing the video data to obtain video data chunks and video processing engine outcomes;
generating storage tier metadata based on the video data chunks and the video processing engine outcomes;
associating the storage tier metadata with the video data chunks; and
storing the storage tier metadata and the video data chunks in the appropriate storage based on the storage tier metadata.
9. The system of claim 8 , wherein obtaining the video data comprises obtaining the video data obtained from the video camera.
10. The system of claim 8 , wherein obtaining the video data comprises obtaining the video data stored in the backup storage.
11. The system of claim 8 , wherein the video camera is operatively connected to the edge device with a local connection and the backup storage is operatively connected to the edge device with a non-local connection.
12. The system of claim 11 , wherein the local connection is a local wireless connection.
13. The system of claim 11 , wherein the local connection is a local wired connection.
14. The system of claim 11 , wherein the non-local connection is a network connection over a wide area network.
15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for processing video data, the method comprising:
obtaining, by a data processing unit (DPU) of an edge device, video data;
processing the video data to obtain video data chunks and video processing engine outcomes;
generating storage tier metadata based on the video data chunks and the video processing engine outcomes;
associating the storage tier metadata with the video data chunks; and
storing the storage tier metadata and the video data chunks in the appropriate storage based on the storage tier metadata.
16. The non-transitory computer readable medium of claim 15 , wherein storing the storage tier metadata and the video data chunks comprises:
storing the storage tier metadata in persistent storage of the edge device; and
storing the video data chunks and copies of the storage tier metadata in appropriate storages of a backup storage based on the storage tier metadata, wherein the backup storage comprises primary storage, secondary storage, and archival storage.
17. The non-transitory computer readable medium of claim 16 , wherein the storage tier metadata specifies whether a video data chunk is to be stored in primary storage, secondary storage, or archival storage.
18. The non-transitory computer readable medium of claim 15 , wherein processing the video data comprises applying at least one data analytics models to the video data.
19. The non-transitory computer readable medium of claim 18 , wherein the at least one data analytics model generates the video data chunks and the video processing engine outcomes.
20. The non-transitory computer readable medium of claim 15 , wherein the video data comprises at least one selected from a group consisted of:
video data obtained from a video camera; and
video data stored in a backup storage.