Method and system for indexing video data using a data processing unit
A method for processing video data is performed by a data processing unit (DPU). The method includes obtaining, by the DPU of an edge device, video data; processing the video data to obtain video data chunks and indexing attributes; generating indexing metadata based on the video data chunks and the indexing attributes; processing the video data chunks and indexing attributes to generate contextual attributes; generating contextual metadata based on the contextual attributes and the video data chunks; associating the indexing metadata and the contextual metadata with the video data chunks; and storing the indexing metadata, contextual metadata, and the video data chunks in storage.
1. A method for processing video data, the method comprising:
obtaining, by a data processing unit (DPU) of an edge device, video data;
processing the video data to obtain video data chunks and indexing attributes;
generating indexing metadata based on the video data chunks and the indexing attributes;
processing the video data chunks and indexing attributes to generate contextual attributes;
generating contextual metadata based on the contextual attributes and the video data chunks;
associating the indexing metadata and the contextual metadata with the video data chunks; and
storing the indexing metadata, contextual metadata, and the video data chunks in storage.
2. The method of claim 1 , wherein the video data comprises at least one selected from a group consisted of:
video data obtained from a video camera; and
video data stored in a backup storage.
3. The method of claim 2 , wherein the video camera is connected to the edge device with a local connection and the backup storage is connected to the edge device with a non-local connection.
4. The method of claim 1 , wherein storing the indexing metadata, contextual metadata, and the video data chunks comprises:
storing the indexing metadata and the contextual metadata in persistent storage of the edge device; and
storing the video data chunks and copies of the indexing metadata and contextual metadata in a backup storage.
5. The method of claim 1 , further comprising:
following the storing of the indexing metadata, contextual metadata, and the video data chunks in storage:
obtaining, by the DPU, a video search request from a user, wherein the video search request specifies an indexing attribute of the indexing attributes;
identifying the indexing metadata associated with the indexing attribute; and
obtaining, from a backup storage, the video data chunks based on the indexing metadata.
6. The method of claim 1 , wherein processing the video data comprises applying at least one data analytics models to the video data.
7. The method of claim 6 , wherein the at least one data analytics model generates the video data chunks, the indexing attributes, and the contextual attributes.
8. A system for processing video data, comprising:
a backup storage operatively connected to an edge device;
a video camera operatively connected to the edge device and configured to generate video data;
the edge device comprising a data processing unit (DPU), wherein the DPU is configured to perform a method, the method comprising:
obtaining the video data;
processing the video data to obtain video data chunks and indexing attributes;
generating indexing metadata based on the video data chunks and the indexing attributes;
processing the video data chunks and indexing attributes to generate contextual attributes;
generating contextual metadata based on the contextual attributes and the video data chunks;
associating the indexing metadata and the contextual metadata with the video data chunks; and
storing the indexing metadata, contextual metadata, and the video data chunks in the backup storage.
9. The system of claim 8 , wherein obtaining the video data comprises obtaining the video data obtained from the video camera.
10. The system of claim 8 , wherein obtaining the video data comprises obtaining the video data stored in the backup storage.
11. The system of claim 8 , wherein the video camera is operatively connected to the edge device with a local connection and the backup storage is operatively connected to the edge device with a non-local connection.
12. The system of claim 11 , wherein the local connection is a local wireless connection.
13. The system of claim 11 , wherein the local connection is a local wired connection.
14. The system of claim 11 , wherein the non-local connection is a network connection over a wide area network.
15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for processing video data, the method comprising:
obtaining, by a data processing unit (DPU) of an edge device, video data;
processing the video data to obtain video data chunks and indexing attributes;
generating indexing metadata based on the video data chunks and the indexing attributes;
processing the video data chunks and indexing attributes to generate contextual attributes;
generating contextual metadata based on the contextual attributes and the video data chunks;
associating the indexing metadata and the contextual metadata with the video data chunks; and
storing the indexing metadata, contextual metadata, and the video data chunks in storage.
16. The non-transitory computer readable medium of claim 15 , wherein the video data comprises at least one selected from a group consisted of:
video data obtained from a video camera; and
video data stored in a backup storage.
17. The non-transitory computer readable medium of claim 16 , wherein the video camera is connected to the edge device with a local connection and the backup storage is connected to the edge device with a non-local connection.
18. The non-transitory computer readable medium of claim 15 , wherein storing the indexing metadata, contextual metadata, and the video data chunks comprises:
storing the indexing metadata and the contextual metadata in persistent storage of the edge device; and
storing the video data chunks and copies of the indexing metadata and contextual metadata in a backup storage.
19. The non-transitory computer readable medium of claim 15 , wherein the method further comprising: following the storing of the indexing metadata, contextual metadata, and the video data chunks in storage:
obtaining, by the DPU, a video search request from a user, wherein the video search request specifies an indexing attribute of the indexing attributes;
identifying the indexing metadata associated with the indexing attribute; and
obtaining, from a backup storage, the video data chunks based on the indexing metadata.
20. The non-transitory computer readable medium of claim 15 , wherein processing the video data comprises applying at least one data analytics models to the video data.