IP Library Granted Patent US 11,252,327
Granted Patent B1
US 11,252,327 · App. 17/080,603 · Granted Feb 15, 2022

Method and system for performing a contextual stitching operation on video data using a data processing unit

Inventors: Ravikanth Chaganti (Bangalore, IN); Dharmesh M. Patel (Round Rock, TX)
Assignee: Dell Products L.P.
H04N5/23229G11B27/031G11B27/10H04L63/0892H04N5/265H04N5/765H04N5/9205H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,252,327
App. No.
17/080,603
Granted
Feb 15, 2022
Kind
B1
Abstract

A method for processing video data is performed by a data processing unit (DPU). The method includes identifying, by the DPU of an edge device, a contextual stitching trigger event; in response to identifying the contextual stitching trigger event: identifying video data chunks, contextual metadata, indexing metadata, and authentication and authorization (AA) metadata associated with the contextual stitching trigger event; generating a virtual blob based on the video data chunks, contextual metadata, indexing metadata, and authentication and authorization AA metadata; making a first determination that a playback request is obtained from a user, wherein the playback request comprises user authentication information; and in response to the first determination: making a second determination that the user authentication information matches the AA metadata; and in response to the second determination; encoding the video data chunks into a single stream and initiating playback for the user.

Claims (85)

1. A method for processing video data, the method comprising:

identifying, by a data processing unit (DPU) of an edge device, a contextual stitching trigger event;

in response to identifying the contextual stitching trigger event:

identifying video data chunks, contextual metadata, indexing metadata, and authentication and authorization (AA) metadata associated with the contextual stitching trigger event;

generating a virtual blob based on the video data chunks, contextual metadata, indexing metadata, and authentication and authorization AA metadata;

making a first determination that a playback request is obtained from a user, wherein the playback request comprises user authentication information; and

in response to the first determination:

making a second determination that the user authentication information matches the AA metadata; and

in response to the second determination;

encoding the video data chunks into a single stream and initiating playback for the user.

2. The method of claim 1 , wherein the contextual stitching trigger event comprises one selected from a group consisted of:

obtaining a contextual stitching request from the user; and

identifying an abnormality during processing of the video data.

3. The method of claim 1 , wherein the virtual blob comprises the indexing metadata, the AA metadata, and the contextual metadata.

4. The method of claim 1 , further comprising:

obtaining a right to be forgotten (RTF) request from a second user, wherein the RTF request is associated with an indexing attribute included in the indexing metadata;

in response to obtaining the RTF request:

identifying the video data chunks, contextual metadata, and the indexing metadata associated with the indexing attribute;

making a third determination that a negative connotation is associated with the video data chunks;

in response to the third determination:

generating a text transcript associated with the video data chunks;

providing the video data chunks to a third user;

making a fourth determination that the third user clears the negative connotation; and

in response to the fourth determination:

deleting the video data chunks associated with the RTF request.

5. The method of claim 4 , wherein the negative connotation is associated with one or more video processing engine outcomes.

6. The method of claim 5 , wherein the video processing engine outcomes comprise one or more outcomes generated by the video processing engine, wherein the video processing engine comprises one or more data analytics models.

7. The method of claim 1 , wherein the contextual metadata comprises contextual information associated with the video data chunks.

8. A system for processing video data, comprising:

a backup storage operatively connected to an edge device;

a video camera operatively connected to the edge device and configured to play video data;

the edge device comprising a data processing unit (DPU), wherein the DPU is configured to perform a method, the method comprising:

identifying, by a data processing unit (DPU) of an edge device, a contextual stitching trigger event;

in response to identifying the contextual stitching trigger event:

identifying video data chunks, contextual metadata, indexing metadata, and authentication and authorization (AA) metadata associated with the contextual stitching trigger event;

generating a virtual blob based on the video data chunks, contextual metadata, indexing metadata, and AA metadata;

making a first determination that a playback request is obtained from a user, wherein the playback request comprises user authentication information; and

in response to the first determination:

making a second determination that the user authentication information matches the AA metadata; and

in response to the second determination

 encoding the video data chunks into a single stream and initiating playback for the user.

9. The system of claim 8 , wherein the video camera is operatively connected to the edge device with a local connection and the backup storage is operatively connected to the edge device with a non-local connection.

10. The system of claim 9 , wherein the local connection is a local wireless connection.

11. The system of claim 9 , wherein the local connection is a local wired connection.

12. The system of claim 9 , wherein the non-local connection is a network connection over a wide area network.

13. The system of claim 8 , wherein the virtual blob comprises the indexing metadata, the AA metadata, and the contextual metadata.

14. The system of claim 8 , wherein the method further comprising:

following encoding the video data chunks into a single stream and initiating playback for the user:

obtaining an right to be forgotten (RTF) request from the user, wherein the RTF request is associated with an indexing attribute included in the indexing metadata;

in response to obtaining the RTF request:

identifying the video data chunks, contextual metadata, and the indexing metadata associated with the indexing attribute;

making a third determination that a negative connotation is associated with the video data chunks;

in response to the third determination:

generating a text transcript associated with the video data chunks;

providing the video data chunks to the user;

making a fourth determination that the user clears the negative connotation; and

in response to the fourth determination:

deleting the video data chunks associated with the RTF request.

15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for processing video data, the method comprising:

identifying, by a data processing unit (DPU) of an edge device, a contextual stitching trigger event;

in response to identifying the contextual stitching trigger event:

identifying video data chunks, contextual metadata, indexing metadata, and authentication and authorization (AA) metadata associated with the contextual stitching trigger event;

generating a virtual blob based on the video data chunks, contextual metadata, indexing metadata, and AA metadata;

making a first determination that a playback request is obtained from a user, wherein the playback request comprises user authentication information; and

in response to the first determination:

making a second determination that the user authentication information matches the AA metadata; and

in response to the second determination

encoding the video data chunks into a single stream and initiating playback for the user.

16. The non-transitory computer readable medium of claim 15 , wherein the contextual stitching trigger event comprises one selected from a group consisted of:

obtaining a contextual stitching request from the user; and

identifying an abnormality during processing of the video data.

17. The non-transitory computer readable medium of claim 15 , wherein the virtual blob comprises the indexing metadata, the AA metadata, and the contextual metadata.

18. The non-transitory computer readable medium of claim 15 , wherein the method further comprising:

obtaining an right to be forgotten (RTF) request from the user, wherein the RTF request is associated with an indexing attribute included in the indexing metadata;

in response to obtaining the RTF request:

identifying the video data chunks, contextual metadata, and the indexing metadata associated with the indexing attribute;

making a third determination that a negative connotation is associated with the video data chunks;

in response to the third determination:

generating a text transcript associated with the video data chunks;

providing the video data chunks to the user;

making a fourth determination that the user clears the negative connotation; and

in response to the fourth determination:

deleting the video data chunks associated with the RTF request.

19. The non-transitory computer readable medium of claim 18 , wherein the negative connotation is associated with one or more video processing engine outcomes.

20. The non-transitory computer readable medium of claim 19 , wherein the video processing engine outcomes comprise one or more outcomes generated by the video processing engine, wherein the video processing engine comprises one or more data analytics models.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0523) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0664 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0434) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0740 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0609) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0570 →
RELEASE OF SECURITY INTEREST AT REEL 054591 FRAME 0471 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0463 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 054475/0609 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0434 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0523 →
SECURITY AGREEMENT Recorded Nov 13, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054591/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2020
From: CHAGANTI, RAVIKANTH; PATEL, DHARMESH M.
To: DELL PRODUCTS LP
Reel/Frame 054185/0781 →
Cited By (1)
US 12,652,444