IP Library › Granted Patent US 11,373,406
Granted Patent B2
US 11,373,406 · App. 16/457,818 · Granted Jun 28, 2022

Transmission, caching, and searching of video streams based on frame dependencies and content

Inventors: Ned M. Smith (Beaverton, OR); Yi Zou (Portland, OR); Shao-Wen Yang (San Jose, CA); Gang Shen (Hillsboro, OR)
Assignee: Intel Corporation
G06V20/46G06F16/738G06V20/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,373,406
App. No.
16/457,818
Granted
Jun 28, 2022
Kind
B2
Abstract

In one embodiment, an apparatus comprises processing circuitry to: receive, via a network interface, a video stream comprising a plurality of video frames; identify a plurality of dependencies among the plurality of video frames; identify, based on the plurality of dependencies, a first subset of video frames to be transmitted using a first transmission method and a second subset of video frames to be transmitted using a second transmission method, wherein the first subset of video frames and the second subset of video frames are identified from the plurality of video frames, and wherein the first transmission method provides a higher quality of service than the second transmission method; transmit, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and transmit, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.

Claims (94)

1. An apparatus, comprising:

a network interface to communicate over a network; and

processing circuitry to:

receive, via the network interface, a video stream comprising a plurality of video frames;

identify a plurality of inter-frame dependencies among the plurality of video frames, wherein the plurality of inter-frame dependencies comprises a plurality of frame protection dependencies associated with one or more security protections applied to the video stream;

partition the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies, wherein the first subset of video frames is to be transmitted using a first transmission method and the second subset of video frames is to be transmitted using a second transmission method, wherein the first transmission method provides a higher quality of service than the second transmission method;

transmit, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and

transmit, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.

2. The apparatus of claim 1 , wherein the plurality of inter-frame dependencies further comprises:

a plurality of frame compression dependencies associated with a compression scheme applied to the video stream.

3. The apparatus of claim 1 , wherein the processing circuitry to partition the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies is further to:

determine, based on the plurality of inter-frame dependencies, that the first subset of video frames corresponds to a larger number of dependencies than the second subset of video frames.

4. The apparatus of claim 1 , wherein:

the first transmission method comprises transmitting the first subset of video frames over a first channel having a first quality of service level; and

the second transmission method comprises transmitting the second subset of video frames over a second channel having a second quality of service level;

wherein the first quality of service level is higher than the second quality of service level.

5. The apparatus of claim 1 , wherein:

the first transmission method comprises transmitting a plurality of replicated copies of the first subset of video frames; and

the second transmission method comprises transmitting a single copy of the second subset of video frames.

6. The apparatus of claim 1 , wherein:

the first transmission method comprises transmitting the first subset of video frames to one or more distributed computing devices to be cached, wherein the one or more distributed computing devices are to transmit the first subset of video frames to the corresponding destination; and

the second transmission method comprises transmitting the second subset of video frames to the corresponding destination.

7. The apparatus of claim 6 , wherein the one or more distributed computing devices are associated with:

a blockchain network; or

a distributed hash table.

8. The apparatus of claim 1 , wherein the processing circuitry is further to:

recognize video content in the plurality of video frames based on a video content classifier;

identify one or more video frames comprising sensitive content, wherein the one or more video frames are identified from the plurality of video frames based on the video content recognized by the video content classifier; and

apply one or more security protections to the one or more video frames.

9. At least one non-transitory machine accessible storage medium having instructions stored thereon, wherein the instructions, when executed on a machine, cause the machine to:

receive, via a network interface, a video stream comprising a plurality of video frames;

identify a plurality of inter-frame dependencies among the plurality of video frames, wherein the plurality of inter-frame dependencies comprises a plurality of frame protection dependencies associated with one or more security protections applied to the video stream;

partition the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies, wherein the first subset of video frames is to be transmitted using a first transmission method and the second subset of video frames is to be transmitted using a second transmission method, wherein the first transmission method provides a higher quality of service than the second transmission method;

transmit, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and

transmit, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.

10. The storage medium of claim 9 , wherein the plurality of inter-frame dependencies further comprises:

a plurality of frame compression dependencies associated with a compression scheme applied to the video stream.

11. The storage medium of claim 9 , wherein the instructions that cause the machine to partition the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies further cause the machine to:

determine, based on the plurality of inter-frame dependencies, that the first subset of video frames corresponds to a larger number of dependencies than the second subset of video frames.

12. The storage medium of claim 9 , wherein:

the first transmission method comprises transmitting the first subset of video frames over a first channel having a first quality of service level; and

the second transmission method comprises transmitting the second subset of video frames over a second channel having a second quality of service level;

wherein the first quality of service level is higher than the second quality of service level.

13. The storage medium of claim 9 , wherein:

the first transmission method comprises transmitting a plurality of replicated copies of the first subset of video frames; and

the second transmission method comprises transmitting a single copy of the second subset of video frames.

14. The storage medium of claim 9 , wherein:

the first transmission method comprises transmitting the first subset of video frames to one or more distributed computing devices to be cached, wherein the one or more distributed computing devices are to transmit the first subset of video frames to the corresponding destination; and

the second transmission method comprises transmitting the second subset of video frames to the corresponding destination.

15. The storage medium of claim 9 , wherein the instructions further cause the machine to:

recognize video content in the plurality of video frames based on a video content classifier;

identify one or more video frames comprising sensitive content, wherein the one or more video frames are identified from the plurality of video frames based on the video content recognized by the video content classifier; and

apply one or more security protections to the one or more video frames.

16. A method, comprising:

receiving, via a network interface, a video stream comprising a plurality of video frames;

identifying a plurality of inter-frame dependencies among the plurality of video frames, wherein the plurality of inter-frame dependencies comprises a plurality of frame protection dependencies associated with one or more security protections applied to the video stream;

partitioning the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies, wherein the first subset of video frames is to be transmitted using a first transmission method and the second subset of video frames is to be transmitted using a second transmission method, wherein the first transmission method provides a higher quality of service than the second transmission method;

transmitting, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and

transmitting, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.

17. The method of claim 16 , wherein the plurality of inter-frame dependencies further comprises:

a plurality of frame compression dependencies associated with a compression scheme applied to the video stream.

18. The method of claim 16 , wherein partitioning the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies comprises:

determining, based on the plurality of inter-frame dependencies, that the first subset of video frames corresponds to a larger number of dependencies than the second subset of video frames.

19. The method of claim 16 , wherein:

the first transmission method comprises transmitting the first subset of video frames over a first channel having a first quality of service level; and

the second transmission method comprises transmitting the second subset of video frames over a second channel having a second quality of service level;

wherein the first quality of service level is higher than the second quality of service level.

20. The method of claim 16 , wherein:

the first transmission method comprises transmitting a plurality of replicated copies of the first subset of video frames; and

the second transmission method comprises transmitting a single copy of the second subset of video frames.

21. The method of claim 16 , wherein:

the first transmission method comprises transmitting the first subset of video frames to one or more distributed computing devices to be cached, wherein the one or more distributed computing devices are to transmit the first subset of video frames to the corresponding destination; and

the second transmission method comprises transmitting the second subset of video frames to the corresponding destination.

22. The method of claim 16 , further comprising:

recognizing video content in the plurality of video frames based on a video content classifier;

identifying one or more video frames comprising sensitive content, wherein the one or more video frames are identified from the plurality of video frames based on the video content recognized by the video content classifier; and

applying one or more security protections to the one or more video frames.

23. A system, comprising:

a camera to capture a video stream, wherein the video stream comprises a plurality of video frames;

a network interface to communicate over a network; and

processing circuitry to:

access the video stream captured by the camera;

identify a plurality of inter-frame dependencies among the plurality of video frames, wherein the plurality of inter-frame dependencies comprises a plurality of frame protection dependencies associated with one or more security protections applied to the video stream;

partition the plurality of video frames into a first subset of video frames and a second subset of video frames based on the plurality of inter-frame dependencies, wherein the first subset of video frames is to be transmitted using a first transmission method and the second subset of video frames is to be transmitted using a second transmission method, wherein the first transmission method provides a higher quality of service than the second transmission method;

transmit, via the network interface, the first subset of video frames to a corresponding destination using the first transmission method; and

transmit, via the network interface, the second subset of video frames to the corresponding destination using the second transmission method.

24. The system of claim 23 , wherein:

the first transmission method comprises transmitting the first subset of video frames over a first channel having a first quality of service level; and

the second transmission method comprises transmitting the second subset of video frames over a second channel having a second quality of service level;

wherein the first quality of service level is higher than the second quality of service level.

25. The system of claim 23 , wherein the processing circuitry is further to:

recognize video content in the plurality of video frames based on a video content classifier;

identify one or more video frames comprising sensitive content, wherein the one or more video frames are identified from the plurality of video frames based on the video content recognized by the video content classifier; and

apply one or more security protections to the one or more video frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: SMITH, NED M.; ZOU, YI; YANG, SHAO-WEN; SHEN, GANG
To: INTEL CORPORATION
Reel/Frame 055716/0476 →
Continuity (1)
Related Publication 20190325227A1 · Oct 24, 2019