LIVE VIDEO STREAMING ARCHITECTURE WITH REAL-TIME FRAME AND SUBFRAME LEVEL LIVE WATERMARKING
A live media streaming architecture with real-time live watermarking wherein watermarks are added at a frame or subframe level. The architecture can use a UDP/WebRTC architecture, without requiring a content delivery network, which is not dependent on transmitting media by segments, thus allowing insertion of the watermark at a frame or subframe level. By inserting watermarks at a frame or subframe level, latency is minimized for media delivery to under 500 milliseconds (ms) and for extraction to about five to fifteen seconds.
1 . A live media streaming architecture with real-time watermarking, comprising:
a processor having an input receiving a real-time live digital media steam and an input defining a payload for a watermark, the processor including a watermarking module that applies the watermark, including at least a portion of the payload, to individual frames of the digital media stream, such that individual portions of the payload are applied to a frame or sub frame level; and
an edge device transmitting differently watermarked digital media streams as live media streams based on the output of the watermarking module to respective different subscriber devices among a plurality of subscriber devices.
2 . The live media streaming architecture of claim 1 , wherein the watermarking library, when applying a watermark to a stream, introduces less than about 500 millisecond of latency to delivery of the stream.
3 . The live media streaming architecture of claim 1 , wherein the watermarking library generates a first version of a subframe with a first watermark and a second version of a subframe with a second watermark, and wherein the edge device delivers a first stream to a first subscriber device with a first sequence of versions of subframes and a second stream to a second subscriber device with a second sequence of versions of subframes different from the first sequence.
4 . The live media streaming architecture of claim 1 , wherein the watermarking library generates a first version of a frame with a first watermark and a second version of a frame with a second watermark, and wherein the edge device delivers a first stream to a first subscriber device with a first sequence of versions of frames and a second stream to a second subscriber device with a second sequence of versions of frames different from the first sequence.
5 . The live media streaming architecture of claim 1 , wherein the digital media stream comprises an audio stream, wherein a frame of the audio stream is marked with the watermark.
6 . The live media streaming architecture of claim 1 , wherein the digital media stream comprises a video stream, wherein a frame of the video stream is marked with the watermark.
7 . The live media streaming architecture of claim 1 , wherein the digital media stream comprises both a video stream and an audio stream, wherein frames of both the audio stream and the video stream are marked with the watermark.
8 . The live video streaming architecture of claim 1 , wherein a payload of the watermark carries data indicating at least one of a republisher, a subscriber, or metadata about the digital media stream.
9 . A computer system providing extraction of a watermark in digital media transmitted by a live media streaming architecture, comprising a processing system configured to:
receive digital media transmitted from a live media streaming architecture to a subscriber device;
extract a watermark from the received digital media;
determine, based on at least the watermark, whether the digital media is authorized; and
take an action with respect to transmission by the live media streaming architecture to the subscriber device based on the determination;
wherein the extraction occurs in less than fifteen seconds from a time of transmission by the live media streaming architecture to the subscriber device.
10 . The computer system of claim 9 , wherein the extraction is performed in at least one of blind, non-blind, or informed extraction modes.
11 . The computer system of claim 9 , wherein the extraction is performed using a computer program library having an application interface enabling the computer program library to be linked to and used by another computer program.
12 . A live media streaming architecture with real-time watermarking, comprising:
a processor having an input receiving a digital media steam and an input defining a payload for a watermark, the processor including a watermarking module that applies the watermark, including at least a portion of the payload, to individual frames of the digital media stream, such that each watermarked frame is produced with a latency of less than about 500 milliseconds; and
an edge device transmitting differently watermarked digital media streams based on the output of the watermarking module to respective different subscriber devices among a plurality of subscriber devices.