Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions
View Patent ↗An apparatus comprising a first circuit and a second circuit. The first circuit may be configured to analyze an audio-video data stream to determine watermark appropriate information for the audio-video data stream. The second circuit may be configured to communicate the watermark appropriate information either in-band with or out-of-band from a bit stream communicating the audio-video data.
1. An apparatus comprising:
a first circuit configured to analyze an audio-video data stream to determine watermark appropriate information for said audio-video data stream, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded and said watermark is embedded in said audio-video data during playback by a decoder based upon said watermark appropriate information and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder; and
a second circuit configured to communicate said watermark appropriate information either in-band with or out-of-band from a bit stream comprising said audio-video data.
2. The apparatus according to claim 1 , wherein said watermark appropriate information is communicated out-of-band in one or more of (i) one or more separate files on a medium communicating said audio-video data stream, (ii) a separate bit stream within the medium communicating said audio-video data stream, (iii) one or more separate communication channels, and (iv) one or more different communication media than said audio-video data stream.
3. The apparatus according to claim 1 , wherein analyzing said audio-video data stream comprises a spatial analysis.
4. The apparatus according to claim 1 , wherein analyzing said audio-video data stream comprises a temporal analysis.
5. The apparatus according to claim 1 , wherein analyzing said audio-video data comprises transform domain analysis.
6. The apparatus according to claim 1 , wherein analyzing said audio-video data stream comprises performing two or more analyses selected from the group consisting of spatial analysis, temporal analysis and transform domain analysis.
7. The apparatus according to claim 1 , wherein said watermark appropriate information is determined according to a predetermined perceptual model involving spatial and temporal analysis of the audio-video data in real-time.
8. The apparatus according to claim 1 , wherein said second circuit is further configured to perform a frame-accurate conveyance of said watermark appropriate information.
9. The apparatus according to claim 8 , wherein said second circuit is further configured to convey said watermark appropriate information within the data to which said watermark appropriate information pertains.
10. The apparatus according to claim 8 , wherein said second circuit is further configured to convey said watermark appropriate information in either (i) one or more previous frames or (ii) one or more subsequent frames with respect to a frame to which said watermark appropriate information pertains.
11. The apparatus according to claim 1 , wherein said watermark appropriate information comprises information concerning how to embed said watermark in said audio-video data during decoding of said bit stream.
12. The apparatus according to claim 1 , wherein said watermark appropriate information comprises information for instructing said decoder to embed said watermark based on one or more conditions selected from the group consisting of per player, per download, per playback session and per user.
13. The apparatus according to claim 1 , wherein said second circuit is further configured to communicate information regarding watermark strength and watermark creation embedded in said bit stream.
14. The apparatus according to claim 13 , wherein said information regarding watermark strength and watermark creation comprises information regarding survivability and obtrusiveness.
15. The apparatus according to claim 14 , wherein said information regarding survivability and obtrusiveness is customizable by a content owner on one or both of a per-content basis and a per-player basis.
16. The apparatus according to claim 1 , wherein said bit stream is compliant with an encoding standard selected from the group consisting of MPEG-1, MPEG-2, MPEG-4, WMV, VC-9, VC-1, H.262, H.263, H.264, H.264/JVC/AVC/MPEG-4 part 10, AVS 1.0, Real Networks, Divx Networks, Macromedia and other open or proprietary methods for compression of audio-video data.
17. The apparatus according to claim 1 , wherein said audio-video data stream is not compressed and said watermark appropriate information is stored or communicated with said audio-video data stream.
18. The apparatus according to claim 17 , wherein said watermark appropriate information is communicated via one of a vertical blanking interval (VBI), a horizontal blanking interval (HBI), a sub-picture unit (SPU), one or more chroma bits.
19. A method for watermarking audio-video data comprising the steps of:
performing one or more analyses selected from the group consisting of spatial analysis, temporal analysis and transform domain analysis, on said audio-video data in an encoder; and
communicating a result of said one or more analyses from said encoder to a decoder either in-band with or out-of-band from a bit stream comprising said audio-video data, wherein a watermark is embedded in said audio-video data by said decoder during playback based upon said result of said one or more analyses and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder.
20. The method according to claim 19 , further comprising:
creating a watermark appropriate information database comprising watermark insertion meta data; and
performing forensic or on-the-fly detection of watermarked data based upon watermark insertion meta data retrieved from the database.
21. An apparatus for decoding a compressed bit stream comprising:
a first circuit configured (i) to detect watermark appropriate information communicated in-band with or out-of-band from an audio-video data bit stream and (ii) to extract said watermark appropriate information, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded in said audio-video data by said apparatus during playback; and
a second circuit configured to embed one or more watermarks in said audio-video data at playback based upon said watermark appropriate information and watermark data stored in said apparatus, wherein said watermark data stored in said apparatus is unique to said apparatus.
22. The apparatus according to claim 21 , wherein said apparatus is configured to perform any combination of functions selected from the group consisting of (i) optical disk player, (ii) broadcast receiver for any of digital broadcast satellite, digital cable and digital terrestrial, (iii) point-to-point streaming, (iv) point-to-point download and (v) non-volatile storage reader.
23. The apparatus according to claim 21 , wherein said apparatus is configured to retrieve watermark insertion meta data from a database and perform forensic or on-the-fly detection of watermarked data based upon the watermark insertion meta data.
24. The apparatus according to claim 23 , wherein said apparatus is configured to inspect a watermark overlay using information retrieved from said database.
25. A method for decoding a compressed bit stream comprising:
detecting watermark appropriate information communicated from an encoder either in-band with or out-of-band from an audio-video data bit stream, wherein said watermark appropriate information describes a location within said audio-video data where a watermark can be embedded in said audio-video data by a decoder during playback;
extracting said watermark appropriate information; and
embedding one or more watermarks in said audio-video data during playback using said decoder based on said watermark appropriate information and watermark data stored in said decoder, wherein said watermark data stored in said decoder is unique to said decoder.
26. The method according to claim 25 , wherein said watermark appropriate information is communicated out-of-band in one or more of (i) one or more separate files on a medium communicating said audio-video data stream, (ii) a separate bit stream within the medium communicating said audio-video data stream, (iii) one or more separate communication channels, and (iv) one or more different communication media than said audio-video data stream.
27. The method according to claim 25 , wherein said one or more watermarks are embedded based on one or more conditions selected from the group consisting of per player, per download, per playback session and per user.
28. The apparatus according to claim 1 , wherein the watermark appropriate information does not contain the actual watermark data embedded in the audio-video data.
29. The method according to claim 19 , wherein said watermark identifies a device on which the audio-video data is decoded for playback.
30. The method according to claim 19 , wherein said result of said one or more analyses provides watermark appropriate information that comprises a data vector describing a location within a particular frame where the watermark data can be embedded by the decoder.
31. The apparatus according to claim 1 , wherein the actual watermark data is determined during decoding or playback.