Audio/video identification watermarking
The invention is directed to marking audio/video (A/V) signals for use in tracing content to a source. An ID controller captures an A/V synchronization fingerprint from a master A/V signal, stores the fingerprint in a data store, and provides signals to an ID encoder to have encoded an identifier into a copy of the master A/V signal. The identifier is encoded to be persistent through actions such as capture, compression, and/or transcoding. In one embodiment, the identifier is encoded as a bit sequence, where each bit is encoded using an encoding technique that is hereinafter called a Mississippi encoding technique. The encoded identifier within the copied A/V signal may later be determined by extracting the fingerprint and comparing it to the stored fingerprint to determine the identifier. The identifier may then be used to trace a source of the copied A/V signal.
1. A system for identifying audio/video content over a network using a computer enabled to perform actions, comprising:
a controller component configured to perform actions, including:
receiving the audio/video content;
determining a master audio/video synchronization fingerprint for the audio/video content that is based on an audio waveform from the audio/video content and a word-count waveform;
determining an identifier or an instruction to determine the identifier; and
sending the identifier or the instruction to another component;
an identification encoding component that is in communication with the controller component and is configured to perform actions, comprising:
receiving the identifier or the instruction;
if the instruction is received, determining a local identifier;
receiving the audio/video content and
modifying at least a portion of an audio/video synchronization fingerprint by adding a plurality of synchronization shifts to the audio/video content to encode the identifier or the local identifier with a timestamp into a copy of the audio/video content during playout, wherein the identifier or the local identifier is determinable by comparing the modified audio/video synchronization fingerprint with the master audio/video synchronization fingerprint, and wherein the identifier or the local identifier is employable for tracing the copy of the audio/video content to a source within a distribution stream.
2. The system of claim 1 , wherein performing the audio synchronization further comprises encoding each bit within a bit sequence of the audio/video content using a Mississippi encoding scheme.
3. The system of claim 2 , wherein the Mississippi encoding scheme further comprises:
encoding of a zero bit as a period of no synchronization change followed by a speeding up of the audio component within the audio/video content with respect to the video component for a time period, followed by a slowing down of the audio component with respect to the video component for the time period; and
encoding a one bit as a period of no synchronization change followed by a slowing down of the audio component with respect to the vide component for the time period, followed by a speeding up of the audio component with respect to the video component for the time period.
4. The system of claim 1 , wherein determining an audio/video synchronization fingerprint further comprises determining the fingerprint from a low pass filtered energy envelope of the audio component of the audio/video content synchronized with a word count from the video component.
5. The system of claim 1 , wherein tracing the copy of the audio/video content to a source further comprises:
determining if the copy of the audio/video content is authorized based in part on a license agreement; and
if the copy is unauthorized, sending a notice of the unauthorized coping to an owner of the identification encoding component; and
if the copy is authorized, sending at least one of a reward, promotion, or discount to the owner of the identification encoding component.
6. A non-transitory computer readable medium that includes instructions, wherein the execution of the instructions provides for identifying an audio/video content by enabling actions, including:
receiving the audio/video content;
determining a master audio/video synchronization fingerprint for the audio/video content based on an audio waveform from the audio/video content and a word-count waveform;
determining a unique identifier; and
modifying at least a portion of an audio/video synchronization fingerprint by adding a plurality of synchronization shifts to the audio/video content using a Mississippi encoding scheme to encode a time stamp with the unique identifier or a local unique identifier into a copy of the audio/video content during playing, wherein the unique identifier or the local unique identifier is determinable by comparing the modified audio/video synchronization fingerprint with the master audio/video synchronization fingerprint, wherein the unique identifier is employable for tracing the copy of the audio/video content to a source within a distribution stream.
7. The non-transitory computer readable medium of claim 6 , wherein determining the unique identifier further comprises:
determining a time associated with the timestamp that is associated with the encoding;
determining an local unique identifier configured that is configured to uniquely identify an encoding component; and
combining the local unique identifier with the timestamp to determine the unique identifier.
8. The non-transitory computer readable medium of claim 6 , wherein the computer readable medium includes instructions for perform actions, further including:
extracting a fingerprint from the copy of the audio/video content using a low pass filtered energy envelope of the audio component synchronized with a word count of the associated video component; and
extracting the unique identifier based on a comparison of the extracted fingerprint to a fingerprint of the received audio/video content.
9. The non-transitory computer readable medium of claim 6 , wherein determining the unique identifier further comprises receiving from another computing device a base identifier useable in determining the unique identifier.
10. A network device for identifying an audio/video content over a network, comprising:
a transceiver to send and receive data over the network; and
a processor that is operative to perform actions, including:
receiving the audio/video content;
determining a master audio/video synchronization fingerprint for the audio/video content based on an audio waveform from the audio/video content and a word-count waveform;
providing at least one of an instruction to determine a unique identifier, or providing the unique identifier over the network to another device, wherein the other device is configured and arranged to modify at least a portion of an audio/video synchronization fingerprint by adding a plurality of synchronization shifts to the audio/video content to encode the unique identifier or a locally determined unique identifier with a timestamp, based on the instruction, into a copy of the audio/video content, wherein the provided unique identifier or the locally determined unique identifier is determinable by comparing the modified audio/video synchronization fingerprint with the master audio/video synchronization fingerprint, and wherein the unique identifier is employable for tracing the copy of the audio/video content to a source within a distribution stream.
11. The network device of claim 10 , wherein encoding the unique identifier further comprises:
encoding into the audio/video content a zero bit as a period of no synchronization change followed by a speeding up of the audio component within the audio/video content with respect to the video component for a time period, followed by a slowing down of the audio component with respect to the video component for the time period; and
encoding into the audio/video content a one bit as a period of no synchronization change followed by a slowing down of the audio component with respect to the video component for the time period, followed by a speeding up of the audio component with respect to the video component for the time period, such that a d.c. component of the audio/video component is substantially unchanged.
12. The network device of claim 10 , further comprising:
receiving the copy of the audio/video content;
extracting a fingerprint from the copy of the audio/video content using a low pass filtered energy envelope of the audio component synchronized with a word count of the associated video component; and
extracting the unique identifier based on a comparison of the extracted fingerprint to a fingerprint of the received audio/video content.
13. The network device of claim 10 , wherein performing an audio synchronization modulation of at least a portion of an audio component of the audio/video content to encode the unique identifier or a locally determined unique identifier, further comprises encoding the unique identifier or the locally determined unique identifier within a plurality of locations of the audio/video content.
14. A computing device that is operative to mark an audio/video content for use in identifying the audio/video content, comprising:
a memory component for storing data; and
a processing component for executing data that enables actions, including:
receiving the audio/video content; and
modifying at least a portion of an audio/video synchronization fingerprint of the audio/video content to encode a unique identifier with a timestamp into a copy of the audio/video content during playing by:
encoding into the audio/video content a zero bit as a period of no synchronization change followed by a speeding up of the audio component within the audio/video content with respect to the video component for a time period, followed by a slowing down of the audio component with respect to the video component for the time period; and
encoding into the audio/video content a one bit as a period of no synchronization change followed by a slowing down of the audio component with respect to the video component for the time period, followed by a speeding up of the audio component with respect to the video component for the time period, wherein the unique identifier is determinable by comparing the modified audio/video synchronization fingerprint with a master audio/video synchronization fingerprint that is based on an audio waveform from the audio/video content and a word-count waveform that corresponds to the received audio/video content, and wherein the unique identifier is employable for tracing the copy of the audio/video content to a source within a distribution stream.
15. The computing device of claim 14 , wherein the unique identifier further comprises the timestamp.
16. The computing device of claim 14 , wherein the encodings are configured to introduce substantially no change to an overall d.c. component of the audio/video content.
17. A method of using a computer to identify an audio/video content over a network, comprising:
receiving the audio/video content at a first computer;
determining a master audio/video synchronization fingerprint for the audio/video content based on an audio waveform from the audio/video content and a word-count waveform;
determining an identifier or an instruction to determine the identifier; and
sending the identifier or the instruction to a second computer;
if the instruction is received by the other component, determining a local identifier;
receiving the audio/video content at the second computer;
modifying at least a portion of an audio/video synchronization fingerprint by adding a plurality of synchronization shifts to the audio/video content to encode the identifier or the local identifier with a timestamp into a copy of the audio/video content during playout;
receiving the copied audio/video content at a third computer;
extracting the identifier from the copied audio/video content based on a comparison of the modified audio/video synchronization fingerprint with the master audio/video synchronization fingerprint; and
if the identifier indicates the copied audio/video content is unauthorized, performing an action.
18. The method of claim 17 , wherein the action further comprises at least one of sending a notice to an owner of the second computer, or inhibiting access to another audio/video content from the first computer.
19. The method of claim 17 , further comprising:
if the identifier indicates that the copied audio/video content is authorized, sending to an owner of the third computer at least one of a discount, a reward, or a promotion.
20. A non-transitory computer-readable storage medium configured to include program instructions that when executed by a processor perform the method of claim 17 .