Use of steganographically-encoded time information as basis to establish a time offset, to facilitate taking content-related action
A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the stream, the watermark encoding a timestamp of the respective time-point within the stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
1. A non-transitory computer-readable medium embodying program instructions executable by a processing unit to carry out operations while a client is processing one or more linear media streams for presentation, each of the one or more linear media streams defining a respective time sequence of frames of media content, and at least one of the linear media streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock, the operations comprising:
extracting the timestamp from the watermark,
computing a time offset based on a difference between the extracted timestamp and a current time according to a client clock, and
using the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
2. The non-transitory computer-readable medium of claim 1 , wherein computing the time offset based on the difference between the extracted timestamp and the current time according to the client clock comprises computing the time offset as the difference.
3. The non-transitory computer-readable medium of claim 1 , wherein the at least one linear media stream is steganographically encoded with multiple watermarks each at a respective media-stream time-point and each encoding a respective timestamp of the respective media-stream time-point according to the server clock, the operations further comprising:
extracting from each of the multiple watermarks the respective timestamp, and
computing multiple time offsets including, respectively for each extracted respective timestamp, a respective time offset between the extracted respective timestamp and a respective current time according to the client clock,
wherein computing the time offset based on a difference between the extracted timestamp and the current time according to the client clock comprises computing a statistical representation of the multiple computed time offsets.
4. The non-transitory computer-readable medium of claim 3 , wherein the statistical measure comprises an average.
5. The non-transitory computer-readable medium of claim 1 , wherein the content-related action comprises dynamic content modification.
6. The non-transitory computer-readable medium of claim 5 , wherein the content-related action comprises dynamic ad replacement.
7. The non-transitory computer-readable medium of claim 5 , wherein the operations further comprise:
receiving from a server a directive for the client to carry out the content-related action in the given linear media stream, the directive specifying an action time point when the client should carry out the content-related action, the action time point being defined according to the server clock,
wherein using by the client the computed time offset as a basis to determine when the client should carry out the content-related action in the given linear media stream comprises applying the computed time offset as a basis to translate the specified action time point into an associated client time point according to the client clock.
8. The non-transitory computer-readable medium of claim 7 , wherein the applying the computed time offset as the basis to translate the specified action time point into the associated client time point according to the client clock comprises adding the computed time offset to the specified action time point.
9. The non-transitory computer-readable medium of claim 7 , wherein processing the one or more linear media streams for presentation comprises receiving each of the one or more linear media streams distributed by a content distribution system, wherein the server clock defines time according to the content distribution system.
10. The non-transitory computer-readable medium of claim 7 , further comprising: generating query fingerprints representing the given linear media stream; and transmitting, from the client to the server, the generated query fingerprints to enable the server to identify the given linear media stream.
11. A non-transitory computer-readable medium embodying program instructions executable by a processing unit to carry out operations while a client is receiving an ongoing media stream that includes watermarks steganographically encoding server-timestamps of portions of the media stream from a time perspective of a server, the operations comprising, for each of one or more of the steganographically encoded watermarks in the media stream being received by the client:
extracting the server-timestamp encoded by the watermark,
comparing the extracted server-timestamp with a respective client-time from a time perspective of the client, to compute a time offset useable as a basis to determine when the client should carry out a content-related action.
12. The non-transitory computer-readable medium of claim 11 , wherein the content-related action comprises dynamic content modification.
13. The non-transitory computer-readable medium of claim 12 , wherein the dynamic content modification is responsive to fingerprint-based automatic content recognition.
14. The non-transitory computer-readable medium of claim 11 , wherein the client is a television.
15. A media client comprising:
a content input interface;
a content presentation interface;
a network communication interface;
a processing unit;
non-transitory data storage; and
program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations including:
receiving an ongoing media stream that includes watermarks steganographically encoding server-timestamps of portions of the media stream from a time perspective of a sever, and
for each of one or more of the steganographically encoded watermarks in the media stream being received, extracting the server-timestamp encoded by the watermark and comparing the extracted server-timestamp with a respective client-time from a time perspective of the media client, to compute a time offset useable by the media client as a basis to determine when the media client should carry out a content-related action.
16. The media client of claim 15 , wherein the media client is a television.
17. The media client of claim 15 , wherein receiving an ongoing media stream comprises receiving the ongoing media streams distributed by a content distribution system, wherein the server clock defines time according to the content distribution system.
18. The media client of claim 15 , wherein the content-related action comprises dynamic content modification.
19. The media client medium of claim 18 , wherein the content-related action comprises dynamic ad replacement.
20. The media client of claim 19 , wherein the dynamic content modification is responsive to fingerprint-based automatic content recognition.