Client-side video advertisement replacement using automatic content recognition
Systems and method for advertisement replacement are disclosed. A server may receive a server feed, generate a plurality of server fingerprints for a respective plurality of segments of the server feed, receive a synchronization message comprising a client fingerprint and a client time, match the client fingerprint with one of the plurality of server fingerprints, and send a synchronization response indicative of a server time associated with the one of the plurality of server fingerprints.
1. A method comprising:
receiving, at a client device, a client feed comprising media content from a source device;
generating, by the client device, at least one client fingerprint for at least one segment of the received client feed;
sending a synchronization message comprising the at least one client fingerprint from the client device to a server device, wherein the server device is configured to identify a corresponding at least one server fingerprint generated by the server device for a corresponding segment of a server feed that matches the at least one client fingerprint;
receiving, at the client device, a synchronization response from the server device, the synchronization response comprising:
data indicative of a time difference between a server feed time associated with the identified at least one server fingerprint that matches the at least one client fingerprint and a client feed time associated with the at least one client fingerprint; and
an upcoming server time for an upcoming segment to be replaced; and
determining, by the client device, a replacement time of the client feed for the segment to be replaced based on at least the upcoming server time and the time difference; and
replacing, by the client device, the segment to be replaced in the client feed with a replacement advertisement at the replacement time.
2. The method of claim 1 , wherein the synchronization response from the server device further comprises a preceding server fingerprint of at least one frame that immediately precedes the upcoming server segment to be replaced.
3. The method of claim 2 , wherein determining, by the client device, the replacement time of the client feed for the segment to be replaced further comprises:
determining, by the client device, when the client device generates a corresponding preceding client fingerprint of the client feed that matches the preceding server fingerprint received from the server device.
4. The method of claim 1 , wherein the synchronization response from the server device further comprises a length of the segment to be replaced.
5. The method of claim 1 , further comprising:
retrieving, by the client device, the replacement advertisement in response to receiving the synchronization response from the server device.
6. The method of claim 1 , further comprising:
generating, by the client device, a sequence of client fingerprints for segments of the received client feed, each client fingerprint comprising a corresponding segment and a corresponding client feed time indicating when the corresponding segment was received by the client device.
7. The method of claim 6 , further comprising, in response to generating each client fingerprint:
sending a corresponding synchronization message comprising a most recent generated client fingerprint from the client device to the sever device; and
receiving, at the client device, a corresponding synchronization response from the server device.
8. A client device comprising:
a processing device;
a memory in communication with the processing device, wherein the memory stores instructions that, when executed by the processing device, cause the processing device to perform operations comprising:
receiving a client feed comprising media content from a source device;
generating at least one client fingerprint for at least one segment of the received client feed;
sending a synchronization message comprising the at least one client fingerprint from the client device to a server device, wherein the server device is configured to identify a corresponding at least one server fingerprint generated by the server device for a corresponding segment of a server feed that matches the at least one client fingerprint;
receiving a synchronization response from the server device, the synchronization response comprising:
data indicative of a time difference between a server feed time associated with the identified at least one server fingerprint that matches the at least one client fingerprint and a client feed time associated with the at least one client fingerprint; and
an upcoming server time for an upcoming segment to be replaced; and
determining a replacement time of the client feed for the segment to be replaced based on at least the upcoming server time and time difference; and
replacing the segment to be replaced in the client feed with a replacement advertisement at the replacement time.
9. The client device of claim 8 , wherein the synchronization response from the server device further comprises a preceding server fingerprint of at least one frame that immediately precedes the upcoming server segment to be replaced.
10. The client device of claim 9 , wherein determining the replacement time of the client feed for the segment to be replaced further comprises:
determining when the client device generates a corresponding preceding client fingerprint of the client feed that matches the preceding server fingerprint received from the server device.
11. The client device of claim 8 , wherein the synchronization response from the server device further comprises a length of the segment to be replaced.
12. The client device of claim 8 , wherein the operations further comprise:
retrieving the replacement advertisement in response to receiving the synchronization response from the server device.
13. The client device of claim 8 , wherein the operations further comprise:
generating a sequence of client fingerprints for segments of the received client feed, each client fingerprint comprising a corresponding segment and a corresponding client feed time indicating when the corresponding segment was received by the client device;
sending a corresponding synchronization message comprising a most recent generated client fingerprint from the client device to the sever device; and
receiving a corresponding synchronization response from the server device.
14. A non-transitory computer-readable medium comprising instruction which, when executed by a processing device in a client device, cause the processing device to perform operations comprising:
receiving a client feed comprising media content from a source device;
generating at least one client fingerprint for at least one segment of the received client feed;
sending a synchronization message comprising the at least one client fingerprint from the client device to a server device, wherein the server device is configured to identify a corresponding at least one server fingerprint generated by the server device for a corresponding segment of a server feed that matches the at least one client fingerprint;
receiving a synchronization response from the server device, the synchronization response comprising:
data indicative of a time difference between a server feed time associated with the identified at least one server fingerprint that matches the at least one client fingerprint and a client feed time associated with the at least one client fingerprint; and
an upcoming server time for an upcoming segment to be replaced; and
determining a replacement time of the client feed for the segment to be replaced based on at least the upcoming server time and time difference; and
replacing the segment to be replaced in the client feed with a replacement advertisement at the replacement time.
15. The non-transitory computer-readable medium of claim 14 , wherein the synchronization response from the server device further comprises a preceding server fingerprint of at least one frame that immediately precedes the upcoming server segment to be replaced.
16. The non-transitory computer-readable medium of claim 15 , wherein determining the replacement time of the client feed for the segment to be replaced further comprises:
determining when the client device generates a corresponding preceding client fingerprint of the client feed that matches the preceding server fingerprint received from the server device.
17. The non-transitory computer-readable medium of claim 14 , wherein the synchronization response from the server device further comprises a length of the segment to be replaced.
18. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise:
retrieving the replacement advertisement in response to receiving the synchronization response from the server device.
19. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise:
generating a sequence of client fingerprints for segments of the received client feed, each client fingerprint comprising a corresponding segment and a corresponding client feed time indicating when the corresponding segment was received by the client device;
sending a corresponding synchronization message comprising a most recent generated client fingerprint from the client device to the sever device; and
receiving, at the client device, a corresponding synchronization response from the server device.