Fingerprint layouts for content fingerprinting
A method is disclosed for identifying the media content. The method includes receiving fingerprint media content from a content provider to obtain a first set of fingerprints, the first set of fingerprints including a first subset of fingerprints in a first fingerprint layout and a second subset of fingerprints in a second fingerprint layout. The method can include receiving a second set of fingerprints for media content displayed on the electronic device, the second set of fingerprints comprising a third subset of fingerprints in the first fingerprint layout and a fourth subset of fingerprints in the second fingerprint layout. The method can include matching a first fingerprint in the first subset of fingerprints to a second fingerprint in the third subset of fingerprints or a third fingerprint in the second subset of fingerprints to a fourth fingerprint in the fourth subset of fingerprints in order to identify the media content.
1. A server comprising:
a memory;
a processing device coupled to the memory, wherein the processing device is configured to execute an automatic content recognition (ACR) system, wherein the ACR system comprises a first interface configured to communicate with a media content provider of a network connection, a second interface configured to communicate with a reference database, and a third interface configured to communicate with a television (TV), and wherein the ACR system is configured to:
receive frames of media content via the first interface;
fingerprint a frame of the media content based on pixel luminance to obtain a first set of fingerprints, the first set of fingerprints comprising a first fingerprint corresponding to a first fingerprint layout and a second fingerprint corresponding to a second fingerprint layout;
store the first set of fingerprints at the reference database;
receive, via the third interface, a second set of fingerprints based on pixel luminance for frames of media content displayed on the TV, the second set of fingerprints comprising a third fingerprint corresponding to in the first fingerprint layout and a fourth fingerprint corresponding to the second fingerprint layout;
match at least one of the first fingerprint or the second fingerprint of the first set of fingerprints to at least one of the third fingerprint or the fourth fingerprint of the second set of fingerprints to identify the media content;
identify overlay content linked to the media content in an overlay content database; and
send the overlay content to the TV to superimpose on top of the media content.
2. The server of claim 1 , wherein the first fingerprint layout is a fully subdivided fingerprint layout and wherein:
the fully subdivided fingerprint layout comprises a frame of the media content divided into a plurality of blocks, each block of the plurality of blocks representing different defined locations in the frame; and
the fully subdivided fingerprint layout excludes a block of the plurality of blocks located at a corner of the frame.
3. The server of claim 1 , wherein the second fingerprint layout is a top subdivided fingerprint layout and wherein:
the top subdivided fingerprint layout comprises a frame of the media content divided into a plurality of blocks, each block of the plurality of blocks representing different defined locations in the frame; and
the top subdivided fingerprint layout excludes one or more blocks of the plurality of blocks located at a bottom of the frame.
4. The server of claim 1 , wherein the second fingerprint layout is a bottom subdivided fingerprint layout and wherein:
the bottom subdivided fingerprint layout comprises a frame of the media content divided into a plurality of blocks, each block of the plurality of blocks representing different defined locations in the frame; and
the bottom subdivided fingerprint layout excludes one or more blocks of the plurality of blocks located at a top of the frame.
5. The server of claim 1 , wherein the frames of media content displayed on the TV comprise: a logo located at a corner of the frames, an emergency message located at a top portion of the frames; or closed caption text located at a bottom portion of the frames.
6. The server of claim 1 , wherein:
the first set of fingerprints comprises a first subset of fingerprints in a fully subdivided fingerprint layout, a second subset of fingerprints in a top subdivided fingerprint layout, and a third subset of fingerprints in a bottom subdivided fingerprint layout;
the second set of fingerprints comprises a fourth subset of fingerprints in the fully subdivided fingerprint layout; a fifth subset of fingerprints in the top subdivided fingerprint layout, and a sixth subset of fingerprints in the bottom subdivided fingerprint layout; and
the first ACR system is further configured to
match a first fingerprint in the first subset of fingerprints to a second fingerprint in the fourth subset of fingerprints, a third fingerprint in the second subset of fingerprints to a fourth fingerprint in the fifth subset of fingerprints, or a fifth fingerprint in the third subset of fingerprints to a sixth fingerprint in the sixth subset of fingerprints in order to identify the media content; and
query, in parallel, the first subset of fingerprints, the second subset of fingerprints, and the third subset of fingerprints for a fingerprint match to identify the media content.
7. The server of claim 1 , wherein the TV comprises a second ACR system configured to fingerprint media content displayed on the TV.
8. The server of claim 7 , wherein when the first ACR system identifies the media content, the second ACR system is further configured to stop querying the reference database for the fingerprint match.
9. The server of claim 1 , wherein the TV is a smart TV comprising:
a second processing device operable to:
access online interactive media or on-demand streaming media using radio frequency (RF) circuitry;
execute an operating system (OS); and
execute one or more applications; and
the RF circuitry comprising an antenna configured to transmit data on the third interface.
10. The server of claim 1 , wherein:
the media content comprises one or more videos or television programs; and
the overlay content is a commercial that is superimposed onto a portion of the one or more videos or television programs.
11. A server comprising:
a memory;
a processing device coupled to the memory, wherein the processing device is configured to:
fingerprint each frame of media content received from a content provider based on pixel luminance to obtain a first set of fingerprints, the first set of fingerprints comprising a first subset of fingerprints in a fully subdivided fingerprint layout, and a second subset of fingerprints in a top subdivided fingerprint layout, and a third subset of fingerprints in a bottom subdivided layout;
receive, from an electronic device, a second set of fingerprints for frames of media content displayed on the electronic device, the second set of fingerprints comprising a fourth subset of fingerprints in the fully subdivided fingerprint layout, and a fifth subset of fingerprints in the top subdivided fingerprint layout, and a sixth subset of fingerprints in the bottom subdivided layout; and
match a first fingerprint in the first subset of fingerprints to a second fingerprint in the fourth subset of fingerprints, or a third fingerprint in the second subset of fingerprints to a fourth fingerprint in the fifth subset of fingerprints, or a fifth fingerprint in the third subset of fingerprints to a sixth fingerprint in the sixth subset of fingerprints in order to identify the media content.
12. The server of claim 11 , wherein the processing device is further configured to sequentially query the first subset of fingerprints, the second subset of fingerprints, and the third subset of fingerprints for a fingerprint match to identify the media content.
13. The server of claim 12 , wherein each of the fully subdivided fingerprint layout, the top subdivided fingerprint layout, and the bottom subdivided fingerprint layout comprise a frame of the media content divided into a plurality of blocks, each block of the plurality of blocks representing different defined locations in the frame.
14. The server of claim 13 , wherein:
the plurality of blocks are each approximately a same size; and
each of the plurality of blocks is rectangle shaped, polygon shaped, circle shaped, or oval shaped.
15. The server of claim 13 , wherein the frame is divided into a four by four grid with 16 blocks.
16. The server of claim 11 , wherein the frames of the media content displayed on the electronic device comprise: a logo located at a corner of the frames, an emergency message located at a top portion of the frames; or closed caption text located at a bottom portion of the frames.
17. The server of claim 11 , wherein the processing device is further configured to send, to the electronic device, overlay content linked to the media content.
18. The server of claim 11 , wherein the processing device is further configured to query, in parallel, the first subset of fingerprints, the second subset of fingerprints, and the third subset of fingerprints for a fingerprint match to identify the media content.