In-band data recognition and synchronization system
View Patent ↗A method and apparatus for recognizing and synchronizing to in-band data at a multimedia device is provided. A content stream includes in-band data. The in-band data is processed and in-band data pattern data associated with the content stream are created. Metadata are attached to the event identification data. The event identification data are provided to multimedia devices which receive broadcasted multimedia content streams containing video programs with in-band data. The in-band data are processed and compared to the event identification data. If a match occurs, the multimedia device uses the metadata to perform specified actions.
1. A method, comprising:
receiving, at a multimedia device, a multimedia content stream comprising in-band data, wherein the in-band data is closed-caption data displayed in one of a plurality of closed-caption modes;
determining a closed-caption mode of the plurality of closed-caption modes in which the closed caption data is displayed;
selecting a computation algorithm for computing a hash value sequences based on the closed-caption mode;
computing, based on the in-band data and using the computation algorithm, a hash value sequence associated with a location in the multimedia content stream;
determining that the hash value sequence matches a stored pattern of hash values, the stored pattern of hash values associated with metadata comprising instructions for performing one or more actions; and
performing the one or more actions, the one or more actions include at least skipping over a segment of the multimedia content stream.
2. The method as recited in claim 1 , wherein the segment corresponds to one or more commercials.
3. The method as recited in claim 1 , further comprising inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions.
4. The method as recited in claim 1 , further comprising:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the multimedia content stream, storing the multimedia content stream for later playback by the multimedia device.
5. The method as recited in claim 1 , further comprising:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the multimedia content
stream, sending the multimedia content stream to a second multimedia device playing, by the second multimedia device, the multimedia content stream; processing, by the second multimedia device, the one or more in-band tags during
playback;
responsive to processing the one or more in-band tags during playback, the second device performing the one or more actions.
6. The method as recited in claim 1 , further comprising:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions
subsequent to inserting the one or more in-band tags into the multimedia content stream, removing the in-band data from the multimedia content stream.
7. The method as recited in claim 1 , wherein inserting the one or more in-band tags comprises inserting one or more data objects representing one or more in-band tags into the multimedia content stream corresponding to the location in the multimedia content stream.
8. The method as recited in claim 1 , wherein the hash value sequence comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.
9. One or more non-transitory computer readable media storing instructions, which when executed by a processor, perform:
receiving, at a multimedia device, a multimedia content stream comprising in-band data, wherein the in-band data is closed-caption data;
determining a closed-caption mode of the plurality of closed-caption modes in which the closed caption data is displayed;
selecting a computation algorithm for computing a hash value sequences based on the closed-caption mode;
computing, based on the in-band data and using the computation algorithm, a hash value sequence associated with a location in the multimedia content stream;
determining that the hash value sequence matches a stored pattern of hash values, the stored pattern of hash values associated with metadata comprising instructions for performing one or more actions; and
performing the one or more actions, the one or more actions include at least skipping over a segment of the multimedia content stream.
10. The one or more non-transitory computer readable media as recited in claim 9 , wherein the segment corresponds to one or more commercials.
11. The one or more non-transitory computer readable media as recited in claim 9 , wherein the instructions, when executed by the processor, further perform inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions.
12. The one or more non-transitory computer readable media as recited in claim 9 , wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the multimedia content stream, storing the multimedia content stream for later playback by the multimedia device.
13. The one or more non-transitory computer readable media as recited in claim 9 , wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the multimedia content
stream, sending the multimedia content stream to a second multimedia device playing, by the second multimedia device, the multimedia content stream; processing, by the second multimedia device, the one or more in-band tags during
playback;
responsive to processing the one or more in-band tags during playback, the second device performing the one or more actions.
14. The one or more non-transitory computer readable media as recited in claim 9 , wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions
subsequent to inserting the one or more in-band tags into the multimedia content stream, removing the in-band data from the multimedia content stream.
15. The one or more non-transitory computer readable media as recited in claim 9 , wherein inserting one or more in-band tags comprises inserting one or more data objects representing the one or more in-band tags into the multimedia content stream corresponding to the location in the multimedia content stream.
16. The one or more non-transitory computer readable media as recited in claim 9 , wherein the hash value sequence comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.
17. An apparatus, comprising:
a subsystem, implemented at least partially in hardware, that receives, at a multimedia device, a multimedia content stream comprising in-band data, wherein the in-band data is closed-caption data displayed in one of a plurality of closed-caption modes;
a subsystem, implemented at least partially in hardware, that determines a closed-caption mode of the plurality of closed-caption modes in which the closed caption data is displayed;
a subsystem, implemented at least partially in hardware, that selects a computation algorithm for computing a hash value sequences based on the closed-caption mode;
a subsystem, implemented at least partially in hardware, that computes, based on the in-band data and using the computation algorithm, a hash value sequence associated with a location in the multimedia content stream;
a subsystem, implemented at least partially in hardware, that determines that the hash value sequence matches a stored pattern of hash values, the stored pattern of hash values associated with metadata comprising instructions for performing one or more actions; and
a subsystem, implemented at least partially in hardware, that performs the one or more actions, the one or more actions include at least skipping over a segment of the multimedia content stream.
18. The apparatus as recited in claim 17 , wherein the segment corresponds to one or more commercials.
19. The apparatus as recited in claim 17 , further comprising: a subsystem, implemented at least partially in hardware, that inserts one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and
comprising command and control information for performing the one or more actions.
20. The apparatus as recited in claim 17 , further comprising:
a subsystem, implemented at least partially in hardware, that inserts one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
a subsystem, implemented at least partially in hardware, that subsequent to inserting the one or more in-band tags into the multimedia content stream, stores the multimedia content stream for later playback by the multimedia device.
21. The apparatus as recited in claim 17 , further comprising:
a subsystem, implemented at least partially in hardware, that inserts one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions;
a subsystem, implemented at least partially in hardware, that subsequent to inserting the one or more in-band tags into the multimedia content stream, sends the multimedia content stream to a second multimedia device
a subsystem, implemented at least partially in hardware, that plays, by the second multimedia device, the multimedia content stream;
a subsystem, implemented at least partially in hardware, that processes, by the second multimedia device, the one or more in-band tags during playback;
a subsystem, implemented at least partially in hardware, that responsive to processing the one or more in-band tags during playback, performs the one or more actions.
22. The apparatus as recited in claim 17 , further comprising:
a subsystem, implemented at least partially in hardware, that inserts one or more in-band tags into the multimedia content stream, the one or more in-band tags corresponding to the location in the multimedia content stream and comprising command and control information for performing the one or more actions
a subsystem, implemented at least partially in hardware, that subsequent to inserting the one or more in-band tags into the multimedia content stream, removes the in-band data from the multimedia content stream.
23. The apparatus as recited in claim 17 , wherein inserting one or more in-band tags comprises inserting one or more data objects representing the one or more in-band tags into the multimedia content stream corresponding to the location in the multimedia content stream.
24. The apparatus as recited in claim 17 , wherein the hash value sequence comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.