IP Library Granted Patent US 12,101,518
Granted Patent B2
US 12,101,518 · App. 18/197,650 · Granted Sep 24, 2024

Method and system for re-uniting metadata with media-stream content at a media client, to facilitate action by the media client

Inventors: Steven M. Cormie (Cambridge, GB); Brian Jentz (Buxton, GB)
Assignee: ROKU, INC.
H04N21/235H04N21/23424H04N21/23892H04N21/812H04N21/83H04N21/8358
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,101,518
App. No.
18/197,650
Granted
Sep 24, 2024
Kind
B2
Abstract

In a communication system where a channel teed carrying a media stream is broadcast for delivery of the media stream to a media client, where the channel feed further includes metadata in-band and correlated with a content frame of the media stream, but where the metadata gets removed from the channel feed before the media stream reaches the media client, a computing system (i) extracts the metadata from the channel feed and (ii) transmits out-of-band to the media client the extracted metadata in correlation with reference fingerprint data representing the frame of the media stream, the correlation being useable by the media client as a basis to re-correlate the metadata with the frame of the media stream, so as to enable the media client to carry out an action, such as dynamic ad insertion, based on the correlation of the metadata with the frame of the media stream.

Claims (33)

1. A computer-implemented method, comprising:

determining, by at least one computer processor, that metadata associated with a content frame of a media stream intended for a media client is removed from a channel feed before the media stream reaches the media client;

extracting the metadata from a copy of the channel feed; and

transmitting in an out-of-band message to the media client, the extracted metadata in correlation with reference fingerprint data representing the content frame of the media stream, wherein the correlation of the extracted metadata with the reference fingerprint data representing the content frame of the media stream enables the media client to re-correlate the metadata with the content frame of the media stream for carrying, out an action based on the correlation of the metadata with the content frame of the media stream.

2. The computer-implemented method of claim 1 , wherein said extracting and said transmitting are performed responsive to determining that the metadata associated with the content frame of the media stream intended for the media client is removed from the channel feed before the media stream reaches the media client.

3. The computer-implemented method of claim 1 , wherein the copy is received before the metadata is removed from the channel feed.

4. The computer-implemented method of claim 3 , wherein the copy of the channel feed is received from a broadcaster.

5. The computer-implemented method of claim 1 , wherein the media stream comprises a television channel.

6. The computer-implemented method of claim 1 , wherein the extracting of the metadata from the copy of the channel feed comprises reading the metadata from a transport stream that carries the media stream.

7. The computer-implemented method of claim 1 , wherein the extracting of the metadata from the copy of the channel feed comprises reading the metadata based on watermarking embedded into the media stream.

8. The computer-implemented method of claim 1 , wherein the extracting of the metadata from the copy of the channel feed comprises reading the metadata from a vertical ancillary data space of a video frame of the media stream.

9. The computer-implemented method of claim 1 , wherein transmitting to the media client the extracted metadata in correlation with the reference fingerprint data representing the content frame of the media stream comprises transmitting to the media client the extracted metadata timestamped with a reference timestamp and transmitting to the media client the reference fingerprint data timestamped with the same reference timestamp.

10. The computer-implemented method of claim 1 , wherein transmitting to the media client the extracted metadata in correlation with the reference fingerprint data representing the content frame of the media stream comprises transmitting to the media client the extracted metadata attached with the reference fingerprint data.

11. The computer-implemented method of claim 1 ,

wherein the action carried out by the media client based on the correlation of the metadata with the content frame of the media stream comprises a content-related action, and

wherein the media client uses the correlation of the extracted metadata with the reference fingerprint data representing the content frame of the media stream as a basis to re-correlate the metadata with the content frame of the media stream, so as to enable the media client to carry out the content-related action based on the correlation of the metadata with the content frame of the media stream.

12. The computer-implemented method of claim 1 , wherein the action carried out by the media client based on the correlation of the metadata with the frame of the media stream comprises dynamic ad insertion.

13. A system, comprising:

one or more memories; and

at least one processor each coupled to at least one of the one or more memories and configured to perform operations comprising:

determining that metadata associated with a content frame of a media stream intended for a media client is removed from a channel feed before the media stream reaches the media client;

extracting the metadata from a copy of the channel feed; and

transmitting, in an out-of-band message to the media client, the extracted metadata in correlation with reference fingerprint data representing the content frame of the media stream, wherein the correlation of the extracted metadata with the reference fingerprint data representing the content frame of the media stream enables the media client to re-correlate the metadata with the content frame of the media stream for carrying out an action based on the correlation of the metadata with the content frame of the media stream.

14. The system of claim 13 , wherein said extracting and said transmitting are performed responsive to determining that the metadata associated with the content frame of the media stream intended for the media client is removed from the channel feed before the media stream reaches the media client.

15. The system of claim 13 , wherein the extracting of the metadata from the copy of the channel feed comprises reading the metadata from a transport stream that carries the media stream.

16. The system of claim 13 , wherein the extracting of the metadata from the copy of the channel feed comprises reading the metadata based on watermarking embedded into the media stream.

17. The system of claim 13 , wherein transmitting to the media client the extracted metadata in correlation with the reference fingerprint data representing the content frame of the media stream comprises transmitting to the media client the extracted metadata timestamped with a reference timestamp and transmitting to the media client the reference fingerprint data timestamped with the same reference timestamp.

18. The system of claim 13 , wherein transmitting to the media client the extracted metadata in correlation with the reference fingerprint data representing the content frame of the media stream comprises transmitting to the media client the extracted metadata attached with the reference fingerprint data.

19. The system of claim 13 , wherein the action carried out by the media client based on the correlation of the metadata with the frame of the media stream comprises dynamic ad insertion.

20. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

determining, by at least one computer processor, that metadata associated with a content frame of a media stream intended for a media client is removed from a channel feed before the media stream reaches the media client;

extracting the metadata from a copy of the channel feed; and

transmitting in an out-of-band message to the media client, the extracted metadata in correlation with reference fingerprint data representing the content frame of the media stream, wherein the correlation of the extracted metadata with the reference fingerprint data representing the content frame of the media stream enables the media client to re-correlate the metadata with the content frame of the media stream for carrying out an action based on the correlation of the metadata with the content frame of the media stream.

Assignments (3)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: CORMIE, STEVEN M.; JENTZ, BRIAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 067148/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 067148/0445 →
Continuity (4)
Continuation 17447711 · Sep 15, 2021
Continuation 15929211 · Jan 28, 2020
Provisional Application 62900043 · Sep 13, 2019
Related Publication 20230403416A1 · Dec 14, 2023