IP Library Granted Patent US 10,977,693
Granted Patent B2
US 10,977,693 · App. 16/128,502 · Granted Apr 13, 2021

Association of content identifier of audio-visual data with additional data through capture infrastructure

Inventors: Ashwin Navin (San Francisco, CA); David Harrison (Reno, NV); Joshua Smallman (San Francisco, CA)
Assignee: FREE STREAM MEDIA CORP.
G06Q30/0269G06F3/14G06F16/783G06F17/30784G06F21/10G06F21/53G06Q30/0255G08C17/02H04L12/18H04L12/1859H04L61/2007H04L61/256H04L61/2514H04L63/10H04L63/102H04L65/1069H04L65/4069H04L65/604H04L67/10H04L67/141H04L67/16H04N21/23424H04N21/2541H04N21/4126H04N21/4147H04N21/41407H04N21/435H04N21/4394H04N21/44008H04N21/4415H04N21/44016H04N21/466H04N21/6175H04N21/64322H04N21/812H04N21/835H04N21/8352H04N21/8358H04N21/84G06F2221/033H04L61/1511H04L61/1541H04L61/2517H04L61/2575H04L61/6022H04L61/6068H04L67/02H04N21/278
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,977,693
App. No.
16/128,502
Granted
Apr 13, 2021
Kind
B2
Abstract

A method of a capture infrastructure includes determining a content identifier by applying a first automatic content recognition algorithm to fingerprint data of an audio-visual data rendered on a networked media device, and associating the content identifier with additional data derived from information other than the fingerprint data.

Claims (17)

1. A method of a capture infrastructure comprising: dividing an audio-visual data rendered on a networked media device into a series of scenes, said networked media device comprising a sandbox reachable service; applying an automatic content recognition algorithm to a first scene of the series of scenes to determine a content identifier; associating an advertisement data with the determined content identifier; identifying a correlation pattern between the first scene and a second scene of the series of scenes; associating the advertisement data to the second scene of the series of scenes; and identifying targeted content to be targeted to a client device associated with the networked media device, said client device supporting sandboxed application execution.

2. The method of claim 1 , further comprising associating, with the content identifier, an audio identifier determined from fingerprint data of audio data received by the capture infrastructure for a same content identified by the content identifier.

3. The method of claim 2 , comprising the audio identifier identifying a piece of music in the same content.

4. The method of claim 2 , comprising the audio identifier identifying a person speaking in the same content.

5. The method of claim 1 , further comprising associating, with the content identifier, a text identifier determined by applying an optical character recognition algorithm to data received by the capture infrastructure for a same content identified by the content identifier and by comparing recognized text to entries in a master database, wherein the text identifier identifies at least one of: a brand, a product, a person, and a location shown in the same content.

6. The method of claim 5 , comprising the additional data text identifier being a logo name determined by comparing the entries in the master database with a logo data of the audio-visual data identified using a logo detection algorithm.

7. The method of claim 1 , comprising the association of the advertisement data with the content identifier being based on a correlation between a metadata of the advertisement data provided by a content provider and the content identifier.

8. The method of claim 1 , further comprising at least one of: automatically dividing the audio-visual data into the series of scenes based on a semantic grouping of actions in the audio-visual data: analyzing the audio-visual data in advance of a broadcast to determine content identifiers associated with each commercial in the audio-visual data such that advertisements are pre-inserted into the audio-visual data prior to the broadcast; and applying a time-order algorithm to automatically match the advertisement data to the audio-visual data when the correlation pattern is identified.

9. The method of claim 1 , further comprising causing rendering of the identified targeted content in the sandboxed application executing within the client device.

10. A capture infrastructure, comprising: a memory; and a processor communicatively coupled to the memory, the processor configured to execute instructions to: divide an audio-visual data rendered on a networked media device into a series of scenes, said networked media device comprising a sandbox reachable service, apply an automatic content recognition algorithm to a first scene of the series of scenes to determine a content identifier, associate an advertisement data with the determined content identifier, identify a correlation pattern between the first scene and a second scene of the series of scenes, associate the advertisement data to the second scene of the series of scenes, and identifying targeted content to be targeted to a client device associated with the networked media device, said client device supporting sandboxed application execution.

11. The capture infrastructure of claim 10 , wherein the processor is further configured to execute instructions to associate, with the content identifier, an audio identifier determined from fingerprint data of audio data received by the capture infrastructure for a same content identified by the content identifier.

12. The capture infrastructure of claim 11 , wherein the audio identifier identifies a piece of music in the same content.

13. The capture infrastructure of claim 11 , wherein the audio identifier identifies a person speaking in the same content.

14. The capture infrastructure of claim 10 , wherein the processor is further configured to execute instructions to associate, with the content identifier, a text identifier determined by applying an optical character recognition algorithm to data received by the capture infrastructure for a same content identified by the content identifier and by comparing recognized text to entries in a master database, wherein the text identifier identifies at least one of: a brand, a product, a person, and a location shown in the same content.

15. The capture infrastructure of claim 14 , wherein the text identifier is a logo name determined by comparing the entries in the master database with a logo data of the audio-visual data identified using a logo detection algorithm.

16. The capture infrastructure of claim 10 , wherein the processor is configured to execute instructions to associate the advertisement data with the content identifier based on a correlation between a metadata of the advertisement data provided by a content provider and the content identifier.

17. The capture infrastructure of claim 10 , wherein the processor is further configured to execute instructions to at least one of: automatically divide the audio-visual data into the series of scenes based on a semantic grouping of actions in the audio-visual data, analyze the audio-visual data in advance of a broadcast to determine content identifiers associated with each commercial in the audio-visual data such that advertisements are pre-inserted into the audio-visual data prior to the broadcast, and apply a time-order algorithm to automatically match the advertisement data to the audio-visual data when the correlation pattern is identified.

Assignments (3)
SECURITY INTEREST Recorded Nov 13, 2025
From: SAMBA TV, INC.
To: HORIZON TECHNOLOGY FINANCE CORPORATION
Reel/Frame 073562/0068 →
CHANGE OF NAME Recorded Jan 17, 2024
From: FREE STREAM MEDIA CORP.
To: SAMBA TV, INC.
Reel/Frame 066342/0506 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2019
From: NAVIN, ASHWIN; HARRISON, DAVID; SMALLMAN, JOSHUA
To: FREE STREAM MEDIA CORP.
Reel/Frame 049585/0328 →
Continuity (9)
Continuation In Part 15259146 · Sep 8, 2016
Continuation 14018396 · Sep 4, 2013
Continuation 13470814 · May 14, 2012
Continuation 12592377 · Nov 23, 2009
Continuation 13736031 · Jan 7, 2013
Provisional Application 61118286 · Nov 26, 2008
Provisional Application 61584168 · Jan 6, 2012
Provisional Application 61696711 · Sep 4, 2012
Related Publication 20190012706A1 · Jan 10, 2019
Cited By (1)
US 12,711,793