IP Library Granted Patent US 10,032,192
Granted Patent B2
US 10,032,192 · App. 13/621,794 · Granted Jul 24, 2018

Automatic localization of advertisements

Inventors: John Tinsman (Santa Cruz, CA); Thomas Huber (Arvada, CO); Thomas Lemmons (Evergreen, CO); Ian Zenoni (Highlands Ranch, CO)
Assignee: ROKU, INC.
G06Q30/0275H04N21/237H04N21/2353H04N21/4316H04N21/8583
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,032,192
App. No.
13/621,794
Granted
Jul 24, 2018
Kind
B2
Abstract

In various example embodiments, a system and method for automatic localization of advertisements is provided. In example embodiments, a transmission signal is received. A portion of the transmission signal is identified. A determination of whether localized advertisement data corresponds to the identified portion is performed. Localized advertisement data that correspond to the identified portion of the transmission signal is retrieved. The localized advertisement data is then inserted into the identified portion of the transmission signal to generate an altered signal. The altered signal is transmitted to a user device.

Claims (64)

1. A method in an upstream source comprising:

automatically identifying, by a pattern recognition component, a type of pattern in a video program, the type of pattern comprising an object or a blank space in the video program;

in response to identifying the type of pattern, generating a tag for identifying a location of the identified object or blank space in one or more images of the video program, the identified object or blank space being movable from one image to a next image in the video program;

receiving, by a transmission engine of the upstream source, a transmission signal comprising the video program, including the tag

identifying, by an identification engine of the upstream source, a non-local advertisement in a portion of the video program for modification by comparing the tag in the transmission signal with stored attributes, of one or more advertisers, associated with the identified object or blank space;

determining, by a retrieval engine of the upstream source, that localized advertisement data corresponds to the non-local advertisement identified in the portion of the video program;

in response to the determining that the localized advertisement data corresponds to the non-local advertisement identified in the portion of the video program, triggering retrieval of the localized advertisement data that corresponds to the non-local advertisement;

determining, using content recognition applied to an image of the non-local advertisement based on the tag, a location within the image of the non-local advertisement where the retrieved localized advertisement is to be inserted;

generating, using one or more processors of the upstream source, an altered transmission signal, the generating comprising:

graphically inserting the retrieved localized advertisement data into the image of the non-local advertisement at the determined location based on the tag, wherein the inserting is performed after a delay after the non-local advertisement bas begun, and

removing the graphically inserted localized advertisement data from the determined location within the image of the non-local advertisement; and

transmitting, by the transmission engine of the upstream source, the altered transmission signal that includes the localized advertisement data graphically inserted into the non-local advertisement to a user electronic device.

2. The method of claim 1 , wherein the determining the location comprises identifying an attribute of the image of the non-local advertisement where the localized advertisement data is insertable.

3. The method of claim 1 , wherein the portion comprises a selection from a group comprising: a television program, a radio program, an audio advertisement, regional advertisement, local advertisement, and streamed media.

4. The method of claim 1 , wherein the identifying of the non-local advertisement in the portion comprises:

determining one or more fingerprints over a plurality of frames of the portion of the media, each fingerprint being an attribute of the image found in the transmission signal; and

making a call to a central database to determine whether the one or more fingerprints are identifiable as part of the non-local advertisement by matching the one or more fingerprints to data stored in the central database.

5. The method of claim 4 , wherein the fingerprint identifies one or more of an average brightness of various colors, variations of colors across the image, difference in brightness between a top and bottom or left and right of the image, or statistics for each zone of the image.

6. The method of claim 1 , wherein the determining that the localized advertisement data corresponds comprises:

accessing a central database including ad asset information for a plurality of localized advertisement data; and

searching the ad asset information of the central database for the localized advertisement data having ad asset information that matches the non-local advertisement in the portion.

7. The method of claim 1 , wherein the graphically inserting of the localized advertisement data comprises overlaying the localized advertisement data onto the determined location of the image of the non-local advertisement identified in the portion.

8. The method of claim 1 , wherein the graphically inserting of the localized advertisement data comprises replacing a portion of the image located at the determined location with the localized advertisement data, wherein a resultant advertisement that is transmitted includes both at least a portion of the localized advertisement data and at least a portion of the non-local advertisement.

9. The method of claim 1 , further comprising:

receiving a selection associated with the localized advertisement data from the user device; and

providing a coupon associated with le localized advertisement data for use by a user of the user device.

10. The method of claim 1 , further comprising verifying a presence of the localized advertisement data in the altered transmission signal by receiving the altered transmission signal and performing a recognition process to identify the presence of the localized advertisement data in the altered transmission signal.

11. The method of claim 1 , wherein the identifying of the non-local advertisement in the portion comprises:

identifying a watermark from the portion of the media; and

extracting identifying information from the watermark used to identify the non-local advertisement in the portion.

12. A non-transitory machine-readable medium storing instructions which, when executed by at least one processor of a machine, causes the machine to perform operations comprising:

automatically identifying, by a pattern recognition component, a type of pattern in a video program, the type of pattern comprising an object or a blank space in the video program;

in response to identifying the type of pattern, generating a tag for identifying a location of the identified object or blank space in one or more images of the video program, the identified object or blank space being movable from one image to a next image in the video program;

receiving, by a transmission engine of the upstream source, a transmission signal comprising the video program, including the tag;

identifying a non-local advertisement in a portion of the video program for modification by comparing the tag in the transmission signal with stored attributes, of one or more advertisers, associated with the identified object or blank space;

determining that localized advertisement data corresponds to the non-local advertisement identified in the portion of the video program;

in response to the determining that the localized advertisement data corresponds to the non-local advertisement identified in the portion of the video program, triggering retrieval of the localized advertisement data that corresponds to the non-local advertisement;

determining, using content recognition applied to an image of the non-local advertisement based on the tag, a location within the image of the non-local advertisement where the retrieved localized advertisement is to be inserted;

generating, using one or more processors of the upstream source, an altered transmission signal, the generating comprising:

graphically inserting the retrieved localized advertisement data into the image of the non-local advertisement at the determined location based on the tag, wherein the inserting is performed after a delay after the non-local advertisement bas begun, and

removing the graphically inserted localized advertisement data from the determined location within the image of the non-local advertisement; and

transmitting, by the transmission engine of the upstream source, the altered transmission signal that includes the localized advertisement data graphically inserted into the non-local advertisement to a user electronic device.

13. The non-transitory machine-readable medium of claim 12 , wherein the identifying of the non-local advertisement in the portion comprises:

determining at least one attribute of the portion of the media; and

making a call to a central database to determine an identity of the non-local advertisement in the portion by matching the at least one attribute to data stored in the central database.

14. The non-transitory machine-readable medium of claim 12 , wherein the determining that the localized advertisement data corresponds comprises:

accessing a central database including ad asset information for the localized advertisement data; and

searching the ad asset information of the central database for a match to the non-local advertisement in the portion.

15. The non-transitory machine-readable medium of claim 12 , wherein the operations further comprise:

receiving a selection associated with the localized advertisement data from the user device; and

providing a coupon associated with the localized advertisement data for use by a user of the user device.

16. The non-transitory machine-readable medium of claim 12 , wherein the operations further comprise verifying a presence of the localized advertisement data in the altered transmission signal.

17. A system comprising:

a processor of a machine;

a pattern recognition component that when executed by the processor:

automatically identifies a type of pattern in a video program, the type of pattern comprising an object or a blank space in the video program:

in response to identifying the type of pattern, generates a tag for identifying a location of the identified object or blank space in one or more images of the video program, the identified object or blank space being movable from one image to a next image in the video program;

a transmission engine of an upstream source that when executed by the processor receives a transmission signal comprising the video program, including the tag

an identification engine that when executed by the processor identifies a non-local advertisement in a portion of the video program for modification by comparing the tag in the transmission signal with stored attributes, of one or more advertisers, associated with the identified object or blank space;

a retrieval engine of the upstream source that when executed by the processor determines that localized advertisement data corresponds to the non-local advertisement identified in the portion of the video program and to trigger retrieval of the localized advertisement data that corresponds to the non-local advertisement in response to a determination that the localized advertisement data corresponds to the non-local advertisement identified in the portion prior to transmitting the transmission signal to a user device;

a recognition engine that when executed by the processor determines, using content recognition applied to an image of the non-local advertisement based on the tag, a location within the image of the non-local advertisement where the localized advertisement is to be inserted; and

an insertion engine that when executed by the processor generates, at the upstream source, an altered transmission signal by graphically inserting, using the processor, the retrieved localized advertisement data into the image of the non-local advertisement at the determined location based on the tag, wherein the inserting is performed after a delay after the non-local advertisement has begun, and removing the graphically inserted localized advertisement data from the determined location within the image of the non-local advertisement prior to an end of the non-local advertisement, the transmission engine further configured to transmit the altered transmission signal that includes the localized advertisement data graphically inserted into the non-local advertisement to a user electronic device.

18. The system of claim 17 , wherein the recognition engine is when executed by the processor determines one or more fingerprints over a plurality of frames of the portion of the media, each fingerprint being an attribute of the image found in the transmission signal, the identification engine further configured to make a call to a central database to determine an identity of the non-local advertisement in the portion by matching the one or more fingerprints to data stored in the central database.

19. The system of claim 17 , further comprising a verification engine that when executed by the processor verifies a presence of the localized advertisement data in the altered transmission signal.

Assignments (6)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 048385/0375) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.
Reel/Frame 062826/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 20, 2019
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 048385/0375 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2018
From: OPENTV, INC.
To: ROKU, INC.
Reel/Frame 044656/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2014
From: TINSMAN, JOHN
To: OPENTV, INC.
Reel/Frame 033744/0736 →
EMPLOYEE PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Sep 16, 2014
From: HUBER, THOMAS; LEMMONS, THOMAS; ZENONI, IAN
To: OPENTV, INC.
Reel/Frame 033745/0900 →
Continuity (3)
Continuation In Part 13175663 · Jul 1, 2011
Continuation 10745899 · Dec 23, 2003
Related Publication 20130031582A1 · Jan 31, 2013