IP Library Granted Patent US 8,368,918
Granted Patent B2
US 8,368,918 · App. 11/855,768 · Granted Feb 5, 2013

Methods and apparatus to identify images in print advertisements

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,368,918
App. No.
11/855,768
Granted
Feb 5, 2013
Kind
B2
Abstract

Methods and apparatus to methods and apparatus to identify images in print advertisements are disclosed. An example method comprises computing a first image feature vector for a first presented image, comparing the first image feature vector to a second image feature vector, and when the first image feature vector matches the second image feature vector, storing printed-media information associated with the first presented image in a database record associated with the second image feature vector.

Claims (42)

1. A method to automatically detect placement of an advertisement in a periodical or book comprising:

obtaining printed-media information representing a first printed periodical or printed book in which the advertisement appears, the printed-media information comprising at least one of source information, a publication name, a publication title, a publication date, a publisher name, or a page number of the first printed periodical or printed book;

computing, using a processor, a first image feature vector from the advertisement;

comparing the first image feature vector to a second image feature vector;

when the first image feature vector substantially matches the second image feature vector, storing the printed-media information in a database record associated with the second image feature vector, and

compiling a list of publications in which advertisements substantially matching the second image feature vector were printed based on the database record.

2. A method as defined in claim 1 , further comprising:

adding a new database record associated with the advertisement when the first image feature vector does not substantially match the second image feature vector;

collecting image information associated with the advertisement from an operator; and

storing the collected image information and the printed-media information in the new database record.

3. A method as defined in claim 1 , wherein comparing the first image feature vector to the second image feature vector comprises:

computing a first dissimilarity metric between the first image feature vector and the second image feature vector; and

determining that the first image feature vector matches the second image feature vector when the first dissimilarity metric is less than a threshold.

4. A method as defined in claim 1 , further comprising:

creating a set of one or more possible matching advertisements; and

presenting the one or more possible matching advertisements to an operator.

5. A method as defined in claim 4 , further comprising:

computing a dissimilarity metric between the first image feature vector and the second image feature vector; and

adding a second advertisement associated with the second image feature vector to the set of possible matching advertisements when the dissimilarity metric is less than a threshold.

6. A method as defined in claim 1 , further comprising:

scanning a cover page of the first printed periodical or printed book containing the advertisement; and

storing the digitized cover page in the database record.

7. A method as defined in claim 1 , further comprising detecting when the first and second image feature vectors match.

8. A method as defined in claim 7 , wherein detecting when the first and second image feature vectors match comprises:

computing a third image feature vector for the advertisement; and

comparing the third image feature vector with a fourth image feature vector associated with the second image feature vector.

9. A method as defined in claim 8 , wherein the third image feature vector is larger than the first image feature vector.

10. A method as defined in claim 8 , wherein the third image feature vector comprises a resized version of the advertisement.

11. An image identification system comprising:

an image feature extraction engine to compute an image feature vector for an image;

a database engine to:

compare the image with one or more additional images stored in a database based on the image feature vector;

when the image matches a first of the one or more additional images, store printed-media information representing a first printed periodical or printed book in which the image was presented in a database record associated with the first of the one or more additional images, wherein the printed-media information comprises at least one of source information, a publication name, a publication title, a publication date, a publisher name, or a page number for the first printed periodical or printed book; and

compile a list of publications in which advertisements substantially matching the second image feature vector were printed based on the database record.

12. An image identification system as defined in claim 11 , wherein the database record contains a list of printed media in which the image was presented.

13. An image identification system as defined in claim 11 , further comprising a user interface to allow an operator to indicate that the image partially matches the first of the one or more additional image, and to prompt the operator for updated image information in response to the partial match indication.

14. An image identification system as defined in claim 11 , further comprising a scanner to digitize a second image, the image feature extraction engine to compute the image feature vector in overlapping time intervals.

15. An image identification system as defined in claim 11 , further comprising a scanner to digitize a cover page of the first printed periodical or printed book containing the image, wherein the database engine is to store the digitized cover page in the database record.

16. An image identification system as defined in claim 15 , wherein the printed-media information is extracted from the digitized cover page.

17. A method as defined in claim 2 , wherein the image information comprises at least one of an advertiser name, a company name, a product name, a product version, a product type, a product price, a sale price, a page size, an image size, or a page location.

18. A method as defined in claim 6 , wherein obtaining the printed-media information comprising extracting the printed-media information from the scanned cover page.

19. A method as defined in claim 6 , wherein obtaining the printed-media information comprising receiving the printed-media information from a person.

Assignments (11)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
MERGER Recorded Jul 20, 2009
From: NIELSEN MEDIA RESEARCH, LLC (FORMERLY KNOWN AS NIELSEN MEDIA RESEARCH, INC.) A CORP. OF DELAWARE
To: NIELSEN COMPANY (US), LLC, THE, A DELAWARE LIMITED LIABILITY COMPANY
Reel/Frame 022994/0513 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2007
From: DENG, KEVIN; BOSWORTH, ALAN NGUYEN
To: NIELSEN MEDIA RESEARCH, INC.
Reel/Frame 020116/0766 →