IP Library Granted Patent US 10,614,582
Granted Patent B2
US 10,614,582 · App. 16/018,011 · Granted Apr 7, 2020

Logo recognition in images and videos

Inventors: Jose Pio Pereira (Cupertino, CA); Kyle Brocklehurst (Mountain View, CA); Sunil Suresh Kulkarni (San Jose, CA); Peter Wendt (San Jose, CA)
Assignee: Gracenote, Inc.
G06T7/337G06K9/4671G06K9/6267G06T7/11G06T7/60G06K9/4642G06K2009/4666G06K2209/25G06T2207/20052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,614,582
App. No.
16/018,011
Granted
Apr 7, 2020
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture of logo recognition in images and videos are disclosed. An example method to detect a specific brand in images and video streams comprises accepting luminance images at a scale in an x direction Sx and a different scale in a y direction Sy in a neural network, and training the neural network with a set of training images for detected features associated with a specific brand.

Claims (37)

1. A method to detect a specific brand in images and video streams, comprising:

accepting luminance images at a scale in an x direction Sx and a different scale in a y direction Sy in a neural network; and

training the neural network with a set of training images for detected features associated with a specific brand.

2. The method as defined in claim 1 , further including accepting RGB images at a scale in the x direction Sx and a different scale in the y direction Sy in a neural network.

3. The method as defined in claim 1 , further including learning to classify an image into the specific brand by applying a logo image for the specific brand in the set of training images.

4. The method as defined in claim 1 , further including generating a set of training images with a set of logo images associated with the specific brand and located on backgrounds associated with the specific brand.

5. The method as defined in claim 1 , further including segmenting a detected character image using heuristics for stroke width, number of horizontal strokes, number of vertical strokes, and number of loops.

6. The method as defined in claim 1 , further including identifying contours according to vertical stroke density and transition analysis.

7. The method as defined in claim 1 , further including:

combining neighboring keypoint regions with consistent aspect ratios and size to generate a new keypoint region;

detecting and combining edge segments of an image in a keypoint region; and

binning sample points on selected edges by angle and distance with reference to a dominant orientation.

8. An apparatus, comprising:

at least one processor; and

a memory in communication with the at least one processor, the memory including non-transitory computer-readable code which, when executed, causes the at least one processor to at least:

accept luminance images at a scale in an x direction Sx and a different scale in a y direction Sy in a neural network; and

train the neural network with a set of training images for detected features associated with a specific brand.

9. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to accept RGB images at a scale in the x direction Sx and a different scale in the y direction Sy in the neural network.

10. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to learn to classify an image into the specific brand by applying a logo image for the specific brand in the set of training images.

11. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to generate a set of training images associated with the specific brand and located on backgrounds associated with the specific brand.

12. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to segment a detected character image using heuristics for stroke width, number of horizontal strokes, number of vertical strokes, and number of loops.

13. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to identify contours according to vertical stroke density and transition analysis.

14. The apparatus as defined in claim 8 , wherein the code, when executed, causes the at least one processor to:

combine neighboring keypoint regions with consistent aspect ratios and size to generate a new keypoint region;

detect and combine edge segments of an image in a keypoint region; and

bin sample points on selected edges by angle and distance with reference to a dominant orientation.

15. A non-transitory computer readable storage medium comprising code that, when executed, causes a machine to at least:

accept luminance images at a scale in an x direction Sx and a different scale in a y direction Sy in a neural network; and

train the neural network with a set of training images for detected features associated with a specific brand.

16. The storage medium as defined in claim 15 , wherein the code, when executed, causes the machine to learn to classify an image into the specific brand by applying a logo image for the specific brand in the set of training images.

17. The storage medium as defined in claim 15 , wherein the code, when executed, causes the machine to generate a set of training images with a set of logo images associated with the specific brand and located on backgrounds associated with the specific brand.

18. The storage medium as defined in claim 15 , wherein the code, when executed, causes the machine to segment a detected character image using heuristics for stroke width, number of horizontal strokes, number of vertical strokes, and number of loops.

19. The storage medium as defined in claim 15 , wherein the code, when executed causes the machine to identify contours according to vertical stroke density and transition analysis.

20. The storage medium as defined in claim 15 , wherein the code, when executed, causes the machine to:

combine neighboring keypoint regions with consistent aspect ratios and size to generate a new keypoint region;

detect and combine edge segments of an image in a keypoint region; and

bin sample points on selected edges by angle and distance with reference to a dominant orientation.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2020
From: PEREIRA, JOSE PIO; BROCKLEHURST, KYLE; KULKARNI, SUNIL SURESH; WENDT, PETER
To: GRACENOTE, INC.
Reel/Frame 051855/0367 →