IP Library Granted Patent US 9,158,993
Granted Patent B2
US 9,158,993 · App. 14/551,828 · Granted Oct 13, 2015

Video comparison using color histograms

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,158,993
App. No.
14/551,828
Granted
Oct 13, 2015
Kind
B2
Abstract

Methods, apparatus and articles of manufacture for video comparison using color histograms are disclosed. Example methods disclosed herein to compare video sequences include determining a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence. Such example methods also include adjusting the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence to determine a first adjusted color histogram corresponding to the input video sequence. Such example methods further include comparing the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

Claims (71)

1. A method to compare video sequences, the method comprising:

determining a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence;

tiling video frames of a first reference video sequence to determine a composite image;

determining a first reference color histogram corresponding to the first reference video sequence based on color values of pixels in the composite image;

adjusting the color histogram corresponding to the input video sequence based on the first reference color histogram corresponding to the first reference video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

comparing the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

2. A method as defined in claim 1 , wherein determining the color histogram corresponding to the input video sequence includes:

sampling a set of pixels from the plurality of video frames of the input video sequence;

determining respective color combinations for respective ones of the set of pixels, a first color combination for a first one of the set of pixels being determined by combining a first color value for the first one of the set of pixels and a second color value for a neighboring pixel of the first one of the set of pixels; and

counting respective occurrences of different ones of the color combinations to determine the color histogram corresponding to the input video sequence.

3. A method as defined in claim 2 , further including:

capturing the input video sequence using a camera operating at a first frame rate;

sampling the input video sequence at a second frame rate lower than the first frame rate to obtain the plurality of video frames of the input video sequence; and

displaying a result indicating whether the first reference video sequence matches the input video sequence.

4. A method as defined in claim 1 , further including:

determining a first comparison value by comparing the adjusted color histogram and the first reference color histogram;

adjusting the first reference color histogram based on the color histogram corresponding to the input video sequence to determine a first adjusted reference color histogram;

determining a second comparison value by comparing the first adjusted reference color histogram and the color histogram corresponding to the input video sequence; and

determining that the first reference video sequence matches the input video sequence when at least one of the first comparison value or the second comparison value satisfies a threshold.

5. A method as defined in claim 1 , wherein adjusting the color histogram corresponding to the input video sequence based on the first reference color histogram includes:

multiplying a value of a first bin of the color histogram corresponding to the input video sequence by a scale factor to determine a scaled bin value; and

determining an adjusted value of a corresponding first bin of the adjusted color histogram to be a smaller of the scaled bin value and a value of a corresponding first bin of the reference color histogram.

6. A method as defined in claim 5 , wherein the scale factor is adjustable.

7. A tangible computer readable medium comprising computer readable instructions which, when executed, cause a processor to at least:

determine a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence;

tile video frames of a first reference video sequence to determine a composite image;

determine a first reference color histogram corresponding to the first reference video sequence based on color values of pixels in the composite image;

adjust the color histogram corresponding to the input video sequence based on the first reference color histogram corresponding to the first reference video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

compare the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

8. A tangible computer readable medium as defined in claim 7 , wherein to determine the color histogram corresponding to the input video sequence, the instructions, when executed, cause the processor to:

sample a set of pixels from the plurality of video frames of the input video sequence;

determine respective color combinations for respective ones of the set of pixels, a first color combination for a first one of the set of pixels being determined by combining a first color value for the first one of the set of pixels and a second color value for a neighboring pixel of the first one of the set of pixels; and

count respective occurrences of different ones of the color combinations to determine the color histogram corresponding to the input video sequence.

9. A tangible computer readable medium as defined in claim 8 , wherein the instructions, when executed, further cause the processor to:

capture the input video sequence using a camera operating at a first frame rate;

sample the input video sequence at a second frame rate lower than the first frame rate to obtain the plurality of video frames of the input video sequence; and

display a result indicating whether the first reference video sequence matches the input video sequence.

10. A tangible computer readable medium as defined in claim 7 , wherein the instructions, when executed, further cause the processor to:

determine a first comparison value by comparing the adjusted color histogram and the first reference color histogram;

adjust the first reference color histogram based on the color histogram corresponding to the input video sequence to determine a first adjusted reference color histogram;

determine a second comparison value by comparing the first adjusted reference color histogram and the color histogram corresponding to the input video sequence; and

determine that the first reference video sequence matches the input video sequence when at least one of the first comparison value or the second comparison value satisfies a threshold.

11. A tangible computer readable medium as defined in claim 7 , wherein to adjust the color histogram corresponding to the input video sequence based on the first reference color histogram, the instructions, when executed, further cause the processor to:

multiply a value of a first bin of the color histogram corresponding to the input video sequence by a scale factor to determine a scaled bin value; and

determine an adjusted value of a corresponding first bin of the adjusted color histogram to be a smaller of the scaled bin value and a value of a corresponding first bin of the reference color histogram.

12. A tangible computer readable medium as defined in claim 11 , wherein the scale factor is adjustable.

13. An apparatus to compare video sequences, the apparatus comprising:

a histogram generator to determine a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence; and

a histogram comparator to:

adjust the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

compare the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence;

wherein the histogram comparator includes a bin adjuster to:

multiply a value of a first bin of the color histogram corresponding to the input video sequence by a scale factor to determine a scaled bin value; and

determine an adjusted value of a corresponding first bin of the adjusted color histogram to be a smaller of the scaled bin value and a value of a corresponding first bin of the reference color histogram.

14. An apparatus as defined in claim 13 , wherein the a histogram generator includes:

an image sampler to sample a set of pixels from the plurality of video frames of the input video sequence;

a color quantizer to determine respective color combinations for respective ones of the set of pixels, a first color combination for a first one of the set of pixels being determined by combining a first color value for the first one of the set of pixels and a second color value for a neighboring pixel of the first one of the set of pixels; and

a color counter to count respective occurrences of different ones of the color combinations to determine the color histogram corresponding to the input video sequence.

15. An apparatus as defined in claim 14 , further including:

a video interface to capture the input video sequence using a camera operating at a first frame rate;

a video frame sampler to sample the input video sequence at a second frame rate lower than the first frame rate to obtain the plurality of video frames of the input video sequence; and

a results interface to display a result indicating whether the first reference video sequence matches the input video sequence.

16. An apparatus as defined in claim 13 , wherein the histogram comparator includes:

a bin adjuster to:

determine the adjusted color histogram; and

adjust the first reference color histogram based on the color histogram corresponding to the input video sequence to determine a first adjusted reference color histogram;

a comparison metric determiner to:

determine a first comparison value by comparing the adjusted color histogram and the first reference color histogram; and

determine a second comparison value by comparing the first adjusted reference color histogram and the color histogram corresponding to the input video sequence; and

a threshold comparator to determine that the first reference video sequence matches the input video sequence when at least one of the first comparison value or the second comparison value satisfies a threshold.

17. An apparatus as defined in claim 13 , wherein the scale factor is adjustable.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2014
From: LEE, MORRIS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 034560/0423 →