IP Library Granted Patent US 9,639,772
Granted Patent B2
US 9,639,772 · App. 14/875,318 · Granted May 2, 2017

Video comparison using color histograms

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,639,772
App. No.
14/875,318
Granted
May 2, 2017
Kind
B2
Abstract

Methods, apparatus and articles of manufacture for video comparison using color histograms are disclosed. Example methods disclosed herein to compare video sequences include determining a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence. Such disclosed example methods also include adjusting the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence different from the input video sequence to determine an adjusted color histogram corresponding to the input video sequence. Such disclosed example methods further include comparing the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

Claims (45)

1. A method to compare video sequences, the method comprising:

determining, by executing an instruction with a processor, a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence;

adjusting, by executing an instruction with the processor, the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence different from the input video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

comparing, by executing an instruction with the processor, the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

2. The method as defined in claim 1 , wherein the adjusting of the color histogram includes:

multiplying bin values of the color histogram corresponding to the input video sequence by a scale factor to determine scaled bin values of the color histogram corresponding to the input video sequence; and

determining bin values of the adjusted color histogram based on the scaled bin values of the color histogram corresponding to the input video sequence and bin values of the first reference color histogram.

3. The method as defined in claim 2 , wherein the determining of the bin values of the adjusted color histogram includes determining a respective bin value of a first bin of the adjusted color histogram to be a smaller of a respective scaled bin value of a corresponding first bin of the color histogram corresponding to the input video sequence and a respective bin value of a corresponding first bin of the first reference color histogram.

4. The method as defined in claim 2 , wherein the scale factor is adjustable.

5. The method as defined in claim 1 , wherein the pixels are selected at specified horizontal and vertical coordinates from selected ones of the plurality of video frames of the input video sequence.

6. The method as defined in claim 5 , wherein the selected ones of the plurality of video frames of the input video sequence are selected randomly from the plurality of video frames of the input video sequence.

7. The method as defined in claim 1 , wherein the comparing of the adjusted color histogram and the first reference color histogram includes:

determining differences between bin values of the adjusted color histogram and corresponding bin values of the reference color histogram;

summing the differences to determine a comparison metric; and

determining whether the comparison metric meets a threshold.

8. A tangible computer readable medium comprising computer readable instructions which, when executed, cause a processor to at least:

determine a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence;

adjust the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence different from the input video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

compare the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

9. The tangible computer readable medium as defined in claim 8 , wherein to adjust the color histogram, the instructions, when executed, cause the processor to:

multiply bin values of the color histogram corresponding to the input video sequence by a scale factor to determine scaled bin values of the color histogram corresponding to the input video sequence; and

determine bin values of the adjusted color histogram based on the scaled bin values of the color histogram corresponding to the input video sequence and bin values of the first reference color histogram.

10. The tangible computer readable medium as defined in claim 9 , wherein to determine the bin values of the adjusted color histogram, the instructions, when executed, cause the processor to determine a respective bin value of a first bin of the adjusted color histogram to be a smaller of a respective scaled bin value of a corresponding first bin of the color histogram corresponding to the input video sequence and a respective bin value of a corresponding first bin of the first reference color histogram.

11. The tangible computer readable medium as defined in claim 9 , wherein the scale factor is adjustable.

12. The tangible computer readable medium as defined in claim 8 , wherein the pixels are selected at specified horizontal and vertical coordinates from selected ones of the plurality of video frames of the input video sequence.

13. The tangible computer readable medium as defined in claim 12 , wherein the selected ones of the plurality of video frames of the input video sequence are selected randomly from the plurality of video frames of the input video sequence.

14. The tangible computer readable medium as defined in claim 8 , wherein to compare the adjusted color histogram and the first reference color histogram, the instructions, when executed, cause the processor to:

determine differences between bin values of the adjusted color histogram and corresponding bin values of the reference color histogram;

sum the differences to determine a comparison metric; and

determine whether the comparison metric meets a threshold.

15. An apparatus comprising:

a histogram generator to determine a color histogram corresponding to an input video sequence based on color values of pixels sampled from a plurality of video frames of the input video sequence; and

a histogram comparator to:

adjust the color histogram corresponding to the input video sequence based on a first reference color histogram corresponding to a first reference video sequence different from the input video sequence to determine an adjusted color histogram corresponding to the input video sequence; and

compare the adjusted color histogram and the first reference color histogram to determine whether the first reference video sequence matches the input video sequence.

16. The apparatus as defined in claim 15 , wherein to adjust the color histogram, the histogram comparator is to:

multiply bin values of the color histogram corresponding to the input video sequence by an adjustable scale factor to determine scaled bin values of the color histogram corresponding to the input video sequence; and

determine bin values of the adjusted color histogram based on the scaled bin values of the color histogram corresponding to the input video sequence and bin values of the first reference color histogram.

17. The apparatus as defined in claim 16 , wherein to determine the bin values of the adjusted color histogram, the histogram comparator is to determine a respective bin value of a first bin of the adjusted color histogram to be a smaller of a respective scaled bin value of a corresponding first bin of the color histogram corresponding to the input video sequence and a respective bin value of a corresponding first bin of the first reference color histogram.

18. The apparatus as defined in claim 15 , wherein the pixels are selected at specified horizontal and vertical coordinates from selected ones of the plurality of video frames of the input video sequence.

19. The apparatus as defined in claim 18 , wherein the selected ones of the plurality of video frames of the input video sequence are selected randomly from the plurality of video frames of the input video sequence.

20. The apparatus as defined in claim 15 , wherein to compare the adjusted color histogram and the first reference color histogram, the histogram comparator is to:

determine differences between bin values of the adjusted color histogram and corresponding bin values of the reference color histogram;

sum the differences to determine a comparison metric; and

determine whether the comparison metric meets a threshold.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2015
From: LEE, MORRIS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 036909/0603 →