IP Library Granted Patent US 8,433,142
Granted Patent B2
US 8,433,142 · App. 12/754,361 · Granted Apr 30, 2013

Methods and apparatus to detect differences between images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,433,142
App. No.
12/754,361
Granted
Apr 30, 2013
Kind
B2
Abstract

Methods and apparatus to detect differences between images are disclosed. An example method to identify image differences disclosed herein comprises electronically determining whether a difference between a first block of pixels of a sample image and a second block of pixels of a reference image is resolvable using a transformation operation, when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable, including the first block in an unresolved difference region of the sample image, and electronically generating a difference signature representative of the unresolved difference region, the difference signature to identify the unresolved difference region of the sample image.

Claims (66)

1. A method to identify image differences, the method comprising:

electronically determining whether a difference between a first block of pixels of a sample image and a second block of pixels of a reference image is resolvable using a transformation operation;

when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable, including the first block in an unresolved difference region of the sample image; and

electronically generating a difference signature representative of the unresolved difference region, the difference signature to identify the unresolved difference region of the sample image, wherein the transformation operation is at least one of an intensity or color adjustment, and further comprising determining whether the first block is substantially flat and whether the second block is substantially flat to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable.

2. A method to identify image differences, the method comprising:

electronically determining whether a difference between a first block of pixels of a sample image and a second block of pixels of a reference image is resolvable using a transformation operation;

when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable, including the first block in an unresolved difference region of the sample image; and

electronically generating a difference signature representative of the unresolved difference region, the difference signature to identify the unresolved difference region of the sample image, wherein the method further comprises:

determining a difference image based on the sample image and the reference image;

partitioning the difference image into a plurality of blocks of pixels;

determining that a correlation value for a third block of the difference image exceeds a threshold;

forming the first block of the sample image to correspond spatially with the third block of the difference image; and

forming the second block of the reference image to correspond spatially with the third block of the difference image.

3. A tangible machine readable storage medium comprising machine readable instructions which, when executed, cause a machine to at least:

determine whether a difference between a first block of pixels of a sample image and a second block of pixels of a reference image is resolvable using a transformation operation;

when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable, include the first block in an unresolved difference region of the sample image; and

generate a difference signature representative of the unresolved difference region, the difference signature to identify the unresolved difference region of the sample image, wherein the transformation operation is at least one of an intensity or color adjustment, and wherein the machine readable instructions, when executed, further cause the machine to determine whether the first block is substantially flat and whether the second block is substantially flat to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable, the first block being substantially flat when the first block includes pixels exhibiting a substantially similar first color and first intensity, and the second block being substantially flat when the second block includes pixels exhibiting a substantially similar second color and second intensity.

4. A tangible machine readable storage medium comprising machine readable instructions which, when executed, cause a machine to at least:

determine whether a difference between a first block of pixels of a sample image and a second block of pixels of a reference image is resolvable using a transformation operation;

when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable, include the first block in an unresolved difference region of the sample image; and

generate a difference signature representative of the unresolved difference region, the difference signature to identify the unresolved difference region of the sample image, wherein the machine readable instructions, when executed, further cause the machine to:

determine a difference image based on the sample image and the reference image;

partition the difference image into a plurality of blocks of pixels;

determine that a correlation value for a third block of the difference image exceeds a threshold;

form the first block of the sample image to correspond spatially with the third block of the difference image; and

form the second block of the reference image to correspond spatially with the third block of the difference image.

5. An image difference identifier comprising:

an image signature matcher to compare a sample image signature representative of a sample image and a plurality of reference image signatures representative of a respective plurality of reference images to select a reference image similar to the sample image;

a difference resolver to:

determine whether a difference between a first block of pixels of the sample image and a second block of pixels of the reference image is resolvable using a transformation operation; and

include the first block in an unresolved difference region of the sample image when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable; and

a difference signature generator to generate a difference signature representative of the unresolved difference region, the difference signature being different from the sample image signature, the difference signature to identify the unresolved difference region of the sample image, wherein the transformation operation is at least one of an intensity or color adjustment, and wherein the difference resolver is to determine whether the first block is substantially flat and whether the second block is substantially flat to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable, the first block being substantially flat when the first block includes pixels exhibiting a substantially similar first color and first intensity, and the second block being substantially flat when the second block includes pixels exhibiting a substantially similar second color and second intensity.

6. An image difference identifier comprising:

an image signature matcher to compare a sample image signature representative of a sample image and a plurality of reference image signatures representative of a respective plurality of reference images to select a reference image similar to the sample image;

a difference resolver to:

determine whether a difference between a first block of pixels of the sample image and a second block of pixels of the reference image is resolvable using a transformation operation; and

include the first block in an unresolved difference region of the sample image when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable; and

a difference signature generator to generate a difference signature representative of the unresolved difference region, the difference signature being different from the sample image signature, the difference signature to identify the unresolved difference region of the sample image, wherein the image difference identifier further comprises:

a difference image determiner to determine a difference image based on the sample image and the reference image;

a difference image segmenter to partition the difference image into a plurality of blocks of pixels; and

a block resolver to:

determine that a correlation value for a third block of the difference image exceeds a threshold;

form the first block of the sample image to correspond spatially with the third block of the difference image; and

form the second block of the reference image to correspond spatially with the third block of the difference image.

7. An image difference identifier comprising:

an image signature matcher to compare a sample image signature representative of a sample image and a plurality of reference image signatures representative of a respective plurality of reference images to select a reference image similar to the sample image;

a difference resolver to:

determine whether a difference between a first block of pixels of the sample image and a second block of pixels of the reference image is resolvable using a transformation operation; and

include the first block in an unresolved difference region of the sample image when the difference between the first and second blocks is determined to be unresolvable, but not when the difference between the first and second blocks is determined to be resolvable; and

a difference signature generator to generate a difference signature representative of the unresolved difference region, the difference signature being different from the sample image signature, the difference signature to identify the unresolved difference region of the sample image, wherein the difference signature is larger than the sample image signature and comprises at least one of an image representative of the unresolved difference region, or one or more proxy values representative of the unresolved difference region.

8. A method as defined in claim 2 wherein the transformation operation is a shift operation, and further comprising determining whether the first block of the sample image substantially matches a fourth block of pixels of the reference image in a neighborhood of the second block to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable.

9. A method as defined in claim 8 wherein the neighborhood of the second block comprises blocks of pixels of the reference image adjacent to the second block, and wherein the first block of the sample image substantially matches the fourth block of the reference image when a correlation value is less than or equals a threshold.

10. A method as defined in claim 8 further comprising determining that the difference between the first and second blocks is resolvable when the first block of the sample image is determined to match any block in the neighborhood of the second block of the reference image.

11. A method as defined in claim 1 wherein the first block is substantially flat when the first block includes pixels exhibiting a substantially similar first color and first intensity, and wherein the second block is substantially flat when the second block includes pixels exhibiting a substantially similar second color and second intensity.

12. A method as defined in claim 1 further comprising determining that the difference between the first and second blocks is resolvable when both the first and second blocks are determined to be substantially flat.

13. A method as defined in claim 2 wherein the reference image is a first reference image, and further comprising:

generating a sample image signature representative of the sample image, the sample image signature being different from the difference signature representative of the unresolved difference region;

comparing the sample image signature and a plurality of reference image signatures representative of a respective plurality of reference images; and

selecting the first reference image from the plurality of reference images when a first reference image signature representative of the first reference image is determined to substantially match the sample image signature.

14. A method as defined in claim 2 further comprising obtaining information describing the unresolved difference region in response to generating a user prompt including the sample image with the unresolved difference region being highlighted.

15. A tangible storage medium as defined in claim 4 wherein the transformation operation is a shift operation, and wherein the machine readable instructions, when executed, further cause the machine to determine whether the first block of the sample image substantially matches a fourth block of pixels of the reference image in a neighborhood of adjacent blocks of the second block to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable.

16. A tangible storage medium as defined in claim 4 wherein the reference image is a first reference image, and wherein the machine readable instructions, when executed, further cause the machine to:

generate a sample image signature representative of the sample image, the sample image signature being different from the difference signature representative of the unresolved difference region, the difference signature being larger than the sample image signature;

compare the sample image signature and a plurality of reference image signatures representative of a respective plurality of reference images; and

select the first reference image from the plurality of reference images when a first reference image signature representative of the first reference image is determined to substantially match the sample image signature.

17. An image difference identifier as defined in claim 6 wherein the transformation operation is a shift operation, and wherein the difference resolver is to determine whether the first block of the sample image substantially matches a fourth block of pixels of the reference image in a neighborhood comprising adjacent blocks of the second block to determine whether the difference between the first block of the sample image and the second block of the reference image is resolvable.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 024849 / FRAME 0178) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061728/0284 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SECURITY AGREEMENT Recorded Aug 17, 2010
From: THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024849/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2010
From: DENG, KEVIN KEQIANG
To: THE NIELSEN COMPANY (US), LLC, A DELAWARE LIMITED LIABILITY COMPANY
Reel/Frame 024267/0315 →