IP Library Granted Patent US 10,354,395
Granted Patent B2
US 10,354,395 · App. 15/609,887 · Granted Jul 16, 2019

Methods and apparatus to improve detection and false alarm rate over image segmentation

Inventors: Jonathan Sullivan (Natick, MA); Brian Schiller (St. Louis, MO); Alejandro Terrazas (Santa Cruz, CA); Wei Xie (Woodridge, IL); Michael Allen Bivins (San Francisco, CA)
Assignee: THE NIELSEN COMPANY (US), LLC
G06T7/231G06T7/12G06T7/143G06T7/74G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,354,395
App. No.
15/609,887
Granted
Jul 16, 2019
Kind
B2
Abstract

Methods and apparatus to improve detection and false alarm rate over image segmentation are disclosed. An example method includes determining a first score based on a first pixel distance between a first feature of a first object in a reference image and a second feature in a second image of a search area, determining a second score corresponding to a second pixel distance between the second feature and a mathematical representation of a plurality of shapes representing a similarity between the second feature in the second image of the search area and the plurality of shapes observed simultaneously. The method further includes determining a normalized score by normalizing the first score based on the second score and identifying a second object in the second image of the search area as the first object in the reference image when the normalized score satisfies a threshold score.

Claims (44)

1. An apparatus to detect an object comprising:

an image scorer to:

determine a first score based on a first pixel distance between a first feature of a first object in a reference image and a second feature in a second image of a search area; and

determine a second score corresponding to a second pixel distance between the second feature and a mathematical representation of a plurality of shapes representing a similarity between the second feature in the second image of the search area and the plurality of shapes observed simultaneously;

a normalizer to determine a normalized score by normalizing the first score based on the second score; and

an object detector to identify a second object in the second image of the search area as the first object in the reference image when the normalized score satisfies a threshold score.

2. The apparatus of claim 1 , wherein the second score represents a lesser similarity between the second feature and the plurality of shapes observed simultaneously than a second similarity between the second feature and any one of the plurality of shapes.

3. The apparatus of claim 1 , wherein the plurality of shapes are representative of background clutter.

4. The apparatus of claim 1 , wherein the second feature in the second image includes an edge of a retail store shelf.

5. The apparatus of claim 1 , wherein the image scorer is to determine the second score by cross-correlating the second feature with a matrix of ones having a same perimeter as the first object.

6. The apparatus of claim 1 , wherein when the normalized score does not satisfy the threshold score:

the image scorer is further to:

determine a third score based on a third pixel distance between the first feature of the first object in the reference image and a third feature in the second image of the search area, the third feature at a different location in the second image than the second feature in the second image; and

determine a fourth score corresponding to a fourth pixel distance between the third feature and a second mathematical representation of a second plurality of shapes representing a similarity between the third feature in the second image of the search area and the second plurality of shapes observed simultaneously;

the normalizer is further to determine a second normalized score by normalizing the third score based on the fourth score; and

the object detector is further to identify the second object in the second image of the search area as the first object in the reference image when the second normalized score satisfies the threshold score.

7. A method to detect an object in an image comprising:

determining, by executing an instruction with a processor, a first score based on a first pixel distance between a first feature of a first object in a reference image and a second feature in a second image of a search area;

determining, by executing an instruction with the processor, a second score corresponding to a second pixel distance between the second feature and a mathematical representation of a plurality of shapes representing a similarity between the second feature in the second image of the search area and the plurality of shapes observed simultaneously;

determining, by executing an instruction with the processor, a normalized score by normalizing the first score based on the second score; and

identifying, by executing an instruction with the processor, a second object in the second image of the search area as the first object in the reference image when the normalized score satisfies a threshold score.

8. The method of claim 7 , wherein the second score represents a lesser similarity between the second feature and the plurality of shapes observed simultaneously than a second similarity between the second feature and any one of the plurality of shapes.

9. The method of claim 7 , wherein the plurality of shapes are representative of background clutter.

10. The method of claim 7 , wherein the second feature in the second image includes an edge of a retail store shelf.

11. The method of claim 7 , wherein determining the second score further includes cross-correlating the second feature with a matrix of ones having a same perimeter as the first object.

12. The method of claim 7 , further including, when the normalized score does not satisfy the threshold score:

determining, by executing an instruction with the processor, a third score based on a third pixel distance between the first feature of the first object in the reference image and a third feature in the second image of the search area, the third feature at a different location in the second image than the second feature in the second image;

determining, by executing an instruction with the processor, a fourth score corresponding to a fourth pixel distance between the third feature and a second mathematical representation of a second plurality of shapes representing a similarity between the third feature in the second image of the search area and the second plurality of shapes observed simultaneously;

determining, by executing an instruction with the processor, a second normalized score by normalizing the third score based on the fourth score; and

identifying, by executing an instruction with the processor, the second object in the second image of the search area as the first object in the reference image when the second normalized score satisfies the threshold score.

13. A non-transitory computer readable storage medium comprising instructions, that when executed, cause a processor to at least:

determine a first score based on a first pixel distance between a first feature of a first object in a reference image and a second feature in a second image of a search area;

determine a second score corresponding to a second pixel distance between the second feature and a mathematical representation of a plurality of shapes representing a similarity between the second feature in the second image of the search area and the plurality of shapes observed simultaneously;

determine a normalized score by normalizing the first score based on the second score; and

identify a second object in the second image of the search area as the first object in the reference image when the normalized score satisfies a threshold score.

14. The non-transitory computer readable storage medium of claim 13 , wherein the second score represents a lesser similarity between the second feature and the plurality of shapes observed simultaneously than a second similarity between the second feature and any one of the plurality of shapes.

15. The non-transitory computer readable storage medium of claim 13 , wherein the plurality of shapes are representative of background clutter.

16. The non-transitory computer readable storage medium of claim 13 , wherein the second feature in the second image includes an edge of a retail store shelf.

17. The non-transitory computer readable storage medium of claim 13 , wherein the instructions are further to cause the processor to determine the second score by cross-correlating the second feature with a matrix of ones having a same perimeter as the first object.

18. The non-transitory computer readable storage medium of claim 13 , wherein when the normalized score does not satisfy the threshold score, the instructions are further to cause the processor to:

determine a third score based on a third pixel distance between the first feature of the first object in the reference image and a third feature in the second image of the search area, the third feature at a different location in the second image than the second feature in the second image;

determine a fourth score corresponding to a fourth pixel distance between the third feature and a second mathematical representation of a second plurality of shapes representing a similarity between the third feature in the second image of the search area and the second plurality of shapes observed simultaneously;

determine a second normalized score by normalizing the third score based on the fourth score; and

identify the second object in the second image of the search area as the first object in the reference image when the second normalized score satisfies the threshold score.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2017
From: SULLIVAN, JONATHAN; SCHILLER, BRIAN; TERRAZAS, ALEJANDRO; XIE, WEI; BIVINS, MICHAEL ALLEN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 042563/0228 →
Continuity (2)
Continuation 14810989 · Jul 28, 2015
Related Publication 20170270676A1 · Sep 21, 2017