IP Library Granted Patent US 10,282,607
Granted Patent B2
US 10,282,607 · App. 15/317,674 · Granted May 7, 2019

Reducing scale estimate errors in shelf images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,282,607
App. No.
15/317,674
Granted
May 7, 2019
Kind
B2
Abstract

Example image processing methods, apparatus/systems and articles of manufacture are disclosed herein. An example apparatus includes an image recognition application to identify matches between stored patterns and objects detected in a shelf image, where the shelf image has a shelf image scale estimate. The example apparatus further includes a scale corrector to calculate deviation values between sizes of (A) a first set of the objects detected in the shelf image and (B) a first set of the stored patterns matched with the first set of the objects and reduce an error of the shelf image scale estimate by calculating a scale correction value for the shelf image scale estimate based on the deviation values.

Claims (33)

1. An apparatus to reduce scale estimate errors, the apparatus comprising:

an image recognition application to identify matches between stored patterns and objects detected in a shelf image, the shelf image having a shelf image scale estimate; and

a scale corrector to:

calculate deviation values between sizes of (A) a first set of the objects detected in the shelf image and (B) a first set of the stored patterns matched with the first set of the objects; and

reduce an error of the shelf image scale estimate by calculating a scale correction value for the shelf image scale estimate based on the deviation values.

2. The apparatus as defined in claim 1 , wherein the scale corrector is to calculate the deviation values by determining a difference in pixel dimensions of a first scaled version of a first pattern of the first set of the stored patterns and a first object of the first set of the objects matched with the first pattern.

3. The apparatus as defined in claim 2 , further including a rescaler to generate the first scaled version of the first pattern by rescaling the first pattern based on the shelf image scale estimate.

4. The apparatus as defined in claim 1 , wherein the first set of the stored patterns have optimized scales.

5. The apparatus as defined in claim 4 , further including a pattern scale optimizer to determine the optimized scales for the first set of the stored patterns.

6. The apparatus as defined in claim 4 , wherein the optimized scales are a median of estimated scales for the first set of the stored patterns.

7. The apparatus as defined in claim 1 , wherein the stored patterns include a second set of the stored patterns, the first set of the stored patterns having a number of scale estimates that satisfy a threshold, the second set of the stored patterns having a number of scale estimates that do not satisfy the threshold.

8. The apparatus as defined in claim 1 , wherein the stored patterns are image representations of at least a portion of a product or packaging of a product, respective ones of the first set of the stored patterns having stored scale estimates associated with the respective stored pattern.

9. The apparatus as defined in claim 8 , wherein each of the first set of the stored patterns has a threshold number of stored scale estimates associated with the respective stored pattern.

10. The apparatus as defined in claim 1 , wherein the scale corrector is to calculate additional scale estimates for respective ones of the first set of the stored patterns matched with the first set of the objects based on the sizes of the first set of the objects detected in the shelf image and the scale correction value for the shelf image scale estimate.

11. A method to reduce scale estimate errors, the method comprising:

identifying, by executing an instruction with a processor, matches between stored patterns and objects detected in a shelf image, the shelf image having an shelf image scale estimate;

calculating, by executing an instruction with the processor, deviation values between sizes of (A) a first set of the objects detected in the shelf image and (B) a first set of the stored patterns matched with the first set of the objects; and

reducing an error of the shelf image scale estimate by calculating, by executing an instruction with the processor, a scale correction value for the shelf image scale estimate based on the deviation values.

12. The method as defined in claim 11 , wherein calculating the deviation values includes determining a difference in pixel dimensions of a first scaled version of a first pattern of the first set of the stored patterns and a first object of the first set of the objects matched with the first pattern.

13. The method as defined in claim 12 , further including generating the first scaled version of the first pattern by rescaling the first pattern based on the shelf image scale estimate.

14. The method as defined in claim 11 , wherein the first set of the stored patterns have optimized scales.

15. The method as defined in claim 14 , further including determining the optimized scales for the first set of the stored patterns.

16. The method as defined in claim 14 , wherein the optimized scales are a median of estimated scales for the first set of the stored patterns.

17. The method as defined in claim 11 , wherein the stored patterns include a second set of the stored patterns, the first set of the stored patterns having a number of scale estimates that satisfy a threshold, the second set of the stored patterns having a number of scale estimates that do not satisfy the threshold.

18. A tangible machine readable storage medium comprising instructions that, when executed, cause a machine to at least:

identify matches between stored patterns and objects detected in a shelf image, the shelf image having an shelf image scale estimate;

calculate deviation values between sizes of (A) a first set of the objects detected in the shelf image and (B) a first set of the stored patterns matched with the first set of the objects; and

reduce an error of the shelf image scale estimate by calculating a scale correction value for the shelf image scale estimate based on the deviation values.

19. The tangible machine readable storage medium as defined in claim 18 , wherein the instructions, when executed, cause the machine to calculate the deviation values by determining a difference in pixel dimensions of a first scaled version of a first pattern of the first set of the stored patterns and a first object of the first set of the objects matched with the first pattern.

20. The tangible machine readable storage medium as defined in claim 19 , wherein the instructions, when executed, further cause the machine to generate the first scaled version of the first pattern by rescaling the first pattern based on the shelf image scale estimate.

21. The tangible machine readable storage medium as defined in claim 18 , wherein the first set of the stored patterns have optimized scales.

22. The tangible machine readable storage medium as defined in claim 21 , wherein the instructions, when executed, further cause the machine to determine the optimized scales for the first set of the stored patterns.

23. The tangible machine readable storage medium as defined in claim 18 , wherein the stored patterns include a second set of the stored patterns, the first set of the stored patterns having a number of scale estimates that satisfy a threshold, the second set of the stored patterns having a number of scale estimates that do not satisfy the threshold.

Assignments (8)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded Mar 25, 2021
From: NIELSEN CONSUMER LLC; BYZZER INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 055742/0719 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Mar 10, 2021
From: CITIBANK, N.A.
To: NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN CONSUMER LLC
Reel/Frame 055557/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2021
From: THE NIELSEN COMPANY (US), LLC
To: NIELSEN CONSUMER LLC
Reel/Frame 055325/0353 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2017
From: GARCIA, ANTONIO HURTADO; MARTIN, FRANCISCO JAVIER; MORATE, DIEGO GARCIA
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 041019/0754 →