IP Library Granted Patent US 10,136,052
Granted Patent B2
US 10,136,052 · App. 15/871,658 · Granted Nov 20, 2018

Methods and apparatus to capture photographs using mobile devices

Inventors: Diego García Morate (Valladolid, ES); Antonio Hurtado Gacia (Valladolid, ES); Javier Tovar Velasco (Valladolid, ES); Carlos Barrales Ruiz (Valladolid, ES)
Assignee: THE NIELSEN COMPANY (US), LLC
H04N5/23222G06K9/22G06T3/4038G06T5/003G06T7/0002G06T7/73H04N5/23254H04N5/23293G06K2009/2045G06K2009/3225G06T2207/30168G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,136,052
App. No.
15/871,658
Granted
Nov 20, 2018
Kind
B2
Abstract

Methods and apparatus to capture photographs using mobile devices are disclosed. An example apparatus includes a photograph capturing controller to capture a photograph with a mobile device. the example apparatus further includes a perspective analyzer, implemented by the mobile device, to analyze the photograph to determine a probability of perspective being present in the photograph. The example apparatus also includes a photograph capturing interface to prompt a user to capture a new photograph when the probability of perspective exceeds a threshold.

Claims (44)

1. An apparatus comprising:

a photograph capturing controller to capture a photograph with a mobile device;

a perspective analyzer, implemented by the mobile device, to analyze the photograph to determine a probability of perspective being present in the photograph by:

applying an edge detection filter to the photograph to determine edge pixels corresponding to edges identified by the edge detection filter within the photograph;

evaluating potential edge lines passing through a first one of the edge pixels;

determining a first one of the potential edge lines that passes through more of the edge pixels than other ones of the potential edge lines; and

calculating the probability of perspective based on an angle of the first one of the potential edge lines; and

a photograph capturing interface to prompt a user to capture a new photograph when the probability of perspective exceeds a threshold.

2. The apparatus of claim 1 , wherein a quantity of the edge pixels through which the potential edge lines pass through is normalized by a length of respective ones of the potential edge lines, the length of the respective ones of potential edge lines defined by a perimeter of the photograph.

3. The apparatus of claim 1 , wherein the perspective analyzer is to calculate a second one of the potential edge lines for a second one of the edge pixels and to calculate the probability of perspective based on a difference in angles of the first and second ones of the potential edge lines.

4. The apparatus of claim 3 , wherein the perspective analyzer is to divide the photograph into separate areas, the first edge pixel corresponding to a first one of the areas and the second edge pixel corresponding to a second one of the areas.

5. The apparatus of claim 4 , wherein the separate areas extend across an entire width of the photograph in a horizontal direction.

6. The apparatus of claim 1 , wherein the perspective analyzer is to calculate the probability of perspective by applying a logistic model to a plurality of angles corresponding to a plurality of lines identified for a plurality of areas of the photograph, the plurality of lines including the first one of the potential edge lines.

7. The apparatus of claim 1 , wherein the perspective analyzer is to generate the potential edge lines by:

determining a series of lines passing through the first edge pixel at different angles between a range of angles within a threshold angle of a line extending perpendicular to a direction of the edge detection filter; and

defining end points for each line in the series of lines based on a size of the photograph.

8. The apparatus of claim 1 , wherein the edge detection filter is applied in a vertical direction such that at least some of the edges identified by the edge detection filter correspond to a horizontal shelf of a shelving module captured in the photograph.

9. A non-transitory computer readable medium comprising instructions that, when executed, causes a processor to at least:

capture a photograph with a mobile device;

determine a probability of perspective being present in the photograph by:

applying an edge detection filter to the photograph to determine edge pixels corresponding to edges identified by the edge detection filter within the photograph;

evaluating potential edge lines passing through a first one of the edge pixels;

determining a first one of the potential edge lines that passes through more of the edge pixels than other ones of the potential edge lines; and

calculating the probability of perspective based on an angle of the first one of the potential edge lines; and

prompt a user to capture a new photograph when the probability of perspective exceeds a threshold.

10. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor to normalize a quantity of the edge pixels through which the potential edge lines pass through based on a length of respective ones of the potential edge lines, the length of the respective ones of the potential edge lines defined by a perimeter of the photograph.

11. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor to calculate a second one of the potential edge lines for a second one of the edge pixels and to calculate the probability of perspective based on a difference in angles of the first and second ones of the potential edge lines.

12. The non-transitory computer readable medium of claim 11 , wherein the instructions further cause the processor to divide the photograph into separate areas, the first edge pixel corresponding to a first one of the areas and the second edge pixel corresponding to a second one of the areas.

13. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor to calculate the probability of perspective by applying a logistic model to a plurality of angles corresponding to a plurality of best lines identified for a plurality of areas of the photograph.

14. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor to generate the potential edge lines by:

determining a series of lines passing through the first edge pixel at different angles between a range of angles within a threshold angle of a line extending perpendicular to a direction of the edge detection filter; and

defining end points for each line in the series of lines based on a size of the photograph.

15. The non-transitory computer readable medium of claim 9 , wherein the edge detection filter is applied in a vertical direction such that at least some of the edges identified by the edge detection filter correspond to a horizontal shelf of a shelving module captured in the photograph.

16. A method comprising:

capturing a photograph with a mobile device;

determining, by executing an instruction with a processor, a probability of perspective being present in the photograph by:

applying an edge detection filter to the photograph to determine edge pixels corresponding to edges identified by the edge detection filter within the photograph;

evaluating potential edge lines passing through a first one of the edge pixels;

determining a first one of the potential edge lines that passes through more of the edge pixels than other ones of the potential edge lines; and

calculating the probability of perspective based on an angle of the first one of the potential edge lines; and

prompting, by executing an instruction with the processor, a user to capture a new photograph when the probability of perspective exceeds a threshold.

17. The method of claim 16 , further including generating the potential edge lines by:

determining a series of lines passing through the first edge pixel at different angles between a range of angles within a threshold angle of a line extending perpendicular to a direction of the edge detection filter; and

defining end points for each line in the series of lines based on a size of the photograph.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2018
From: GARCÍA MORATE, DIEGO; HURTADO GARCIA, ANTONIO; TOVAR VELASCO, JAVIER; BARRALES RUIZ, CARLOS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 044623/0250 →
Continuity (3)
Continuation 14796813 · Jul 10, 2015
Continuation In Part PCTIB2015001103 · Jun 18, 2015
Related Publication 20180139381A1 · May 17, 2018