IP Library Granted Patent US 10,136,184
Granted Patent B2
US 10,136,184 · App. 15/893,226 · Granted Nov 20, 2018

Methods and apparatus to detect people

Inventor: Michael Alan Hicks (Clearwater, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44218G06K9/00026G06K9/00228G06K9/00771G06K9/2018H04H60/33H04H60/45H04N21/25891H04N21/4223H04N21/44222H04N21/6582H05K999/99G06K9/00268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,136,184
App. No.
15/893,226
Granted
Nov 20, 2018
Kind
B2
Abstract

Example apparatus disclosed herein include processor circuitry and memory including machine executable instructions which, when executed, cause the processor circuitry to generate a first presence indication based on a threshold number of portions of an image including a first human pulse waveform. The example instructions, when executed, also cause the processor circuitry to identify a first location associated with a face in the image based on thermal imaging data, and adjust a first count based on a comparison of the first location associated with the face and a second location associated with the first presence indication.

Claims (45)

1. An apparatus, comprising:

processor circuitry; and

memory including machine executable instructions which, when executed, cause the processor circuitry to:

generate a first presence indication based on a threshold number of portions of an image including a first human pulse waveform;

identify a first location associated with a face in the image based on thermal imaging data; and

adjust a first count based on a comparison of the first location associated with the face and a second location associated with the first presence indication.

2. The apparatus as described in claim 1 , wherein the instructions, when executed, cause the processor circuitry to:

decrement the first count when the first location does not correspond to the second location.

3. The apparatus as described in claim 1 , wherein the instructions, when executed, further cause the processor circuitry to:

identify a third location associated with a non-face body part based on the thermal imaging data; and

decrement the first count when the third location corresponds to the second location.

4. The apparatus as described in claim 1 , wherein the instructions, when executed, further cause the processor circuitry to:

generate a second count of presence indications, the presence indications based on a threshold number of portions of the image including corresponding human pulse waveforms; and

generate a third count of faces in the image based on the thermal imaging data; and

adjust the first count when the second count of presence indications does not correspond to the third count of faces.

5. The apparatus as described in claim 4 , wherein the instructions, when executed, cause the processor circuitry to increment the first count when the first location associated with the face does not correspond to any of the presence indications.

6. The apparatus as described in claim 4 , wherein the instructions, when executed, cause the processor circuitry to not adjust the first count when respective locations associated with the faces in the image correspond to respective locations of the presence indications.

7. The apparatus as described in claim 1 , wherein the image is obtained from a light sensor array, and the thermal image data is obtained from a thermal imaging device different from the light sensor array.

8. The apparatus as described in claim 1 , wherein the portions of the image include vertical strips spanning across at least part of the image.

9. An apparatus, comprising:

a grouper to generate a first presence indication based on a threshold number of portions of an image including a first human pulse waveform;

a face identifier to identify a first location associated with a face in the image based on thermal imaging data obtained by a thermal imaging device; and

an adjustor to adjust a people count based on a comparison of the first location associated with the face and a second location associated with the presence indication.

10. The apparatus as described in claim 9 , wherein the adjuster is to decrement the first count when the first location does not correspond to the second location.

11. The apparatus as described in claim 9 , further including:

a non-face identifier to identify a third location associated with a non-face body part based on the thermal imaging data, wherein the adjustor is to decrement the count when the third location corresponds to the second location.

12. The apparatus as described in claim 9 , wherein the grouper is to generate a second count of presence indications, the presence indications based on a threshold number of portions of the image including corresponding human pulse waveforms, the face identifier is to generate a third count of faces in the image based on thermal imaging data, and the adjuster is to adjust the first count when the second count of presence indications does not correspond to the third count of faces.

13. The apparatus as described in claim 12 , wherein the adjuster is to increment the first count when the first location associated with the face does not correspond to any of the presence indications.

14. The apparatus as described in claim 12 , wherein the adjuster is not to adjust the first count when a respective location associated with each face corresponds to a respective location of a respective one of the presence indications.

15. The apparatus as described in claim 9 , wherein the image is obtained from a light sensor array different from the thermal imaging device.

16. The apparatus as described in claim 9 , wherein the portions of the image include vertical strips spanning across at least part of the image.

17. An apparatus, comprising:

means for generating a first presence indication based on a threshold number of portions of an image including a first human pulse waveform;

means for identifying a first location associated with a face in the image based on thermal imaging data, the thermal imaging data different than the image; and

means for adjusting a people count based on a comparison of the first location associated with the face and a second location associated with the first presence indication.

18. The apparatus as described in claim 17 , wherein the means for adjusting is to decrement the first count when the first location does not correspond to the second location.

19. The apparatus as described in claim 17 , further including:

a means for identifying a third location associated with a non-face body part based on the thermal imaging data, and the means for adjusting is to decrement the count when the third location corresponds to the second location.

20. The apparatus as described in claim 17 , wherein the means for generating is to generate a second count of presence indications, the presence indications based on a threshold number of portions of the image including a corresponding human pulse waveform, the means for identifying the first location is to generate a third count of faces in the image based on thermal imaging data, and the means for adjusting is to adjust the first count when the second count of presence indications does not correspond to the third count of faces.

21. The apparatus as described in claim 20 , wherein the means for adjusting is to increment the first count when a first location associated with the face does not correspond to any of the presence indications.

22. The apparatus as described in claim 20 , wherein the means for adjusting is not to adjust the first count when a respective location associated with each face corresponds to a respective location of a respective one of the presence indications.

23. The apparatus as described in claim 17 , further including:

means for receiving light information to generate the image;

means for receiving thermal radiation to generate the thermal imaging data.

24. The apparatus as described in claim 17 , wherein the portions of the image include vertical strips spanning across at least part of the image.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2018
From: HICKS, MICHAEL ALAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 047032/0177 →
Continuity (3)
Continuation 15469968 · Mar 27, 2017
Continuation 14471988 · Aug 28, 2014
Related Publication 20180167679A1 · Jun 14, 2018