IP Library › Granted Patent US 11,373,425
Granted Patent B2
US 11,373,425 · App. 16/890,715 · Granted Jun 28, 2022

Methods and apparatus for monitoring an audience of media based on thermal imaging

Inventors: John T. Livoti (Clearwater, FL); Rajakumar Madhanganesh (Oldsmar, FL); Stanley Wellington Woodruff (Palm Harbor, FL); Khushboo Agarwal (Oldsmar, FL)
Assignee: The Nielsen Company (U.S.), LLC
G06V40/10G06V10/40G06V20/53H04N5/33H04N21/4223H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,373,425
App. No.
16/890,715
Granted
Jun 28, 2022
Kind
B2
Abstract

Methods, apparatus, systems, and articles of manufacture are disclosed. An example apparatus includes a thermal image detector to determine a heat blob count based on a frame of thermal image data, the frame of thermal image data captured in the media environment, a comparator to compare the heat blob count to a prompted people count, the prompted people count based on one or more responses to a prompting message, and when the heat blob count and the prompted people count match, cause a timer that is to trigger generation of the prompting message to be reset.

Claims (34)

1. An apparatus to count people in a media environment, the apparatus comprising:

a thermal image detector to determine a heat blob count based on a frame of thermal image data, the frame of thermal image data corresponding to the media environment;

a comparator to:

compare the heat blob count to a prompted people count, the prompted people count based on one or more responses to a prompting message;

when the heat blob count and the prompted people count match, cause a timer that is to trigger generation of the prompting message to be reset; and

a controller to train a machine learning model based on a feature vector including a verified people count, at least one of a day or time corresponding to the verified people count, and a media source detected in the media environment during the at least one of the day or time, the verified people count based on the comparison of the heat blob count to the prompted people count, the machine learning model to predict subsequent people counts based on features representative of the media environment.

2. The apparatus of claim 1 , wherein the comparator is to cause the prompting message to be generated when the prompted people count does not match the heat blob count.

3. The apparatus of claim 1 , wherein when the comparator determines the prompted people count is greater than the heat blob count, the comparator is to decrease the prompted people count to equal the heat blob count.

4. The apparatus of claim 1 , wherein the controller is a first controller, and further including a second controller to determine the prompted people count based on the one or more responses to the prompting message, the one or more responses associated with unique people identifiers.

5. The apparatus of claim 4 , wherein the second controller is to generate the prompting message to request a response to provide an input or remove an input.

6. The apparatus of claim 1 , wherein the thermal image detector is to evaluate features in the frame of thermal image data to detect one or more human size heat blobs, the one or more human size heat blobs corresponding to the heat blob count.

7. The apparatus of claim 1 , wherein the comparator is to verify a number of people in the media environment based on comparison of the heat blob count and the prompted people count.

8. A method to count people in a media environment, the method comprising:

determining a heat blob count based on a frame of thermal image data, the frame of thermal image data captured in the media environment;

comparing the heat blob count to a prompted people count, the prompted people count based on one or more responses to a prompting message;

when the heat blob count and the prompted people count match, causing a timer that is to trigger generation of the prompting message to be reset; and

training a machine learning model based on a feature vector including a verified people count, at least one of a day or time corresponding to the verified people count, and a media source detected in the media environment during the at least one of the day or time, the verified people count based on the comparison of the heat blob count to the prompted people count, the machine learning model to predict subsequent people counts based on features representative of the media environment.

9. The method of claim 8 , wherein further including causing the prompting message to be generated when the prompted people count does not match the heat blob count.

10. The method of claim 8 , further including decreasing the prompted people count to equal the heat blob count when the prompted people count is greater than the heat blob count.

11. The method of claim 8 , further including determining the prompted people count based on the one or more responses to the prompting message, the one or more responses associated with unique people identifiers.

12. The method of claim 11 , further including generating the prompting message to request a response to provide an input or remove an input.

13. The method of claim 8 , further including evaluating features in the frame of thermal image data to detect one or more human size heat blobs, the one or more human size heat blobs corresponding to the heat blob count.

14. The method of claim 8 , further including verifying a number of people in the media environment based on comparison of the heat blob count and the prompted people count.

15. A non-transitory computer readable storage medium comprising instructions that, when executed, cause one or more processors to at least:

determine a heat blob count based on a frame of thermal image data, the frame of thermal image data captured in a media environment;

compare the heat blob count to a prompted people count, the prompted people count based on one or more responses to a prompting message;

when the heat blob count and the prompted people count match, cause a timer that is to trigger generation of the prompting message to be reset; and

train a machine learning model based on a feature vector including a verified people count, at least one of a day or time corresponding to the verified people count, and a media source detected in the media environment during the at least one of the day or time, the verified people count based on the comparison of the heat blob count to the prompted people count, the machine learning model to predict subsequent people counts based on features representative of the media environment.

16. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the one or more processors to cause the prompting message to be generated when the prompted people count does not match the heat blob count.

17. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the one or more processors to decrease the prompted people count to equal the heat blob count when the prompted people count is greater than the heat blob count.

18. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the one or more processors to determine the prompted people count based on the one or more responses to the prompting message, the one or more responses associated with unique people identifiers.

19. The non-transitory computer readable storage medium of claim 18 , wherein the instructions, when executed, cause the one or more processors to generate the prompting message to request a response to provide an input or remove an input.

20. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the one or more processors to evaluate features in the frame of thermal image data to detect one or more human size heat blobs, the one or more human size heat blobs corresponding to the heat blob count.

21. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the one or more processors to verify a number of people in the media environment based on comparison of the heat blob count and the prompted people count.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2020
From: LIVOTI, JOHN T.; MADHANGANESH, RAJAKUMAR; WOODRUFF, STANLEY WELLINGTON; AGARWAL, KHUSHBOO
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 053754/0131 →
Continuity (1)
Related Publication 20210374394A1 · Dec 2, 2021
Cited By (1)
US 12,301,932