IP Library Granted Patent US 11,763,591
Granted Patent B2
US 11,763,591 · App. 16/998,814 · Granted Sep 19, 2023

Methods and apparatus to determine an audience composition based on voice recognition, thermal imaging, and facial recognition

Inventors: John T. LiVoti (Clearwater, FL); Stanley Wellington Woodruff (Palm Harbor, FL)
Assignee: The Nielsen Company (US), LLC
G06V40/10G06V10/751G10L25/51G10L25/78H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,763,591
App. No.
16/998,814
Filed
Aug 20, 2020
Granted
Sep 19, 2023
Kind
B2
Art Unit
2666
USPC
382/103
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed. An example apparatus includes an audio detector to determine a first audience count based on signatures of audio data captured in the media environment, a thermal image detector to determine a heat blob count based on a frame of thermal image data captured in the media environment, and an audience image detector to identify at least one audience member based on a comparison of a frame of audience image data with a library of reference audience images, the audience image detector to perform the comparison in response to the first audience count not matching the heat blob count.

Claims (35)

1. An apparatus to measure an audience in a media environment, the apparatus comprising:

a media identifier to generate first media identification signatures to identify media presented by a media device, the first media identification signatures to be generated from first audio data obtained with a first audio sensor in the media environment;

an audio detector to determine a first audience count based on second signatures generated, based on a same signature generation technique as the first media identification signatures, from second audio data obtained with a second audio sensor in the media environment;

a thermal image detector to determine a heat blob count based on a first frame of thermal image data captured in the media environment;

a light imaging sensor to capture a second frame of audience image data associated with a field of view, the light imaging sensor to focus the field of view based on the first frame of thermal image data captured in the media environment; and

an audience image detector to identify at least one audience member based on a comparison of the second frame of audience image data with a library of reference audience images, the audience image detector to perform the comparison in response to the first audience count not matching the heat blob count.

2. The apparatus of claim 1 , further including a comparator to compare the first audience count and the heat blob count.

3. The apparatus of claim 1 , further including a people meter controller to cause a people meter, which is to emit a prompt for audience identification information, to not emit the prompt for at least a first time period after the at least one audience member is identified.

4. The apparatus of claim 3 , wherein the people meter controller is to cause the people meter to emit the prompt in response to the audience image detector not identifying a number of audience members in the second frame of audience image data equal to the heat blob count.

5. The apparatus of claim 1 , wherein the audio detector is to identify the at least one audience member based on a second comparison of the second signatures generated from the second audio data with a library of reference signatures, the audio detector to perform the second comparison when the first audience count matches the heat blob count.

6. The apparatus of claim 5 , wherein the audience image detector is not to capture the second frame of audience image data in response to the audio detector identifying the at least one audience member.

7. The apparatus of claim 1 , wherein the audio detector is to identify at least one speech pattern based on the second signatures generated from the second audio data.

8. A non-transitory computer readable storage medium comprising instructions that, when executed, cause one or more processors to at least:

generate first media identification signatures to identify media presented by a media device, the first media identification signatures to be generated from first audio data obtained with a first audio sensor in a media environment;

determine a first audience count based on second signatures generated, based on a same signature generation technique as the first media identification signatures, from second audio data obtained with a second audio sensor in the media environment;

determine a heat blob count based on a first frame of thermal image data captured in the media environment;

cause a second frame of audience image data to be captured, the second frame of audience image data associated with a field of view to be focused based on the first frame of thermal image data captured in the media environment; and

identify at least one audience member based on a comparison of the second frame of audience image data with a library of reference audience images, the comparison performed in response to the first audience count not matching the heat blob count.

9. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the one or more processors to compare the first audience count and the heat blob count.

10. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the one or more processors to cause a people meter, which is to emit a prompt for audience identification information, to not emit the prompt for at least a first time period after the at least one audience member is identified.

11. The non-transitory computer readable storage medium of claim 10 , wherein the instructions, when executed, cause the one or more processors to cause the people meter to emit the prompt in response to not identifying a number of audience members in the second frame of audience image data equal to the heat blob count.

12. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the one or more processors to identify the at least one audience member based on a second comparison of the second signatures generated from the second audio data with a library of reference signatures, the second comparison performed when the first audience count matches the heat blob count.

13. The non-transitory computer readable storage medium of claim 12 , wherein the instructions, when executed, cause the one or more processors not to capture the second frame of audience image data in response to identifying the at least one audience member.

14. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the one or more processors to identify at least one speech pattern based on the second signatures generated from the second audio data.

15. A method to measure an audience in a media environment, the method comprising:

generating first media identification signatures to identify media presented by a media device, the first media identification signatures to be generated from first audio data obtained with a first audio sensor in the media environment;

determining a first audience count based on second signatures generated, based on a same signature generation technique as the first media identification signatures, from second audio data obtained with a second audio sensor in the media environment;

determining a heat blob count based on a first frame of thermal image data captured in the media environment;

capturing a second frame of audience image data associated with a field of view, the field of view focused based on the first frame of thermal image data captured in the media environment; and

identifying at least one audience member based on a comparison of the second frame of audience image data with a library of reference audience images, the comparison performed in response to the first audience count not matching the heat blob count.

16. The method of claim 15 , further including causing a people meter, which is to emit a prompt for audience identification information, to not emit the prompt for at least a first time period after the at least one audience member is identified.

17. The method of claim 16 , further including causing the people meter to emit the prompt in response to not identifying a number of audience members in the second frame of audience image data equal to the heat blob count.

18. The method of claim 15 , further including identifying the at least one audience member based on a second comparison of the second signatures generated from the second audio data with a library of reference signatures, the second comparison performed when the first audience count matches the heat blob count.

19. The method of claim 18 , further including not capturing the second frame of audience image data in response to identifying the at least one audience member.

20. The method of claim 15 , further including identifying at least one speech pattern based on the second signatures generated from the second audio data.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: LIVOTI, JOHN T.; WOODRUFF, STANLEY WELLINGTON
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 054199/0137 →
Continuity (1)
Related Publication 20220058382A1 · Feb 24, 2022