IP Library Granted Patent US 12,301,932
Granted Patent B2
US 12,301,932 · App. 18/154,379 · Granted May 13, 2025

Methods and apparatus to determine an audience composition based on voice recognition

Inventors: John T. LiVoti (Clearwater, FL); Stanley Wellington Woodruff (Palm Harbor, FL); Rajakumar Madhanganesh (Tampa, FL); Khushboo Agarwal (Oldsmar, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44218G10L15/20G10L15/32H04N21/42203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,932
App. No.
18/154,379
Filed
Jan 13, 2023
Granted
May 13, 2025
Kind
B2
Art Unit
2425
USPC
725/14
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed. An example apparatus includes a controller to cause a people meter to emit a prompt for input of audience identification information at a first time and determine a first audience count based on the input, an audio detector to determine a second audience count based on signatures generated from audio data captured in the media environment, and a comparator to cause the people meter to not emit the prompt for at least a first time period after the first time when the first audience count is equal to the second audience count.

Claims (55)

1. A system comprising:

interface circuitry to obtain audio data;

a processor; and

a memory storing instructions that, when executed by the processor, cause the system to perform operations comprising:

generating a target signature from the audio data, the target signature associated with a first time interval;

comparing the target signature to a plurality of reference signatures in a library of reference signatures, the plurality of reference signatures associated with one or more identified audience members;

in response to a determination that the target signature is not associated with a match in the library of reference signatures, causing a meter to emit a prompt for input of audience identification information associated with the first time interval;

tagging the target signature generated from the audio data with metadata, wherein tagging the target signature comprises:

combining audience metadata comprising the audience identification information with audio metadata comprising one or more characteristics of the audio data from which the target signature was generated to generate combined metadata for the target signature; and

tagging the target signature with the combined metadata.

2. The system of claim 1 , wherein the target signature is one of a plurality of target signatures associated with the first time interval, and wherein the operations further comprise:

determining a first people count associated with the first time interval based on comparison of the target signatures to the library of reference signatures; and

determining whether to cause the meter to emit the prompt for input of audience identification information based on the first people and a second people count associated with a second time interval prior to the first time interval.

3. The system of claim 2 , wherein the operations further comprise:

causing the meter to emit the prompt for input of audience identification information in response to the first people count not matching the second people count; and

causing the meter to not emit the prompt for input of audience identification information in response to the first people count matching the second people count.

4. The system of claim 3 , wherein the operations further comprise: notifying the meter to reset a timer for scheduling generation of prompts.

5. The system of claim 2 , wherein the operations further comprise: determining the first people count based on a number of matches of the target signatures to different reference signatures associated with different ones of the identified audience members.

6. The system of claim 1 , wherein the operations further comprise: initiating signature generation and comparison in response to a media device being turned on.

7. The system of claim 1 , wherein the operations further comprise: performing signature generation and comparison in response to detection of a signal associated with control of a media device.

8. The system of claim 1 , wherein the operations further comprise:

storing the target signature tagged with the combined metadata in a database.

9. The system of claim 1 , wherein the audio metadata comprises metadata indicative of a device that captured the audio data.

10. A non-transitory computer readable storage medium comprising computer readable instructions that, when executed, cause a processor to perform operations comprising:

generating a target signature from audio data, the target signature associated with a first time interval;

comparing the target signature to a plurality of reference signatures in a library of reference signatures, the plurality of reference signatures associated with one or more identified audience members;

in response to a determination that the target signature is not associated with a match in the library of reference signatures, causing a meter to emit a prompt for input of audience identification information associated with the first time interval;

tagging the target signature generated from the audio data with metadata, wherein tagging the target signature comprises:

combining audience metadata comprising the audience identification information with audio metadata comprising one or more characteristics of the audio data from which the target signature was generated to generate combined metadata for the target signature; and

tagging the target signature with the combined metadata.

11. The non-transitory computer readable storage medium of claim 10 , wherein the target signature is one of a plurality of target signatures associated with the first time interval, and wherein the operations further comprise:

determining a first people count associated with the first time interval based on comparison of the target signatures to the library of reference signatures; and

determining whether to cause the meter to emit the prompt for input of audience identification information based on the first people and a second people count associated with a second time interval prior to the first time interval.

12. The non-transitory computer readable storage medium of claim 11 , wherein the operations further comprise:

causing the meter to emit the prompt for input of audience identification information in response to the first people count not matching the second people count; and

causing the meter to not emit the prompt for input of audience identification information in response to the first people count matching the second people count.

13. The non-transitory computer readable storage medium of claim 12 , wherein to the operations further comprise: notifying the meter to reset a timer for scheduling generation of prompts.

14. The non-transitory computer readable storage medium of claim 11 , wherein the operations further comprise: determining the first people count based on a number of matches of the target signatures to different reference signatures associated with different ones of the identified audience members.

15. The non-transitory computer readable storage medium of claim 10 , wherein the operations further comprise: initiating signature generation and comparison in response to a media device being turned on.

16. The non-transitory computer readable storage medium of claim 10 , wherein the operations further comprise: performing signature generation and comparison in response to detection of a signal associated with control of a media device.

17. A method comprising:

generating a target signature from audio data, the target signature associated with a first time interval;

comparing, by executing a first instruction with a processor, the target signature to a plurality of reference signatures in a library of reference signatures, the plurality of reference signatures associated with one or more identified audience members;

in response to a determination that the target signature is not associated with a match in the library of reference signatures, triggering, by executing a second instruction with the processor, a meter to emit a prompt for input of audience identification information associated with the first time interval;

assigning an audience member identifier to the audience identification information associated with the first time interval; and

tagging the target signature generated from the audio data with metadata, wherein tagging the target signature comprises:

combining audience metadata comprising the audience member identifier with audio metadata comprising one or more characteristics of the audio data from which the target signature was generated to generate combined metadata for the target signature; and

tagging the target signature with the combined metadata.

18. The method of claim 17 , wherein the target signature is one of a plurality of target signatures associated with the first time interval, and wherein the method further comprises:

determining a first people count associated with the first time interval based on comparison of the target signatures to the library of reference signatures; and

determining whether to trigger the meter to emit the prompt for input of audience identification information based on the first people and a second people count associated with a second time interval prior to the first time interval.

19. The method of claim 18 , further comprising:

triggering the meter to emit the prompt for input of audience identification information in response to the first people count not matching the second people count; and

causing the meter to not emit the prompt for input of audience identification information in response to the first people count matching the second people count.

20. The method of claim 19 , wherein the causing of the meter to not emit the prompt comprises: notifying the meter to reset a timer for scheduling generation of prompts.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2023
From: LIVOTI, JOHN T.; WOODRUFF, STANLEY WELLINGTON; MADHANGANESH, RAJAKUMAR; AGARWAL, KHUSHBOO
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 063543/0225 →
Continuity (2)
Continuation 16998811 · Aug 20, 2020
Related Publication 20230232071A1 · Jul 20, 2023
References Cited (130)
US 4769697A · Gilley et al. · 1988 [cited by applicant]
US 5995206A · Morinaka et al. · 1999 [cited by applicant]
US 6029124A · Gillick et al. · 2000 [cited by applicant]
US 7155159B1 · Weinblatt et al. · 2006 [cited by applicant]
US 7609853B2 · Ramaswamy et al. · 2009 [cited by applicant]
US 7752042B2 · Srinivasan · 2010 [cited by applicant]
US 7839291B1 · Richards · 2010 [cited by applicant]
US 7985953B2 · Luterotti et al. · 2011 [cited by applicant]
US 8091100B2 · Donato · 2012 [cited by applicant]
US 8571865B1 · Hewinson · 2013 [cited by applicant]
US 8849199B2 · Shrum, Jr. et al. · 2014 [cited by applicant]
US 9100132B2 · Kolessar et al. · 2015 [cited by applicant]
US 9100685B2 · Conrad et al. · 2015 [cited by applicant]
US 9183849B2 · Neuhauser et al. · 2015 [cited by applicant]
US 9219559B2 · McMillan · 2015 [cited by applicant]
US 9363155B1 · Gravino et al. · 2016 [cited by applicant]
US 9489640B2 · Neuhauser et al. · 2016 [cited by applicant]
US 9503536B2 · Bosworth et al. · 2016 [cited by applicant]
US 9628844B2 · Conrad et al. · 2017 [cited by applicant]
US 9667920B2 · Deng · 2017 [cited by applicant]
US 9711034B2 · Daniel · 2017 [cited by applicant]
US 9918127B2 · Hicks · 2018 [cited by applicant]
US 10032451B1 · Mamkina et al. · 2018 [cited by applicant]
US 10657383B1 · Solh et al. · 2020 [cited by applicant]
US 10860645B2 · Oh · 2020 [cited by applicant]
US 11151858B2 · Modiano · 2021 [cited by applicant]
US 11176940B1 · Zhong et al. · 2021 [cited by applicant]
US 11373425B2 · Livoti et al. · 2022 [cited by applicant]
US 11553247B2 · Woodruff et al. · 2023 [cited by applicant]
US 11595723B2 · LiVoti et al. · 2023 [cited by applicant]
US 20020052746A1 · Handelman · 2002 [cited by applicant]
US 20020198762A1 · Donato · 2002 [cited by applicant]
US 20030046083A1 · Devinney, Jr. · 2003 [cited by examiner]
US 20030229492A1 · Nolan · 2003 [cited by examiner]
US 20040059438A1 · Sherlock · 2004 [cited by applicant]
US 20050044189A1 · Ikezoye et al. · 2005 [cited by applicant]
US 20050144632A1 · Mears · 2005 [cited by examiner]
US 20050172319A1 · Reichardt · 2005 [cited by examiner]
US 20060062429A1 · Ramaswamy et al. · 2006 [cited by applicant]
US 20070011040A1 · Wright et al. · 2007 [cited by applicant]
US 20080010066A1 · Broman · 2008 [cited by examiner]
US 20090002144A1 · Bernard et al. · 2009 [cited by applicant]
US 20090290756A1 · Ramaswamy · 2009 [cited by examiner]
US 20100162285A1 · Cohen et al. · 2010 [cited by applicant]
US 20100195865A1 · Luff · 2010 [cited by applicant]
US 20110004474A1 · Bansal et al. · 2011 [cited by applicant]
US 20110215932A1 · Daniel · 2011 [cited by applicant]
US 20110283316A1 · Chen · 2011 [cited by examiner]
US 20120023976A1 · Kim et al. · 2012 [cited by applicant]
US 20120191231A1 · Wang · 2012 [cited by applicant]
US 20120323566A1 · Johnston · 2012 [cited by examiner]
US 20130016203A1 · Saylor et al. · 2013 [cited by applicant]
US 20130030809A1 · Farrell · 2013 [cited by examiner]
US 20130132271A1 · Daniel · 2013 [cited by applicant]
US 20130312019A1 · McMillan · 2013 [cited by examiner]
US 20140056433A1 · Emerson, III · 2014 [cited by applicant]
US 20140280127A1 · Wang et al. · 2014 [cited by applicant]
US 20140309866A1 · Ricci · 2014 [cited by applicant]
US 20150092019A1 · Asano et al. · 2015 [cited by applicant]
US 20150189378A1 · Soundararajan · 2015 [cited by examiner]
US 20150334457A1 · Chandel et al. · 2015 [cited by applicant]
US 20160065902A1 · Deng · 2016 [cited by examiner]
US 20160162674A1 · Friedman · 2016 [cited by applicant]
US 20160234034A1 · Mahar et al. · 2016 [cited by applicant]
US 20160261911A1 · Soundararajan et al. · 2016 [cited by applicant]
US 20160344856A1 · Alameh et al. · 2016 [cited by applicant]
US 20170024591A1 · Detter et al. · 2017 [cited by applicant]
US 20170078749A1 · PangZe · 2017 [cited by applicant]
US 20170147885A1 · Aggarwal et al. · 2017 [cited by applicant]
US 20170178681A1 · Keal et al. · 2017 [cited by applicant]
US 20170201795A1 · Hicks · 2017 [cited by applicant]
US 20180137740A1 · Vitt et al. · 2018 [cited by applicant]
US 20180157902A1 · Tu et al. · 2018 [cited by applicant]
US 20180242907A1 · Bonomi · 2018 [cited by applicant]
US 20180286068A1 · Matsubara et al. · 2018 [cited by applicant]
US 20180295420A1 · Rumreich et al. · 2018 [cited by applicant]
US 20180365968A1 · Vitt et al. · 2018 [cited by applicant]
US 20190098359A1 · Hicks · 2019 [cited by applicant]
US 20190116272A1 · Freeman · 2019 [cited by applicant]
US 20190130365A1 · Pell et al. · 2019 [cited by applicant]
US 20190268575A1 · Leow · 2019 [cited by applicant]
US 20190320214A1 · Sullivan et al. · 2019 [cited by applicant]
US 20190332871A1 · Sudarsan et al. · 2019 [cited by applicant]
US 20190377898A1 · Dunjic et al. · 2019 [cited by applicant]
US 20190378519A1 · Dunjic et al. · 2019 [cited by applicant]
US 20200067620A1 · Carmichael · 2020 [cited by applicant]
US 20200112759A1 · Alameh et al. · 2020 [cited by applicant]
US 20200193592A1 · Arienzo et al. · 2020 [cited by applicant]
US 20200334472A1 · Miyano · 2020 [cited by applicant]
US 20200349230A1 · Yoshioka et al. · 2020 [cited by applicant]
US 20200411013A1 · Horton · 2020 [cited by examiner]
US 20210042859A1 · Iwai · 2021 [cited by applicant]
US 20210073528A1 · Lagerman · 2021 [cited by applicant]
US 20210082127A1 · Yano et al. · 2021 [cited by applicant]
US 20210082382A1 · Pinhas · 2021 [cited by applicant]
US 20210216753A1 · Gefen et al. · 2021 [cited by applicant]
US 20210374394A1 · Livoti et al. · 2021 [cited by applicant]
US 20220058382A1 · Livoti et al. · 2022 [cited by applicant]
US 20220060784A1 · LiVoti et al. · 2022 [cited by applicant]
US 20220060785A1 · Woodruff et al. · 2022 [cited by applicant]
US 20220327853A1 · Livoti et al. · 2022 [cited by applicant]
US 20230134393A1 · Woodruff et al. · 2023 [cited by applicant]
EP 358911A2 · 1990 [cited by applicant]
JP 3328500B2 · 2002 [cited by applicant]
NZ 530015A · 2005 [cited by applicant]
“What's The Difference between Thermal Imaging and Night Vision,” Flir.com, retrieved from https://www.flir.com/discover/ots/thermal-vs-night-vision/ on May 21, 2019, (7 pages). [cited by applicant]
Cooper, “How secure is voice recognition technology?”, [http://www.business.att.com], retrieved on Jul. 14, 2020, 5 pages. [cited by applicant]
Wikipedia, “Speaker Recognition,” [https://en.wikipedia.org/wiki/Speaker_recognition], retrieved on Jul. 14, 2020, last edited on Feb. 21, 2020, 6 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-final Office Action,” mailed in connection with U.S. Appl. No. 16/998,817, filed Jul. 21, 2021, 6 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-final Office Action,” mailed in connection with U.S. Appl. No. 16/890,715, filed Feb. 22, 2021, 9 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” mailed in connection with U.S. Appl. No. 16/890,715, filed Jul. 23, 2021, 11 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” mailed in connection with U.S. Appl. No. 16/998,817, filed Nov. 5, 2021, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” mailed in connection with U.S. Appl. No. 16/998,811, filed Dec. 22, 2021, 12 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” mailed in connection with U.S. Appl. No. 16/890,715, filed Feb. 4, 2022, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” mailed in connection with U.S. Appl. No. 16/998,814, filed Mar. 15, 2022, 8 pages. [cited by applicant]
International Searching Authority, “Written Opinion of the International Searching Authority,” issued in connection with PCT Application No. PCT/US2021/035449, issued on Oct. 5, 2021, 4 pages. [cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with PCT Application No. PCT/US2021/035449, issued on Oct. 5, 2021, 4 pages. [cited by applicant]
United States Patent and Trademark Office, “Non Final Office Action,” mailed in connection with U.S. Appl. No. 16/998,817, filed Mar. 24, 2022, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/890,715, mailed on May 23, 2022, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 16/890,715, mailed on Jun. 2, 2022, 2 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 16/998,811, mailed on Jun. 1, 2022, 17 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” mailed in connection with U.S. Appl. No. 16/998,814, filed Aug. 1, 2022, 11 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/998,811, mailed on Aug. 16, 2022, 9 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/998,817, filed Aug. 31, 2022, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Advisory Action,” issued in connection with U.S. Appl. No. 16/998,814, filed Oct. 25, 2022, 2 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/998,811, mailed on Nov. 22, 2022, 9 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/998,814, filed Dec. 15, 2022, 5 pages. [cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 16/998,817, mailed on Dec. 15, 2022, 3 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/998,814, filed May 3, 2023, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 18/091,538, filed May 18, 2023, 7 pages. [cited by applicant]