IP Library › Granted Patent US 12,287,853
Granted Patent B2
US 12,287,853 · App. 17/533,041 · Granted Apr 29, 2025

End-point media watermarking

Inventors: Arun Ramaswamy (Tampa, FL); Timothy Scott Cooper (Tarpon Springs, FL); Jeremey M. Davis (New Port Richey, FL); Alexander Topchy (New Port Richey, FL)
Assignee: The Nielsen Company (US), LLC
G06F21/16G06F21/1063
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,853
App. No.
17/533,041
Granted
Apr 29, 2025
Kind
B2
Abstract

Apparatus, systems, methods, and articles of manufacture related to end-point media watermarking are disclosed. An example device includes a media receiver to receive a media signal, a watermark generator to generate a watermark, a trigger to activate the watermark generator to generate the watermark based on an external input, an encoder to encode the media signal with the watermark to synthesize an encoded media signal, a media output to render the encoded media signal.

Claims (68)

1. A device comprising:

a media receiver configured to receive a media signal;

a watermark generator configured to:

receive, from an audience measurement meter, a signal indicating the presence of the audience measurement meter in a household, and

based on receiving the signal, generate a watermark payload;

an encoder to encode the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload; and

a media output to provide the encoded media signal to a media rendering device.

2. The device of claim 1 , wherein the signal is a command received by the device over a communication link.

3. The device of claim 1 , wherein the audience measurement meter is a wearable device.

4. The device of claim 1 , further comprising a feedback receiver configured to receive a quality indicator from the audience measurement meter.

5. The device of claim 4 , wherein the encoder is configured to encode the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

6. The device of claim 4 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

7. The device of claim 1 , wherein the watermark payload is further based on a characteristic of the device.

8. A non-transitory computer readable medium comprising computer readable instructions that, when executed, cause one or more processors to at least:

generate a watermark payload for a received media signal, the watermark payload generation triggered by receipt of a signal indicating the presence of an audience measurement meter in a household from the audience measurement meter;

encode the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload; and

provide the encoded media signal to a media rendering device.

9. The non-transitory computer readable medium of claim 8 , wherein the signal is a command received by the media rendering device over a communication link.

10. The non-transitory computer readable medium of claim 8 , wherein the audience measurement meter is a wearable device.

11. The non-transitory computer readable medium of claim 8 , wherein the instructions further cause the one or more processors to receive a quality indicator from the audience measurement meter.

12. The non-transitory computer readable medium of claim 11 , wherein the instructions further cause the one or more processors to encode the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

13. The computer readable medium of claim 11 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

14. The computer readable medium of claim 8 , wherein the watermark payload is further based on a characteristic of the media rendering device.

15. A device comprising:

means for receiving a media signal;

means for generating a watermark payload based on receipt of a signal indicating the presence of an audience measurement meter in a household from the audience measurement meter;

means for encoding the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload; and

means for providing the encoded media signal to a media rendering device.

16. The device of claim 15 , wherein the signal is a command received by the device over a communication link.

17. The device of claim 15 , wherein the audience measurement meter is a wearable device.

18. The device of claim 15 , wherein the means for receiving is to receive a quality indicator from the audience measurement meter.

19. The device of claim 18 , wherein the means for encoding is to encode the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

20. The device of claim 18 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

21. The device of claim 15 , wherein the watermark payload is further based on a characteristic of the device.

22. A method for watermarking media at a point of rendering the media, the method comprising:

generating a watermark payload for a received media signal, the watermark payload generation triggered by receipt of a signal indicating the presence of an audience measurement meter in a household from the audience measurement meter;

encoding the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload; and

providing the encoded media signal to a media rendering device.

23. The method of claim 22 , wherein the signal is a command received by the media rendering device over a communication link.

24. The method of claim 22 , wherein the audience measurement meter is a wearable device.

25. The method of claim 22 , further including receiving a quality indicator from the audience measurement meter.

26. The method of claim 25 , further including encoding the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

27. The method of claim 25 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

28. The method of claim 22 , wherein the watermark payload is further based on a characteristic of the media rendering device.

29. A computing system comprising:

memory including machine-readable instructions; and

one or more processors configured to execute the instructions to:

generate a watermark payload for a received media signal received, the watermark payload generation triggered by receipt of a signal indicating the presence of an audience measurement meter in a household from the audience measurement meter,

encode the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload, and

provide the encoded media signal to a media rendering device.

30. The computing system of claim 29 , wherein the signal is a command received by the media rendering device over a communication link.

31. The computing system of claim 29 , wherein the audience measurement meter is a wearable device.

32. The computing system of claim 29 , wherein the one or more processors are configured to receive the a quality indicator from the audience measurement meter.

33. The computing system of claim 32 , wherein the one or more processors are configured to encode the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

34. The computing system of claim 32 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

35. The computing system of claim 29 , wherein the watermark payload is further based on a characteristic of the media rendering device.

36. A system to watermark media at a point of rendering the media, the system comprising:

an audience measurement meter configured to broadcast a presence of the audience measurement meter; and

a media watermarking device configured to:

generate a watermark payload for a received media signal, the watermark payload generation triggered by receipt of a signal indicating the presence of the audience measurement meter from the audience measurement meter,

encode the media signal with first watermarks to synthesize an encoded media signal, the first watermarks based on the watermark payload, and

provide the encoded media signal to a media rendering device.

37. The system of claim 36 , wherein the audience measurement meter is a wearable device.

38. The system of claim 36 , wherein the audience measurement meter includes a watermark detector to detect the watermarks in the encoded media signal.

39. The system of claim 36 , wherein the media watermarking device is further configured to receive a quality indicator from the audience measurement meter.

40. The system of claim 39 , wherein the media watermarking device is configured to encode the media signal with second watermarks in accordance with a level of encoding that is based on the quality indicator.

41. The system of claim 39 , wherein the quality indicator includes a value corresponding to a sparsity of the first watermarks detected by the audience measurement meter.

42. The system of claim 36 , wherein the watermark payload is further based on a characteristic of the device.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2022
From: RAMASWAMY, ARUN; COOPER, TIMOTHY SCOTT; DAVIS, JEREMEY M.; TOPCHY, ALEXANDER
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 062152/0034 →
Continuity (3)
Continuation PCTUS2020031424 · May 5, 2020
Continuation 16405130 · May 7, 2019
Related Publication 20220215074A1 · Jul 7, 2022
References Cited (162)
US 5450490A · Jensen et al. · 1995 [cited by applicant]
US 5764763A · Jensen et al. · 1998 [cited by applicant]
US 6157330A · Bruekers et al. · 2000 [cited by applicant]
US 6507299B1 · Nuijten · 2003 [cited by applicant]
US 6845360B2 · Jensen et al. · 2005 [cited by applicant]
US 6871180B1 · Neuhauser et al. · 2005 [cited by applicant]
US 7155159B1 · Weinblatt et al. · 2006 [cited by applicant]
US 7197156B1 · Levy · 2007 [cited by applicant]
US 7266697B2 · Kirovski et al. · 2007 [cited by applicant]
US 7584484B2 · Headley · 2009 [cited by examiner]
US 7587732B2 · Wright et al. · 2009 [cited by applicant]
US 8130811B2 · Tian · 2012 [cited by examiner]
US 8300885B2 · Vestergaard · 2012 [cited by applicant]
US 8355910B2 · McMillan et al. · 2013 [cited by applicant]
US 8451086B2 · Petrovic et al. · 2013 [cited by applicant]
US 8768714B1 · Blesser · 2014 [cited by applicant]
US 8799659B2 · Srinivasan · 2014 [cited by examiner]
US 8805689B2 · Ramaswamy · 2014 [cited by examiner]
US 8863218B2 · Wright et al. · 2014 [cited by applicant]
US 8918326B1 · Blesser · 2014 [cited by applicant]
US 8918802B2 · Ramaswamy · 2014 [cited by examiner]
US 9418395B1 · Gish et al. · 2016 [cited by applicant]
US 9503536B2 · Bosworth et al. · 2016 [cited by applicant]
US 9881623B2 · Nakamura · 2018 [cited by applicant]
US 9905233B1 · Thagadur Shivappa et al. · 2018 [cited by applicant]
US 9922658B2 · Arnold et al. · 2018 [cited by applicant]
US 10212242B2 · Bosworth et al. · 2019 [cited by applicant]
US 10236006B1 · Gurijala · 2019 [cited by applicant]
US 10623511B2 · Bosworth et al. · 2020 [cited by applicant]
US 11269976B2 · Khan · 2022 [cited by applicant]
US 20010029580A1 · Moskowitz · 2001 [cited by examiner]
US 20010044899A1 · Levy · 2001 [cited by applicant]
US 20020026635A1 · Wheeler · 2002 [cited by applicant]
US 20020029338A1 · Bloom · 2002 [cited by applicant]
US 20020168082A1 · Razdan · 2002 [cited by applicant]
US 20030021439A1 · Lubin · 2003 [cited by applicant]
US 20030103645A1 · Levy · 2003 [cited by applicant]
US 20030112996A1 · Holliman · 2003 [cited by applicant]
US 20040015362A1 · Rhoads · 2004 [cited by applicant]
US 20040073916A1 · Petrovic et al. · 2004 [cited by applicant]
US 20050025335A1 · Bloom et al. · 2005 [cited by applicant]
US 20050144632A1 · Mears · 2005 [cited by examiner]
US 20050149735A1 · Tsuria · 2005 [cited by examiner]
US 20060062426A1 · Levy · 2006 [cited by examiner]
US 20060069912A1 · Zheng · 2006 [cited by examiner]
US 20060146604A1 · Muraki · 2006 [cited by examiner]
US 20060212704A1 · Kirovski et al. · 2006 [cited by applicant]
US 20060239503A1 · Petrovic · 2006 [cited by applicant]
US 20060282676A1 · Serret-Avila et al. · 2006 [cited by applicant]
US 20070005808A1 · Day · 2007 [cited by examiner]
US 20070076916A1 · Rhoads et al. · 2007 [cited by applicant]
US 20070140523A1 · Parisis · 2007 [cited by applicant]
US 20070150565A1 · Ayyagari · 2007 [cited by examiner]
US 20070266252A1 · Davis · 2007 [cited by examiner]
US 20080002854A1 · Tehranchi et al. · 2008 [cited by applicant]
US 20080028474A1 · Horne et al. · 2008 [cited by applicant]
US 20080056531A1 · Zhao · 2008 [cited by applicant]
US 20080126420A1 · Wright · 2008 [cited by applicant]
US 20080137903A1 · Nakamura · 2008 [cited by applicant]
US 20080162133A1 · Couper · 2008 [cited by examiner]
US 20080191816A1 · Balachandran · 2008 [cited by applicant]
US 20080270373A1 · Oostveen · 2008 [cited by examiner]
US 20090049556A1 · Vrielink · 2009 [cited by examiner]
US 20090136087A1 · Oren · 2009 [cited by applicant]
US 20090158318A1 · Levy · 2009 [cited by applicant]
US 20090256972A1 · Ramaswamy · 2009 [cited by applicant]
US 20090260027A1 · Weinblatt · 2009 [cited by applicant]
US 20100011135A1 · Jawa · 2010 [cited by examiner]
US 20100011217A1 · Tachibana et al. · 2010 [cited by applicant]
US 20100034513A1 · Nakano et al. · 2010 [cited by applicant]
US 20100080413A1 · Chen · 2010 [cited by applicant]
US 20100082478A1 · Van Der Veen · 2010 [cited by examiner]
US 20110066437A1 · Luff · 2011 [cited by applicant]
US 20110093510A1 · Beck · 2011 [cited by examiner]
US 20110111713A1 · Park et al. · 2011 [cited by applicant]
US 20110176060A1 · Lee · 2011 [cited by applicant]
US 20110224992A1 · Chaoui et al. · 2011 [cited by applicant]
US 20120003932A1 · Zhodzishsky · 2012 [cited by examiner]
US 20120072731A1 · Winograd et al. · 2012 [cited by applicant]
US 20120219156A1 · Ramaswamy · 2012 [cited by examiner]
US 20120272327A1 · Shin · 2012 [cited by applicant]
US 20120289498A1 · Glick · 2012 [cited by applicant]
US 20130024698A1 · Tadano · 2013 [cited by applicant]
US 20130117571A1 · Petrovic et al. · 2013 [cited by applicant]
US 20130227595A1 · Nielsen · 2013 [cited by examiner]
US 20130251189A1 · McMillan · 2013 [cited by applicant]
US 20130312019A1 · McMillan · 2013 [cited by applicant]
US 20140032918A1 · Wendling · 2014 [cited by examiner]
US 20140040929A1 · Mears et al. · 2014 [cited by applicant]
US 20140108020A1 · Sharma · 2014 [cited by applicant]
US 20140129841A1 · McMillan · 2014 [cited by applicant]
US 20140142958A1 · Sharma · 2014 [cited by applicant]
US 20140254801A1 · Srinivasan et al. · 2014 [cited by applicant]
US 20140280874A1 · Bosworth et al. · 2014 [cited by applicant]
US 20140321695A1 · Srinivasan · 2014 [cited by applicant]
US 20140344844A1 · Wright · 2014 [cited by examiner]
US 20150067712A1 · Lee · 2015 [cited by applicant]
US 20150153803A1 · Tokutake · 2015 [cited by examiner]
US 20150161061A1 · Couch · 2015 [cited by examiner]
US 20150181269A1 · McMillan · 2015 [cited by applicant]
US 20150242985A1 · Reed · 2015 [cited by applicant]
US 20150319490A1 · Besehanic · 2015 [cited by applicant]
US 20150356281A1 · Van Deventer et al. · 2015 [cited by applicant]
US 20150370435A1 · Kirmse · 2015 [cited by examiner]
US 20150373428A1 · Trollope · 2015 [cited by examiner]
US 20160019901A1 · Topchy · 2016 [cited by applicant]
US 20160050456A1 · Arini · 2016 [cited by examiner]
US 20160055693A1 · Somani · 2016 [cited by examiner]
US 20160065902A1 · Deng · 2016 [cited by examiner]
US 20160072599A1 · Kariyappa · 2016 [cited by applicant]
US 20160078874A1 · Blesser et al. · 2016 [cited by applicant]
US 20160094877A1 · Heffernan · 2016 [cited by applicant]
US 20160140969A1 · Srinivasan · 2016 [cited by examiner]
US 20160156638A1 · Somani · 2016 [cited by examiner]
US 20160171486A1 · Wagner · 2016 [cited by examiner]
US 20160232515A1 · Jhas · 2016 [cited by examiner]
US 20160253772A1 · Kofod et al. · 2016 [cited by applicant]
US 20160261917A1 · Trollope · 2016 [cited by applicant]
US 20160295279A1 · Srinivasan et al. · 2016 [cited by applicant]
US 20160329058A1 · Lynch et al. · 2016 [cited by applicant]
US 20160353124A1 · Gish · 2016 [cited by examiner]
US 20170018278A1 · Srinivasan · 2017 [cited by applicant]
US 20170025128A1 · Blesser · 2017 [cited by applicant]
US 20170025129A1 · Blesser · 2017 [cited by applicant]
US 20170041410A1 · Bosworth et al. · 2017 [cited by applicant]
US 20170064351A1 · Jakkula et al. · 2017 [cited by applicant]
US 20170201793A1 · Pereira · 2017 [cited by examiner]
US 20170245009A1 · Nielsen · 2017 [cited by examiner]
US 20170303074A1 · Lin · 2017 [cited by examiner]
US 20170334234A1 · Curtis · 2017 [cited by applicant]
US 20170372055A1 · Robinson · 2017 [cited by examiner]
US 20170372359A1 · Bodzo · 2017 [cited by examiner]
US 20170372445A1 · Nielsen · 2017 [cited by examiner]
US 20170374413A1 · Cooper · 2017 [cited by examiner]
US 20170374415A1 · Cooper · 2017 [cited by examiner]
US 20170374546A1 · Nielsen · 2017 [cited by examiner]
US 20180084313A1 · Splaine et al. · 2018 [cited by applicant]
US 20180089790A1 · Tehranchi · 2018 [cited by applicant]
US 20180121635A1 · Tormasov et al. · 2018 [cited by applicant]
US 20180123712A1 · Topchy · 2018 [cited by examiner]
US 20180124533A1 · Messier · 2018 [cited by examiner]
US 20180165463A1 · McCreary et al. · 2018 [cited by applicant]
US 20190035046A1 · Tung · 2019 [cited by applicant]
US 20190132652A1 · Zhao · 2019 [cited by applicant]
US 20190182344A1 · Bosworth et al. · 2019 [cited by applicant]
US 20190266749A1 · Rhoads · 2019 [cited by applicant]
US 20190332811A1 · Robison · 2019 [cited by applicant]
US 20210289498A1 · Lapede et al. · 2021 [cited by applicant]
US 20220215074A1 · Ramaswamy · 2022 [cited by applicant]
EP 2109237A2 · 2009 [cited by applicant]
WO 0171960A1 · 2001 [cited by applicant]
WO 2020227259A1 · 2020 [cited by applicant]
International Searching Authority, “International Search Report and Written Opinion,” issued in connection with PCT No. PCT/US2020/031424, Aug. 26, 2020, 12 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action”, issued in connection with U.S. Appl. No. 16/405,130, mailed on Jan. 25, 2021, 18 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action”, issued in connection with U.S. Appl. No. 16/405,130, mailed on May 18, 2021, 17 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action”, issued in connection with U.S. Appl. No. 16/405,130, Sep. 24, 2021, 14 pages. [cited by applicant]
International Bureau, “International Preliminary Report on Patentability,” issued in connection with PCT No. PCT/US2020/031424, on Nov. 2, 2021, 9 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action”, issued in connection with U.S. Appl. No. 16/405,130, mailed on Feb. 22, 2022, 15 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due”, issued in connection with U.S. Appl. No. 16/405,130, mailed on Aug. 17, 2022, 15 pages. [cited by applicant]
United States Patent and Trademark Office, “Corrected Notice of Allowability”, issued in connection with U.S. Appl. No. 16/405,130, mailed on Nov. 30, 2022, 3 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 18/069,817, mailed on Jun. 22, 2023, 14 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Rejection,” issued in connection with U.S. Appl. No. 18/069,817, mailed on Nov. 9, 2023, 16 pages. [cited by applicant]