IP Library Granted Patent US 50,577
Granted Patent E1
US 50,577 · App. 17/992,934 · Granted Sep 2, 2025

Watermark based content recognition improvements

Inventors: Rade Petrovic (San Diego, CA); Joseph M. Winograd (San Diego, CA)
H04N21/44008G06F21/16G06T1/005H04N21/8352H04N21/8358H04N21/8456G06T2201/0065
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 50,577
App. No.
17/992,934
Granted
Sep 2, 2025
Kind
E1
Abstract

Method, devices, systems and computer program products are described that improve speed and accuracy of watermark detection from multimedia content, and allow faster and better content recognition. One technique for improving detection of boundaries of an embedded multimedia content segment includes detecting a synchronization header and a full watermark from the multimedia content, constructing a predicted watermark segment that is positioned at a predicted distance from the synchronization header, and comparing the group of candidate watermark symbols obtained from the multimedia content to the first predicted watermark segment to obtain a match. The disclosed techniques enable extraction of watermarks from short content segments, and can utilize a shortened payload design to establish media time during content usage.

Claims (60)

1. A method for embedding watermarks in multimedia content comprising:

generating a watermark registry database, which includes links between watermark codes and content metadata;

embedding content with a succession of watermarks using a watermark embedded embedder that is implemented at least partly in electronic circuitry, each embedded watermark including a payload, wherein the embedded watermarks have a flexible payload format that allows for alternative watermark payloadshaving different sizes;

wherein the embedding including using a one or more predetermined embedding stego key keys to embed each watermark, the one or more embedding stego key keys identifying potential locations for watermark embedding and identifying particular characteristics of the watermarks, wherein the same one or more embedding stego key keys is are used to embed each of the succession of watermarks; and

storing a record of the embedded watermark payload in the watermark registry database, wherein the database links some of the embedded watermarks to at least one alternative payloadwith a different payload size.

2. The method according to claim 1 further comprising:

identifying upstream watermarks at locations in the content different from the locations of the embedded watermarks, the upstream watermarks having been previously stored in the watermark registry database;

receiving the content at a watermark extractor that is implemented at least partly in electronic circuitry;

using the watermark extractor to extract watermark symbols from the embedded watermarks in the multimedia content;

retrieving a new watermark payload from the identified upstream watermark in the watermark registry database;

overwriting the extracted watermark with a new watermark having the new a watermark payload of a different size from the embedded watermark payload, using a downstream watermark embedder employing the one or more predetermined embedding stego key keys; and

storing saving a record of the overwritten watermarks and the new watermarks in the watermark registry database for later use.

3. The method according to claim 1 further comprising:

identifying upstream metadata linked to locations different from the locations of the embedded watermarks in the content, the upstream metadata having been previously stored in the watermark registry database;

receiving the content at a watermark extractor;

using the watermark extractor to extract watermark symbols from the embedded watermarks in the multimedia content;

retrieving the upstream metadata in the watermark registry;

overwriting the extracted watermark with a new watermark having an alternate watermark payload, which is based on the metadata, the alternate payload having a different size from the embedded watermark payload, using a downstream watermark embedder employing the one or more predetermined embedding stego key keys; and

storing saving a record of the overwritten watermarks and the new watermarks in the watermark registry database for later use.

4. The method according to claim 3 wherein the metadata includes a compact watermark code that is linked to a DOI.

5. The method according to claim 1 wherein the embedded watermark payload includes a content identifier.

6. The method according to claim 5 wherein the content identifier is one of: AdID or EIDR.

7. The method according to claim 1 wherein the embedded watermark payload facilitates the establishment of a media timeline.

8. The method according to claim 7 wherein the embedded watermark payload includes a server code and an interval code.

9. The method according to claim 1 wherein the one or more stego key keys comprises of a set of stego keys and wherein each watermark is embedded with the same set of stego keys.

10. The method according to claim 1 wherein the embedded watermarks are audio watermarks.

11. The method according to claim 1 wherein the embedded watermarks are video watermarks.

12. A device comprising:

a processor; and

a memory including processor executable code, the processor executable code, when executed by the processor, causes the device to:

generate a watermark registry database, which includes links between watermark codes and content metadata;

embed content with a succession of watermarks using a watermark embedded that is implemented at least partly in electronic circuitry, each embedded watermark including a payload, wherein the embedded watermarks have a flexible payload format that allows for alternative watermark payloadshaving different sizes;

wherein the embedding including using a one or more predetermined embedding stego key keys to embed each watermark, the one or more embedding stego key keys identifying potential locations for watermark embedding and identifying particular characteristics of the watermarks, wherein the same one or more embedding stego key is keys are used to embed each of the succession of watermarks; and

store a record of the embedded watermark payload in the watermark registry database, wherein the database links some of the embedded watermarks to at least one alternative payloadwith a different payload size.

13. The device according to claim 12 , the processor executable code, when executed by the processor, causes the device to:

identify upstream watermarks at locations in the content different from the locations of the embedded watermarks, the upstream watermarks having been previously stored in the watermark registry database;

receive the content at a watermark extractor that is implemented at least partly in electronic circuitry;

use the watermark extractor to extract watermark symbols from the embedded watermarks in the multimedia content;

retrieve a new watermark payload from the identified upstream watermark in the watermark registry database;

overwrite the extracted watermark with a new watermark having the new a watermark payload of a different size from the embedded watermark payload, using a downstream watermark embedder employing the one or more predetermined embedding stego key keys; and

store save a record of the overwritten watermarks and the new watermarks in the watermark registry database for later use.

14. The device according to claim 12 , the processor executable code, when executed by the processor, causes the device to:

identify upstream metadata linked to locations different from the locations of the embedded watermarks in the content, the upstream metadata having been previously stored in the watermark registry database;

receive the content at a watermark extractor;

use the watermark extractor to extract watermark symbols from the embedded watermarks in the multimedia content;

retrieve the upstream metadata in the watermark registry;

overwrite the extracted watermark with a new watermark having an alternate watermark payload, which is based on the metadata, the alternate payload having a different size from the embedded watermark payload, using a downstream watermark embedder employing the one or more predetermined embedding stego key keys; and

store save a record of the overwritten watermarks and the new watermarks in the watermark registry database for later use.

15. The device according to claim 12 wherein the metadata includes a compact watermark code that is linked to a DOI.

16. The device according to claim 12 wherein the embedded watermark payload includes a content identifier.

17. The device according to claim 12 wherein the embedded watermark payload facilitates the establishment of a media timeline.

18. The device according to claim 12 the embedded watermark payload includes a server code and an interval code.

19. The device according to claim 12 wherein the one or more stego key keys comprises of a set of stego keys and wherein each watermark is embedded with the same set of stego keys.

20. A method for processing watermarks in multimedia content comprising: receiving the multimedia content at a watermark extractor that is implemented at least partly in electronic circuits, wherein the multimedia content has been embedded with a succession of watermarks, each watermark including a payload, and wherein the embedded watermarks have a flexible payload format that allows for alternative watermark payloadshaving different sizes, and wherein the embedding includes using a one or more predetermined embedding stego key keys to embed each watermark, the one or more embedding stego key keys identifying potential locations for watermark embedding and identifying particular characteristics of the watermarks, wherein the same one or more embedding stego key keys is used to embed each of the succession of watermarks, and wherein a record of the embedded watermark payload has been stored in a watermark registry database, wherein the database links some of the embedded watermarks to at least one alternative payloadwith different payload size;

at the watermark extractor, extracting watermark symbols from the embedded watermarks in the multimedia content;

overwriting extracted watermarks with new watermarks having a new alternative watermark payload of a different size from the embedded watermark payload using a downstream watermark embedder employing the one or more predetermined embedding stego key keys; and

storing saving a record of the overwritten watermarks and the new watermarks in a watermark registry database for later use.

21. The method according to claim 1 wherein the alternative watermark payloads have different sizes.

22. The method according to claim 12 wherein the alternative watermark payloads have different sizes.

23. The method according to claim 20 wherein the alternative watermark payloads have different sizes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2026
From: VERANCE CORPORATION
To: VERANCE ACQUISITION CORP.
Reel/Frame 075326/0142 →
Continuity (1)
Reissue 16378378 · Apr 8, 2019
References Cited (132)
US 6122610A · Isabelle · 2000 [cited by applicant]
US 6145081A · Winograd et al. · 2000 [cited by applicant]
US 6175627B1 · Petrovic et al. · 2001 [cited by applicant]
US 6427012B1 · Petrovic · 2002 [cited by applicant]
US 6430301B1 · Petrovic · 2002 [cited by applicant]
US 6683958B2 · Petrovic · 2004 [cited by applicant]
US 6792542B1 · Lee et al. · 2004 [cited by applicant]
US 6888943B1 · Lam et al. · 2005 [cited by applicant]
US 6931536B2 · Hollar · 2005 [cited by applicant]
US 7024018B2 · Petrovic · 2006 [cited by applicant]
US 7159118B2 · Petrovic · 2007 [cited by applicant]
US 7224819B2 · Levy et al. · 2007 [cited by applicant]
US 7460667B2 · Lee et al. · 2008 [cited by applicant]
US 7983922B2 · Neusinger et al. · 2011 [cited by applicant]
US 7986806B2 · Rhoads · 2011 [cited by applicant]
US 7991995B2 · Rabin et al. · 2011 [cited by applicant]
US 8015410B2 · Pelly et al. · 2011 [cited by applicant]
US 8055013B2 · Levy et al. · 2011 [cited by applicant]
US 8059815B2 · Lofgren et al. · 2011 [cited by applicant]
US 8059858B2 · Brundage et al. · 2011 [cited by applicant]
US 8085935B2 · Petrovic · 2011 [cited by applicant]
US 8138930B1 · Heath · 2012 [cited by applicant]
US 8151113B2 · Rhoads · 2012 [cited by applicant]
US 8181262B2 · Cooper et al. · 2012 [cited by applicant]
US 8189861B1 · Rucklidge · 2012 [cited by applicant]
US 8194803B2 · Baum et al. · 2012 [cited by applicant]
US 8249992B2 · Harkness et al. · 2012 [cited by applicant]
US 8280103B2 · Petrovic et al. · 2012 [cited by applicant]
US 8301893B2 · Brundage · 2012 [cited by applicant]
US 8315835B2 · Tian et al. · 2012 [cited by applicant]
US 8321679B2 · Petrovic et al. · 2012 [cited by applicant]
US 8340348B2 · Petrovic et al. · 2012 [cited by applicant]
US 8346532B2 · Chakra et al. · 2013 [cited by applicant]
US 8346567B2 · Petrovic et al. · 2013 [cited by applicant]
US 8467717B2 · Croy et al. · 2013 [cited by applicant]
US 8479225B2 · Covell et al. · 2013 [cited by applicant]
US 8533481B2 · Petrovic et al. · 2013 [cited by applicant]
US 8538066B2 · Petrovic et al. · 2013 [cited by applicant]
US 8588459B2 · Bloom et al. · 2013 [cited by applicant]
US 8589969B2 · Falcon · 2013 [cited by applicant]
US 8601504B2 · Stone et al. · 2013 [cited by applicant]
US 8615104B2 · Petrovic et al. · 2013 [cited by applicant]
US 8682026B2 · Petrovic et al. · 2014 [cited by applicant]
US 8726304B2 · Petrovic et al. · 2014 [cited by applicant]
US 8745403B2 · Petrovic · 2014 [cited by applicant]
US 8781967B2 · Tehranchi et al. · 2014 [cited by applicant]
US 8791789B2 · Petrovic et al. · 2014 [cited by applicant]
US 8806517B2 · Petrovic et al. · 2014 [cited by applicant]
US 8811655B2 · Petrovic et al. · 2014 [cited by applicant]
US 8838977B2 · Winograd et al. · 2014 [cited by applicant]
US 8838978B2 · Winograd et al. · 2014 [cited by applicant]
US 8869222B2 · Winograd et al. · 2014 [cited by applicant]
US 8923548B2 · Petrovic et al. · 2014 [cited by applicant]
US 9009482B2 · Winograd · 2015 [cited by applicant]
US 9055239B2 · Tehranchi et al. · 2015 [cited by applicant]
US 9106964B2 · Zhao · 2015 [cited by applicant]
US 9117270B2 · Wong et al. · 2015 [cited by applicant]
US 9485089B2 · Petrovic · 2016 [cited by examiner]
US 20010029580A1 · Moskowitz · 2001 [cited by examiner]
US 20050271246A1 · Sharma · 2005 [cited by examiner]
US 20070039018A1 · Saslow et al. · 2007 [cited by applicant]
US 20070061580A1 · Venkatesan · 2007 [cited by examiner]
US 20110261667A1 · Ren et al. · 2011 [cited by applicant]
US 20110286625A1 · Petrovic · 2011 [cited by examiner]
US 20110293090A1 · Ayaki et al. · 2011 [cited by applicant]
US 20110320627A1 · Landow et al. · 2011 [cited by applicant]
US 20120023595A1 · Speare et al. · 2012 [cited by applicant]
US 20120072731A1 · Winograd et al. · 2012 [cited by applicant]
US 20120102304A1 · Brave · 2012 [cited by applicant]
US 20120122429A1 · Wood et al. · 2012 [cited by applicant]
US 20120129547A1 · Andrews, III et al. · 2012 [cited by applicant]
US 20120203556A1 · Villette et al. · 2012 [cited by applicant]
US 20120203734A1 · Spivack et al. · 2012 [cited by applicant]
US 20120216236A1 · Robinson et al. · 2012 [cited by applicant]
US 20120265735A1 · McMillan et al. · 2012 [cited by applicant]
US 20120272012A1 · Aronovich et al. · 2012 [cited by applicant]
US 20120272327A1 · Shin et al. · 2012 [cited by applicant]
US 20120300975A1 · Chalamala et al. · 2012 [cited by applicant]
US 20120304206A1 · Roberts et al. · 2012 [cited by applicant]
US 20120308071A1 · Ramsdell et al. · 2012 [cited by applicant]
US 20130031579A1 · Klappert · 2013 [cited by applicant]
US 20130060837A1 · Chakraborty et al. · 2013 [cited by applicant]
US 20130073065A1 · Chen et al. · 2013 [cited by applicant]
US 20130114847A1 · Petrovic et al. · 2013 [cited by applicant]
US 20130129303A1 · Lee et al. · 2013 [cited by applicant]
US 20130151855A1 · Petrovic et al. · 2013 [cited by applicant]
US 20130151856A1 · Petrovic et al. · 2013 [cited by applicant]
US 20130152210A1 · Petrovic · 2013 [cited by examiner]
US 20140067950A1 · Winograd · 2014 [cited by applicant]
US 20140074855A1 · Zhao et al. · 2014 [cited by applicant]
US 20140075465A1 · Petrovic et al. · 2014 [cited by applicant]
US 20140075469A1 · Zhao · 2014 [cited by applicant]
US 20140267907A1 · Downes et al. · 2014 [cited by applicant]
US 20140270337A1 · Zhao et al. · 2014 [cited by applicant]
US 20140270338A1 · Zhao et al. · 2014 [cited by applicant]
US 20140279549A1 · Petrovic et al. · 2014 [cited by applicant]
US 20140325550A1 · Winograd et al. · 2014 [cited by applicant]
US 20140325673A1 · Petrovic · 2014 [cited by applicant]
US 20150030200A1 · Petrovic et al. · 2015 [cited by applicant]
US 20150036873A1 · Petrovic et al. · 2015 [cited by applicant]
US 20150121534A1 · Zhao et al. · 2015 [cited by applicant]
JP 2004163855 · 2004 [cited by applicant]
JP 2004173237 · 2004 [cited by applicant]
JP 2004193843 · 2004 [cited by applicant]
JP 2004194233 · 2004 [cited by applicant]
JP 2004328747 · 2004 [cited by applicant]
JP 2005051733 · 2005 [cited by applicant]
JP 2005094107 · 2005 [cited by applicant]
JP 2005525600 · 2005 [cited by applicant]
JP 20100272920 · 2010 [cited by applicant]
KR 1020080087047 · 2008 [cited by applicant]
KR 20100009384 · 2010 [cited by applicant]
KR 1020120128149 · 2012 [cited by applicant]
WO 2005017827 · 2005 [cited by applicant]
WO 2005038778 · 2005 [cited by applicant]
WO 2006051043 · 2006 [cited by applicant]
WO 2009031082 · 2009 [cited by applicant]
WO 2010073236 · 2010 [cited by applicant]
WO 2010135687 · 2010 [cited by applicant]
WO 2011116309 · 2011 [cited by applicant]
WO 2013163921 · 2013 [cited by applicant]
Aris Technologies, Inc. “Audio Watermarking System to Screen Digital Audio Content for LCM Acceptance,” May 1999 (17 pages). [cited by applicant]
Bangaleea, R., et al., “Performance improvement of spread spectrum spatial-domain watermarking scheme through diversity and attack characterisation,” IEEE Africon, pp. 293-298, 2002. [cited by applicant]
Hartung, F., et al., “Watermarking of MPEG-2 encoded video without decoding and re-coding,” Proc. SPIE Multimedia Computing and Networking 97, 3020:264-274, Feb. 1997. [cited by applicant]
Hartung, F., et al., “Watermarking of uncompressed and compressed video,” Signal Processing, 3(66):283-301, May 1998. [cited by applicant]
Kalker, T., et al., “System issues in digital image and video watermarking for copy protection,” Proc. IEEE Int. Conf. on Multimedia Computing and Systems, pp. 562-567, Jun. 1999. [cited by applicant]
Kirovski, D., et al., “Multimedia content screening using a dual watermarking and fingerprinting system,” Proceedings of the tenth ACM international conference, pp. 372-381, 2002. [cited by applicant]
Kirovski, D., et al., “Multimedia content screening using a dual watermarking and fingerprinting system,” Multimedia '02 Proceedings of the tenth ACM international conference on Multimedia, 2002 (11 pages). [cited by applicant]
Verance Corporation, “Confirmedia,” PowerPoint presentation made to National Association of Broadcasters, Apr. 24, 2001 (40 pages). [cited by applicant]
Zhao, J., “A WWW service to embed and prove digital copyright watermarks,” Proc. European Conf. on Multimedia Applications, Services and Techniques (ECMAST'96), May 1996 (15 pages). [cited by applicant]
Zhao, J., “Applying digital watermarking techniques to online multimedia commerce,”Proc. Int. Conf. on Imaging Science, Systems and Applications (CISSA'97), Jun./Jul. 1997 (7 pages). [cited by applicant]
International Search Report and Written Opinion for International Patent Application No. PCT/US2016/027614, dated Jul. 26, 2016 (8 pages). [cited by applicant]