IP Library Granted Patent US 12,572,631
Granted Patent B2
US 12,572,631 · App. 17/898,829 · Granted Mar 10, 2026

System and method for watermarking data for tracing access

Inventors: William Francis Ganong, III (Brookline, MA); Ljubomir Milanovic (Vienna, AT); Dushyant Sharma (Tracy, CA); Uwe Helmut Jost (Groton, MA); Patrick Aubrey Naylor (Reading, GB)
Assignee: Microsoft Technology Licensing, LLC.
G06F21/16H04L9/30H04L2209/608
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,572,631
App. No.
17/898,829
Granted
Mar 10, 2026
Kind
B2
Abstract

A method, computer program product, and computing system for receiving, from a requesting party, a request to access data from a storage device. Identity information associated with the requesting party is determined. A bespoke identity-based watermark is generated for the requesting party. The bespoke identity-based watermark is encoded into the data. The watermarked data is provided to the requesting party.

Claims (34)

1 . A computer-implemented method, executed on a computing device, comprising:

storing data on a storage device, the data including an encrypted audio file;

receiving, from an authorized requesting party, a request to access the data from the storage device;

determining identity information associated with the authorized requesting party;

generating a bespoke identity-based watermark for the authorized requesting party by applying a hash function to a payload containing the identity information associated with the authorized requesting party, wherein the payload further contains a timestamp associated with the request received from the authorized requesting party, and wherein the bespoke identity-based watermark identifies the timestamp of the request in addition to the authorized requesting party;

encoding the bespoke identity-based watermark into the data to obtain encoded watermarked data identifying the authorized requesting party, wherein encoding the bespoke identity-based watermark into the data comprises decrypting the encrypted audio file using a private key and encoding the bespoke identity-based watermark as an inaudible audio signal within the decrypted audio file, the inaudible audio signal being outside of human hearing;

providing the encoded watermarked data to the authorized requesting party; and

upon detection of a data leak in which a copy of the data has been accessed by, or otherwise made accessible to, an unauthorized party, detecting the bespoke identity-based watermark within the copy of the data, wherein the bespoke identity-based watermark is used to trace access of the data from the timestamp of the request and to identify the authorized requesting party as a potential source of the data leak.

2 . The computer-implemented method of claim 1 , wherein the encrypted audio file was encrypted using a public key corresponding to the private key.

3 . The computer implemented method of claim 1 , wherein the encrypted audio data is recorded by an Ambient Cooperative Intelligence (ACI) system monitoring a private meeting between participants.

4 . A computing system comprising:

one or more processors; and

a memory storing programming instructions for execution by the one or more processors, the programming instructions, upon execution by the one or more processors, causing the computing system to perform the following operations:

storing data on a storage device, the data including an encrypted audio file;

receiving, from an authorized requesting party, a request to access the data from the storage device;

determining identity information associated with the authorized requesting party;

generating a bespoke identity-based watermark for the authorized requesting party by applying a hash function to a payload containing the identity information associated with the authorized requesting party, wherein the payload further contains a timestamp associated with the request received from the authorized requesting party, and wherein the bespoke identity-based watermark identifies the timestamp of the request in addition to the authorized requesting party;

encoding the bespoke identity-based watermark into the data to obtain encoded watermarked data identifying the authorized requesting party, wherein encoding the bespoke identity-based watermark into the data comprises decrypting the encrypted audio file using a private key and encoding the bespoke identity-based watermark as an inaudible audio signal within the decrypted audio file, the inaudible audio signal being outside of human hearing;

providing the encoded watermarked data to the authorized requesting party; and

upon detection of a data leak in which a copy of the data has been accessed by, or otherwise made accessible to, an unauthorized party, detecting the bespoke identity-based watermark within the copy of the data, wherein the bespoke identity-based watermark is used to trace access of the data from the timestamp of the request and to identify the authorized requesting party as a potential source of the data leak.

5 . The computing system of claim 4 , wherein the data includes automated speech recognition (ASR) training data.

6 . The computing system of claim 4 , wherein the encrypted audio file was encrypted using a public key corresponding to the private key.

7 . The computing system of claim 4 , wherein the encrypted audio data is recorded by an Ambient Cooperative Intelligence (ACI) system monitoring a private meeting between participants.

8 . A computer program product residing on a non-transitory computer readable medium having programming instructions stored thereon which, when executed by one or more processors of a computing system, cause the computing system to perform the following operations:

storing data on a storage device, the data including an encrypted audio file;

receiving, from an authorized requesting party, a request to access the data from the storage device;

determining identity information associated with the authorized requesting party;

generating a bespoke identity-based watermark for the authorized requesting party by applying a hash function to a payload containing the identity information associated with the authorized requesting party, wherein the payload further contains a timestamp associated with the request received from the authorized requesting party, and wherein the bespoke identity-based watermark identifies the timestamp of the request in addition to the authorized requesting party;

encoding the bespoke identity-based watermark into the data to obtain encoded watermarked data identifying the authorized requesting party, wherein encoding the bespoke identity-based watermark into the data comprises decrypting the encrypted audio file using a private key and encoding the bespoke identity-based watermark as an inaudible audio signal within the decrypted audio file, the inaudible audio signal being outside of human hearing;

providing the encoded watermarked data to the authorized requesting party; and

upon detection of a data leak in which a copy of the data has been accessed by, or otherwise made accessible to, an unauthorized party, detecting the bespoke identity-based watermark within the copy of the data, wherein the bespoke identity-based watermark is used to trace access of the data from the timestamp of the request and to identify the authorized requesting party as a potential source of the data leak.

9 . The computer program product of claim 8 , wherein the data includes automated speech recognition (ASR) training data.

10 . The computer program product of claim 8 , wherein the encrypted audio file was encrypted using a public key corresponding to the private key.

11 . The computer program product of claim 8 , wherein the encrypted audio data is recorded by an Ambient Cooperative Intelligence (ACI) system monitoring a private meeting between participants.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2025
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 070762/0337 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065578/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: GANONG, WILLIAM FRANCIS, III; MILANOVIC, LJUBOMIR; SHARMA, DUSHYANT; JOST, UWE HELMUT; NAYLOR, PATRICK AUBREY
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 060948/0297 →
Continuity (1)
Related Publication 20240070239A1 · Feb 29, 2024
References Cited (32)
US 8677132B1 · Liao · 2014 [cited by examiner]
US 11252469B2 · Smith · 2022 [cited by examiner]
US 20060107056A1 · Bhatt · 2006 [cited by examiner]
US 20060107334A1 · Leone · 2006 [cited by examiner]
US 20060242325A1 · Ramaswamy · 2006 [cited by examiner]
US 20070033419A1 · Kocher · 2007 [cited by examiner]
US 20070107063A1 · Eckleder · 2007 [cited by examiner]
US 20080103821A1 · Cerbone · 2008 [cited by examiner]
US 20130159021A1 · Felsher · 2013 [cited by examiner]
US 20140068791A1 · Resch · 2014 [cited by examiner]
US 20140086408A1 · Bickmore · 2014 [cited by examiner]
US 20150124950A1 · Koenig · 2015 [cited by examiner]
US 20160212103A1 · Rhoads · 2016 [cited by examiner]
US 20170099149A1 · Eber · 2017 [cited by examiner]
US 20190034601A1 · Coleman · 2019 [cited by examiner]
US 20190246036A1 · Wu · 2019 [cited by examiner]
US 20200106785A1 · Abbaszadeh · 2020 [cited by examiner]
US 20200125699A1 · Liu · 2020 [cited by examiner]
US 20200356644A1 · Liuzzo · 2020 [cited by examiner]
US 20210067842A1 · Revital · 2021 [cited by examiner]
US 20210192651A1 · Groth · 2021 [cited by examiner]
US 20220021728A1 · Kelly · 2022 [cited by examiner]
US 20220179931A1 · Levacher · 2022 [cited by examiner]
US 20220239495A1 · Norton · 2022 [cited by examiner]
US 20220415333A1 · Zhu · 2022 [cited by examiner]
US 20230104583A1 · Bekker · 2023 [cited by examiner]
US 20230197064A1 · Bekker · 2023 [cited by examiner]
US 20240070266A1 · Chai · 2024 [cited by examiner]
US 20240221763A1 · Ginsburg · 2024 [cited by examiner]
US 20250245773A1 · Hanes · 2025 [cited by examiner]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US23/028901”, Mailed Date: Sep. 21, 2023, 13 Pages. [cited by applicant]
International Preliminary Report on Patentability (Chapter I) received for PCT Application No. PCT/US23/028901, mailed on Mar. 13, 2025, 10 pages. [cited by applicant]