IP Library Granted Patent US 10,776,894
Granted Patent B2
US 10,776,894 · App. 16/247,459 · Granted Sep 15, 2020

Differential modulation for robust signaling and synchronization

Inventors: John F. Stach (Portland, OR); Ajith M. Kamath (Beaverton, OR)
Assignee: Digimarc Corporation
G06T1/005G06T1/0028G06T1/0064G06T2201/0061G06T2201/0065G06T2201/0202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,894
App. No.
16/247,459
Granted
Sep 15, 2020
Kind
B2
Abstract

Differential modulation schemes encode a data channel within host signal or noisy environment in a manner that is robust, flexible to achieve perceptual quality constraints, and provides improved data capacity. Differential arrangements enable a decoder to suppress host signal or other background signal interference when detecting, synchronizing and extracting an encoded data channel. They also enable the incorporation of implicit or explicit synchronization components, which are either formed from the data signal or are complementary to it.

Claims (51)

1. A method of steganographically encoding a watermark signal within an electronic host media signal representing an array of media elements, wherein each of the media elements is characterized by a media element value, the method comprising executing instructions on a processor to perform the acts of:

obtaining a first modulation kernel characterized by a set of modulation elements, wherein a modulation value is assigned to each modulation element such that the first modulation kernel represents an orthogonal matrix;

obtaining a synchronization kernel characterized by a set of modulation elements, wherein each modulation element in the set is assigned a modulation value such that the synchronization kernel facilitates subsequent discernment of a transformation to which encoded auxiliary data has been subjected;

aggregating the synchronization kernel and the first modulation kernel; and

altering portions of the host media signal based on the first modulation kernel such that media element values for a first set of the media elements are modulated in accordance with modulation values assigned to corresponding modulation elements in the first modulation kernel.

2. The method of claim 1

wherein the first modulation kernel represents a matrix obtained by a process that includes obtaining a first outer product of a first vector and a vector selected from the group consisting of the first vector and a second vector orthogonal to the first vector.

3. The method of claim 2 , wherein the first vector is a zero-mean vector.

4. The method of claim 2 , wherein the first vector is a non-zero-mean vector.

5. The method of claim 2 , wherein the first vector consists of binary coefficients.

6. The method of claim 2 , wherein obtaining the first outer product comprises obtaining an outer product of the first vector and the second vector.

7. The method of claim 6 , wherein the second vector is a zero-mean vector.

8. The method of claim 6 , wherein the second vector is a non-zero-mean vector.

9. The method of claim 2 , wherein obtaining the first modulation kernel further comprises:

obtaining a second outer product, different from the first outer product, of the first vector and the second vector; and

aggregating the outer products obtained.

10. The method of claim 2 , further comprising:

obtaining auxiliary data; and

encoding the auxiliary data into the host media signal by associating at least one first bit of the auxiliary data with the first modulation kernel.

11. The method of claim 10 ,

wherein the act of associating at least one first bit of the auxiliary data with the first modulation kernel comprises:

obtaining a data kernel characterized by a set of modulation elements, wherein modulation values are assigned to the modulation elements of the data kernel;

associating the at least one first bit of the auxiliary data with a first subset of the modulation elements; and

wherein the act of obtaining the first modulation kernel comprises setting the data kernel having the first subset of the modulation elements associated with the at least one first bit of the auxiliary data as the first modulation kernel.

12. The method of claim 10 , further comprising encoding the auxiliary data into the host media signal by associating at least one second bit of the auxiliary data with the first modulation kernel.

13. The method of claim 12 ,

wherein the act of associating at least one second bit of the auxiliary data with the first modulation kernel comprises associating the at least one second bit of the auxiliary data with a second subset of the modulation elements of the data kernel; and

wherein the act of obtaining the first modulation kernel comprises setting the data kernel having the first and second subsets, respectively associated with the at least one first bit of the auxiliary data and the at least one second bit of the auxiliary data, as the first modulation kernel.

14. The method of claim 13 , wherein the first subset includes at least one modulation element that is also included in the second subset.

15. The method of claim 13 , wherein modulation values assigned to modulation elements of the first subset form a first data modulation pattern that is spatially orthogonal to a second data modulation pattern formed by modulation values assigned to modulation elements of the second subset.

16. The method of claim 2 , further comprising:

obtaining a second modulation kernel characterized by a set of modulation elements, wherein each modulation element in the set is assigned a modulation value; and

altering portions of the host media signal based on the second modulation kernel such that media element values for a second set of the media elements are modulated in accordance with modulation values assigned to corresponding modulation elements in the second modulation kernel.

17. The method of claim 1 , further comprising:

obtaining auxiliary data; and

encoding the auxiliary data into the host media signal by associating at least one first bit of the auxiliary data with the first modulation kernel.

18. The method of claim 17 ,

wherein the act of associating at least one first bit of the auxiliary data with the first modulation kernel comprises:

obtaining a data kernel characterized by a set of modulation elements, wherein modulation values are assigned to the modulation elements of the data kernel;

associating the at least one first bit of the auxiliary data with a first subset of the modulation elements; and

wherein the act of obtaining the first modulation kernel comprises setting the data kernel having the first subset of the modulation elements associated with the at least one first bit of the auxiliary data as the first modulation kernel.

19. The method of claim 1

wherein a modulation value is assigned to each modulation element such that the first modulation kernel represents a square, zero-mean matrix, of order N, where N is 3 or greater;

the method further comprising:

aggregating the synchronization kernel and a data kernel, wherein the act of obtaining the first modulation kernel comprises setting the aggregated synchronization and data kernels as the first modulation kernel.

20. A non-transitory computer readable medium on which is stored instructions, which configure a processor to steganographically encode a watermark signal within an electronic host media signal representing an array of media elements, wherein each of the media elements is characterized by a media element value,

the instructions configure the processor to:

obtain a first modulation kernel characterized by a set of modulation elements, wherein a modulation value is assigned to each modulation element such that the first modulation kernel represents an orthogonal matrix;

obtain a synchronization kernel characterized by a set of modulation elements, wherein each modulation element in the set is assigned a modulation value such that the synchronization kernel facilitates subsequent discernment of a transformation to which encoded auxiliary data has been subjected;

aggregate the synchronization kernel and the first modulation kernel; and

alter portions of the host media signal based on the first modulation kernel such that media element values for a first set of the media elements are modulated in accordance with modulation values assigned to corresponding modulation elements in the first modulation kernel.

Assignments (3)
ARTICLES OF CONVERSION Recorded Jun 19, 2026
From: DIGIMARC CORPORATION
To: DIGIMARC LLC
Reel/Frame 075863/0211 →
ARTICLES OF AMENDMENT OFTHE ARTICLES OF ORGANIZATION OF DIGIMARC LLC Recorded Jun 19, 2026
From: DIGIMARC LLC
To: DMRC LLC
Reel/Frame 075863/0266 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2020
From: STACH, JOHN F.; KAMATH, AJITH M.
To: DIGIMARC CORPORATION
Reel/Frame 052900/0228 →
Continuity (4)
Continuation 15687332 · Aug 25, 2017
Continuation 14724729 · May 28, 2015
Provisional Application 62106685 · Jan 22, 2015
Related Publication 20190266692A1 · Aug 29, 2019
Cited By (1)
US 12,333,624