IP Library Granted Patent US 11,410,261
Granted Patent B2
US 11,410,261 · App. 17/020,307 · Granted Aug 9, 2022

Differential modulation for robust signaling and synchronization

Inventors: John F. Stach (Portland, OR); Ajith M. Kamath (Beaverton, OR)
Assignee: Digimarc Corporation
G06T1/005G06T1/0028G06T1/0064G06T2201/0061G06T2201/0065G06T2201/0202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,410,261
App. No.
17/020,307
Granted
Aug 9, 2022
Kind
B2
Abstract

Differential modulation schemes encode a data channel within host signal or noisy environment in a manner that is robust, flexible to achieve perceptual quality constraints, and provides improved data capacity. Differential arrangements enable a decoder to suppress host signal or other background signal interference when detecting, synchronizing and extracting an encoded data channel. They also enable the incorporation of implicit or explicit synchronization components, which are either formed from the data signal or are complementary to it.

Claims (32)

1. A non-transitory computer readable medium on which is stored instructions, which when executed by a processor, perform the method of:

generating an auxiliary data signal comprised of variable data elements;

mapping each of the variable data elements to plural blocks within a host image signal, wherein each block comprises neighboring embedding locations within the host image signal;

for each variable data element, modulating the host image signal according to the variable data element to embed the variable data element in corresponding plural blocks, including within each of the corresponding plural blocks, modulating the host image signal by establishing differential relationships between the variable data element in non-adjacent embedding locations within each block of the plural blocks.

2. The non-transitory computer readable medium of claim 1 on which is stored instructions, which when executed by a processor, perform the method of:

mapping variable data elements in a repetitive structure that forms a template in a frequency domain transform of the host image signal.

3. The non-transitory computer readable medium of claim 1 wherein plural of the variable data elements are mapped to the same plural blocks within the host image signal, and plural variable data elements within the same block are encoded in differential relationships among interleaved embedding locations within the same block.

4. The non-transitory computer readable medium of claim 1 on which is stored instructions, which when executed by a processor, perform the method of:

mapping synchronization signal elements to plural blocks within the host image signal.

5. The non-transitory computer readable medium of claim 4 wherein embedding locations of the synchronization signal elements and the variable data elements are interleaved within the same plural blocks.

6. The non-transitory computer readable medium of claim 4 wherein differential relationships for encoding the variable data elements and synchronization signal elements are established using vectors for the variable data elements and synchronization elements that are orthogonal.

7. An apparatus for encoding auxiliary data in a host image signal, the apparatus comprising:

means for generating an auxiliary data signal comprised of variable data elements;

means for mapping each of the variable data elements to plural blocks within the host image signal, wherein each block comprises neighboring embedding locations within the host image signal;

means for modulating the host image signal according to the variable data element to embed the variable data element in corresponding plural blocks, including means for modulating the host image signal by establishing differential relationships between the variable data element in non-adjacent embedding locations within corresponding blocks where each variable data element is mapped.

8. The non-transitory computer readable medium of claim 1 , further comprising instructions, which when executed by a processor, perform a method of decoding an auxiliary data signal embedded in a host image, the method comprising:

applying geometrically distorted versions of a first extraction filter to the host image to obtain feature vectors;

obtaining geometric distortion parameters from the feature vectors;

for each of plural filtering locations within the host image, applying a second extraction filter that extracts auxiliary data signal elements from relationships between host image signal elements at embedding locations within a block of neighboring embedding locations around a filtering location, wherein the relationships are formed by differential modulation of the auxiliary data signal within the host image;

aggregating filter output across plural filtering locations for each of plural variable data signal elements within the auxiliary data signal to obtain estimates of each of the plural variable data signal elements; and

error correction decoding a variable message from the estimates.

9. The non-transitory computer readable medium of claim 8 , further comprising instructions, which when executed by a processor, perform the acts of:

transforming the host image into a frequency domain, wherein a repetitive pattern of the relationships form a template;

matching the transformed host image with a pre-determined template to obtain an estimate of rotation and scale of the auxiliary data signal within the host image.

10. The non-transitory computer readable medium of claim 9 , further comprising instructions, which when executed by a processor, perform the acts of:

with the rotation and scale to compensate for geometric distortion, applying the extraction filter to extract an approximate auxiliary data signal from the relationships;

transforming the approximate auxiliary data signal into a frequency domain; and

refining synchronization by matching the pre-determined template with the transformed approximate auxiliary data signal.

11. The non-transitory computer readable medium of claim 8 further comprising instructions, which when executed by a processor, perform the act of:

transforming the host image into a frequency domain, wherein a repetitive pattern of the relationships form a template; wherein the auxiliary data signal comprises variable data signal elements and sync signal elements that are differentially encoded within the host image according to orthogonal vectors for the variable data signal elements and the sync signal elements.

12. The non-transitory computer readable medium of claim 8 further comprising instructions, which when executed by a processor, perform the act of:

synchronizing the auxiliary data signal with nulls formed in an output of applying the second extraction filter to the host image.

Assignments (3)
ARTICLES OF CONVERSION Recorded Jun 19, 2026
From: DIGIMARC CORPORATION
To: DIGIMARC LLC
Reel/Frame 075863/0211 →
ARTICLES OF AMENDMENT OFTHE ARTICLES OF ORGANIZATION OF DIGIMARC LLC Recorded Jun 19, 2026
From: DIGIMARC LLC
To: DMRC LLC
Reel/Frame 075863/0266 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2020
From: STACH, JOHN F.; KAMATH, AJITH M.
To: DIGIMARC CORPORATION
Reel/Frame 053764/0157 →
Continuity (5)
Continuation 16247259 · Jan 14, 2019
Continuation 15687332 · Aug 25, 2017
Continuation 14724729 · May 28, 2015
Provisional Application 62106685 · Jan 22, 2015
Related Publication 20210073935A1 · Mar 11, 2021
Cited By (1)
US 12,333,624