IP Library Granted Patent US 11,183,198
Granted Patent B2
US 11,183,198 · App. 16/751,629 · Granted Nov 23, 2021

Multi-mode audio recognition and auxiliary data encoding and decoding

Inventors: Tomas Filler (Tigard, OR); Shankar Thagadur Shivappa (San Diego, CA)
Assignee: Digimarc Corporation
G10L19/018G10L19/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,183,198
App. No.
16/751,629
Granted
Nov 23, 2021
Kind
B2
Abstract

Audio signal processing enhances audio watermark embedding and detecting processes. Audio signal processes include audio classification and adapting watermark embedding and detecting based on classification. Advances in audio watermark design include adaptive watermark signal structure data protocols, perceptual models, and insertion methods. Perceptual and robustness evaluation is integrated into audio watermark embedding to optimize audio quality relative the original signal, and to optimize robustness or data capacity. These methods are applied to audio segments in audio embedder and detector configurations to support real time operation. Feature extraction and matching are also used to adapt audio watermark embedding and detecting.

Claims (32)

1. A method of detecting a watermark in an electronic audio signal, the method comprising:

estimating rake receiver parameters using known attributes of a watermark signal in the electronic audio signal;

forming a rake receiver using the estimated rake receiver parameters, wherein the rake receiver detects reflections of the watermark signal due to multipath; and

detecting the watermark signal by applying the rake receiver with the estimated rake receiver parameters to the electronic audio signal, the applying comprising correlating the electronic audio signal with the watermark signal and combining the reflections of the watermark signal to improve watermark signal to noise ratio.

2. The method of claim 1 wherein the rake receiver parameters comprise delay and attenuation factor for each of plural rake fingers.

3. The method of claim 2 wherein the attenuation factors are determined with a Maximum Likelihood Estimator assessment of correlation between the watermark signal and the electronic audio signal, the delay corresponding to a peak in the correlation.

4. The method of claim 2 comprising:

determining the rake receiver parameters by correlating the electronic audio signal with a chip sequence to produce a correlation signal and evaluating variance of the correlation signal by assessing amount of variance at each of plural delays.

5. The method of claim 1 comprising:

in a mobile device, re-estimating the rake receiver parameters in response to sensor input indicating movement of the mobile device.

6. A non-transitory computer readable medium on which is stored instructions that configure a processor to perform a method of:

estimating rake receiver parameters using known attributes of a watermark signal in the electronic audio signal;

forming a rake receiver using the estimated rake receiver parameters, wherein the rake receiver detects reflections of the watermark signal due to multipath; and

detecting the watermark signal by applying the rake receiver with the estimated rake receiver parameters to the electronic audio signal, the applying comprising correlating the electronic audio signal with the watermark signal and combining the reflections of the watermark signal to improve watermark signal to noise ratio.

7. The non-transitory computer readable medium of claim 6 wherein the rake receiver parameters comprise delay and attenuation factor for each of plural rake fingers.

8. The non-transitory computer readable medium of claim 7 wherein the attenuation factors are determined with a Maximum Likelihood Estimator assessment of correlation between the watermark signal and the electronic audio signal, the delay corresponding to a peak in the correlation.

9. The non-transitory computer readable medium of claim 7 on which is stored instructions that configure the processor to perform a method further comprising:

determining the rake receiver parameters by correlating the electronic audio signal with a chip sequence to produce a correlation signal and evaluating variance of the correlation signal by assessing amount of variance at each of plural delays.

10. The non-transitory computer readable medium of claim 6 on which is stored instructions that configure the processor to perform a method further comprising:

in a mobile device, re-estimating the rake receiver parameters in response to sensor input indicating movement of the mobile device.

11. An audio watermark detector comprising:

a memory;

a processor configured to read an audio signal captured from a microphone and stored in the memory, the processor configured with instructions to:

estimate rake receiver parameters using known attributes of a watermark signal in the electronic audio signal;

form a rake receiver using the estimated rake receiver parameters, wherein the rake receiver detects reflections of the watermark signal due to multipath; and

detect the watermark signal by applying the rake receiver with the estimated rake receiver parameters to the electronic audio signal, the instructions configured to apply the rake receiver by correlating the electronic audio signal with the watermark signal and the correlating configured to combine the reflections of the watermark signal to improve watermark signal to noise ratio.

12. The audio watermark detector of claim 11 wherein the rake receiver parameters comprise delay and attenuation factor for each of plural rake fingers.

13. The audio watermark detector of claim 12 wherein the attenuation factors are determined with a Maximum Likelihood Estimator assessment of correlation between the watermark signal and the electronic audio signal, the delay corresponding to a peak in the correlation.

14. The audio watermark detector of claim 12 wherein the processor is further configured with instructions to:

determine the rake receiver parameters by correlating the electronic audio signal with a chip sequence to produce a correlation signal and evaluating variance of the correlation signal by assessing amount of variance at each of plural delays.

15. The audio watermark detector of claim 12 wherein the processor is further configured with instructions to:

re-estimating the rake receiver parameters in response to sensor input indicating movement of a mobile device.

Assignments (3)
ARTICLES OF CONVERSION Recorded Jun 19, 2026
From: DIGIMARC CORPORATION
To: DIGIMARC LLC
Reel/Frame 075863/0211 →
ARTICLES OF AMENDMENT OFTHE ARTICLES OF ORGANIZATION OF DIGIMARC LLC Recorded Jun 19, 2026
From: DIGIMARC LLC
To: DMRC LLC
Reel/Frame 075863/0266 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2020
From: FILLER, TOMAS; THAGADUR SHIVAPPA, SHANKAR
To: DIGIMARC CORPORATION
Reel/Frame 052899/0887 →
Continuity (6)
Continuation 15848339 · Dec 20, 2017
Continuation 15090279 · Apr 4, 2016
Continuation 14054492 · Oct 15, 2013
Continuation In Part 13841727 · Mar 15, 2013
Provisional Application 61714019 · Oct 15, 2012
Related Publication 20200234719A1 · Jul 23, 2020
Cited By (3)
US 12,512,987 US 12,738,281 US 12,738,282