IP Library › Granted Patent US 12,229,653
Granted Patent B2
US 12,229,653 · App. 17/276,577 · Granted Feb 18, 2025

Methods and apparatuses for implementing adaptive multi-trace carving to track signal traces

Inventors: Qiang Zhu (College Park, MD); Mingliang Chen (Greenbelt, MD); Min Wu (Clarksville, MD); Chau-Wai Wong (Apex, NC)
Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
G06N3/04G10L25/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,653
App. No.
17/276,577
Granted
Feb 18, 2025
Kind
B2
Abstract

Systems, methods, apparatuses, and computer program products for tracking weak signal traces under severe noise and/or distortions. A method may include tracking at least one candidate frequency trace from a time-frequency representation of a signal. The method may also include identifying a frequency trace of the signal based on tracking results. In addition, the method may include outputting an estimated frequency vector related to the frequency trace. Further, the tracking may be performed under a noisy condition environment.

Claims (41)

1. A method of authenticating frequency traces, comprising:

iteratively tracking at least one candidate frequency trace from a time-frequency representation of a signal;

identifying all frequency traces of the signal via a multiple frequency traces tracking and detection procedure, wherein the multiple frequency traces tracking and detection procedure comprises

identifying at least one frequency trace comprising diffused energy of the signal within a predefined frequency range based on tracking results, and

determining an estimated frequency vector related to the at least one frequency trace by implementing an energy function, wherein the energy function comprises the time-frequency representation of the signal to be analyzed, and a regularization parameter that enforces smooth tracking results;

outputting the estimated frequency vector related to the at least one frequency trace;

reducing interference in subsequent iterations of tracking the at least one candidate frequency trace by attenuating, at an end of each iteration, diffused energy around the at least one frequency trace indicated by the estimated frequency vector; and

authenticating the identified frequency traces by validating all the identified and attenuated frequency traces against a reference source,

wherein the tracking is performed under a noisy condition environment.

2. The method according to claim 1 , wherein the tracking and outputting are performed via a convolutional neural network or the multiple frequency traces tracking and detection procedure.

3. The method according to claim 2 , wherein the convolutional neural network comprises a plurality of convolutional layers, a plurality of pooling layers, and at least one fully connected layer.

4. The method according to claim 3 , wherein each of the plurality of convolutional layers comprises a different filter size in frequency and in time.

5. The method according to claim 3 , wherein the plurality of pooling layers comprises a combination of maxpooling layers and an average pooling layer.

6. The method according to claim 3 , wherein the method further comprises applying a rectified linear units activation function after each of the plurality of convolutional layers and the at least one fully connected layer.

7. The method according to claim 2 , wherein the multiple frequency traces tracking and detection procedure comprises an iterative dynamic programming application and an adaptive trace compensation application.

8. The method according to claim 7 , wherein the iterative dynamic programming application comprises iteratively computing an accumulated regularized maximum energy map of the signal column by column for all entries.

9. The method according to claim 7 , wherein the iterative dynamic programming application further comprises backtracking from a maximum entry of a last column of the accumulated regularized maximum energy map.

10. The method according to claim 7 , wherein the iterative dynamic programming application further comprises determining, by a relative energy ratio, a presence of a frequency component within a time window of the signal.

11. The method according to claim 2 , wherein the multiple frequency traces tracking and detection procedure comprises an adaptive multi-trace carving application.

12. The method according to claim 11 , wherein the adaptive multi-trace carving application comprises iteratively running an iterative dynamic programming application, and attenuating diffused energy around the frequency component.

13. An apparatus, comprising:

at least one processor; and

at least one memory comprising computer program code,

the at least one memory and the computer program code are configured, with the at least one processor to cause the apparatus at least to

iteratively track at least one candidate frequency trace from a time-frequency representation of a signal;

identify all frequency traces of the signal via a multiple frequency traces tracking and detection procedure, wherein the multiple frequency traces tracking and detection procedure comprises

identification of at least one frequency trace comprising diffused energy of the signal within a predefined frequency range based on tracking results, and

determination of an estimated frequency vector related to the at least one frequency trace by implementing an energy function, wherein the energy function comprises the time-frequency representation of the signal to be analyzed, and a regularization parameter that enforces smooth tracking results;

output the estimated frequency vector related to the at least one frequency trace;

reduce interference in subsequent iterations of tracking the at least one candidate frequency trace by attenuating, at an end of each iteration, diffused energy around the at least one frequency trace indicated by the estimated frequency vector; and

authenticate the identified frequency traces by validating all the identified and attenuated frequency traces against a reference source,

wherein the tracking is performed under a noisy condition environment.

14. A computer program embodied on a non-transitory computer-readable medium, said computer program comprising program instructions stored thereon for performing a method, the method comprising:

iteratively tracking at least one candidate frequency trace from a time-frequency representation of signal;

identifying all frequency traces of the signal via a multiple frequency traces tracking and detection procedure, wherein the multiple frequency traces tracking and detection procedure comprises

identifying at least one frequency trace comprising diffused energy of the signal within a predefined frequency range based on tracking results, and

determining an estimated frequency vector related to the at least one frequency trace by implementing an energy function, wherein the energy function comprises the time-frequency representation of the signal to be analyzed, and a regularization parameter that enforces smooth tracking results;

outputting the estimated frequency vector related to the at least one frequency trace;

reducing interference in subsequent iterations of tracking the at least one candidate frequency trace by attenuating, at an end of each iteration, diffused energy around the at least one frequency trace indicated by the estimated frequency vector; and

authenticating the identified frequency traces by validating all the identified and attenuated frequency traces against a reference source,

wherein the tracking is performed under a noisy condition environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2025
From: CHEN, MINGLIANG; WONG, CHAU-WAI; WU, MIN; ZHU, QIANG
To: UNIVERSITY OF MARYLAND, COLLEGE PARK
Reel/Frame 069774/0431 →
Continuity (2)
Provisional Application 62733397 · Sep 19, 2018
Related Publication 20220051075A1 · Feb 17, 2022
References Cited (20)
US 8949118B2 · Avargel et al. · 2015 [cited by applicant]
US 20130246062A1 · Avargel · 2013 [cited by examiner]
US 20140358730A1 · Achan · 2014 [cited by examiner]
US 20160035078A1 · Lin · 2016 [cited by examiner]
US 20170221176A1 · Munteanu · 2017 [cited by examiner]
US 20190052958A1 · Miller · 2019 [cited by examiner]
Ide et al. Improvement of Learning for CNN with ReLU Activation by Sparse Regularization. IEEE. 2017 (Year: 2017). [cited by examiner]
Knack et al. Real-Time Content-Aware Video Retargeting for Tunnel Vision Assistance. Multimedia Content and Mobile Devices, edited by David Akopian, et al., Proc. of SPIE-IS&T Electronic Imaging, SPIE vol. 8667, 86670N … [cited by examiner]
Convolutional Neural Networks Basics An Introduction to CNNs and Deep Learning. 2017 (Year: 2017). [cited by examiner]
MIT Computer Vision. Advances in Computer Vision. Fall 2015 (Year: 2015). [cited by examiner]
Wikipedia. Smoothing. The Wayback Machine—https://web.archive.org/web/20160504051658/https://en.wikipedia.org/wiki/Smoothing (Year: 2016). [cited by examiner]
Avidan et al. Seam Carving for Content-Aware Image Resizing. ACM Transactions on Graphics, vol. 26, No. 3, Article 10, Publication date: Jul. 2007. (Year: 2007). [cited by examiner]
International Search Report and Written Opinion dated Dec. 12, 2019 corresponding to International Patent Application No. PCT/US2019/051979. [cited by applicant]
J. Rissanen, “Modeling by Shortest Data Description”, Automatica, vol. 14, pp. 465-471, International Federation of Automatic Control Pergamon Press Ltd. 1978, printed in Great Britain, 7 pages. [cited by applicant]
A. Nádas et al., “Speech Recognition Using Noise-Adaptive Prototypes”, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, No. 10, Oct. 1989, 9 pages. [cited by applicant]
Qiang Zhu et al., “Adaptive Multi-Trace Carving Based on Dynamic Programming”, Asilomar 2018, 5 pages. [cited by applicant]
A. Hajj-Ahmad et al., “Spectrum Combining for ENF Signal Estimation”, IEEE Signal Processing Letters, vol. 20, No. 9, Sep. 2013, DOI: 10.1109/LSP.2013.2272523, 4 pages. [cited by applicant]
S. Zahorian et al., “A Spectral/Temporal Method for Robust Fundamental Frequency Tracking”, The Journal of the Acoustical Society of America 123, 4559 (2008); doi: 10.1121/1.2916590, 14 pages. [cited by applicant]
Y. Shi et al., “Spectrogram-Based Formant Tracking Via Particle Filters”, Microsoft Research Asia, ICASSP 2003, 4 pages. [cited by applicant]
V. Mitra et al., “Time-Frequency Convolutional Networks for Robust Speech Recognition”, Speech Technology and Research Laboratory, SRI International, Menlo Park, CA, ASRU 2015, 7 pages. [cited by applicant]