System and methods of amplitude-modulation frequency-modulation (AM-FM) demodulation for image and video processing
Image and video processing using multi-scale amplitude-modulation frequency-modulation (“AM-FM”) demodulation where a multi-scale filterbank with bandpass filters that correspond to each scale are used to calculate estimates for instantaneous amplitude, instantaneous phase, and instantaneous frequency. The image and video are reconstructed using the instantaneous amplitude and instantaneous frequency estimates and variable-spacing local linear phase and multi-scale least square reconstruction techniques. AM-FM demodulation is applicable in imaging modalities such as electron microscopy, spectral and hyperspectral devices, ultrasound, magnetic resonance imaging (“MRI”), positron emission tomography (“PET”), histology, color and monochrome images, molecular imaging, radiographs (“X-rays”), computer tomography (“CT”), and others. Specific applications include fingerprint identification, detection and diagnosis of retinal disease, malignant cancer tumors, cardiac image segmentation, atherosclerosis characterization, brain function, histopathology specimen classification, characterization of anatomical structure such as carotid artery walls and plaques or cardiac motion and as the basis for computer-aided diagnosis to name a few.
1. A computer system method for modeling image content comprising the steps of:
providing an input image;
computing a two-dimensional extended analytic signal of the input image;
selecting a multi-scale filterbank by defining one or more bandpass filters that correspond to each scale of the multi-scale filterbank;
processing the two-dimensional extended analytic signal through the multi-scale filterbank;
calculating estimates for instantaneous amplitude, instantaneous phase, and instantaneous frequency, said calculating step further comprising the step of applying a Variable Spacing Local Linear Phase Model;
selecting the instantaneous amplitude estimate with the maximum amplitude response, the instantaneous phase estimate with the maximum phase response, and the instantaneous frequency estimate with the maximum frequency response from said calculating step;
reconstructing the input image using the instantaneous amplitude estimate and instantaneous frequency estimate from said selecting step to obtain a reconstructed image; and
displaying the reconstructed image on a display unit.
2. The computer system method for modeling image content of claim 1 wherein said applying step further comprises the steps of:
selecting the instantaneous frequency estimate with the minimum value for a condition number;
pre-filtering the instantaneous frequency estimate with a median filter;
post-filtering the instantaneous frequency estimate with the median filter; and
modulating high-frequency outputs to baseband, wherein the Variable Spacing Local Linear Phase Model is directly applicable.
3. The computer system method for modeling image content of claim 1 wherein the multi-scale filterbank includes the one or more bandpass filters that have been optimally designed using min-max criteria.
4. The computer system method for modeling image content of claim 1 wherein said reconstructing step further includes the step of:
figuring the instantaneous amplitude estimate and the instantaneous frequency estimate for each scale of the multi-scale filterbank to obtain computed estimates.
5. The computer system method for modeling image content of claim 1 wherein the method is applied to images identifying of disease at different stages.
6. The computer system method for modeling image content of claim 1 wherein the method is applied to retinal image analysis.
7. The computer system method for modeling image content of claim 6 wherein the retinal image analysis further includes diabetic retinopathy classification.
8. The computer system method for modeling image content of claim 1 wherein the method is applied to processing X-ray images.
9. The computer system method for modeling image content of claim 1 wherein the method is applied to describing images featuring atherosclerotic plaque.
10. A computer system method for modeling video content comprising the steps of:
providing an input video;
computing a three-dimensional extended analytic signal of the input video;
selecting a multi-scale filterbank by defining one or more bandpass filters that correspond to each scale of the multi-scale filterbank;
processing the three-dimensional extended analytic signal through the multi-scale filterbank;
calculating estimates for instantaneous amplitude, instantaneous phase, and instantaneous frequency, said calculating step further comprising the step of applying a Variable Spacing Local Linear Phase Model;
selecting the instantaneous amplitude estimates with the maximum amplitude response, the instantaneous phase estimate with the maximum phase response, and the instantaneous frequency estimate with the maximum frequency response from said calculating step;
reconstructing the input video using the instantaneous amplitude estimate and instantaneous frequency estimate from said selecting step to obtain a reconstructed video; and
displaying the reconstructed video on a display unit.
11. The computer system method for modeling video content of claim 10 wherein said applying step further comprises the steps of:
Selecting the instantaneous frequency estimates with the minimum value for a condition number;
pre-filtering the instantaneous frequency estimate with a median filter;
post-filtering the instantaneous frequency estimate with the median filter; and
modulating high-frequency outputs to baseband, wherein the Variable Spacing Local Linear Phase Model is directly applicable.
12. The computer system method for modeling video content of claim 10 wherein the multi-scale filterbank includes the one or more bandpass filters that have been optimally designed using min-max criteria.
13. The computer system method for modeling video content of claim 10 wherein said reconstructing step further includes the step of:
figuring the instantaneous amplitude estimate and the instantaneous frequency estimate scale by for each scale of the multi-scale filterbank to obtain computed estimates.
14. The computer system method for modeling video content of claim 10 wherein the method is applied to images identifying disease at different stages.
15. The computer system method for modeling video content of claim 10 wherein the method is applied to retinal image analysis.
16. The computer system method for modeling video content of claim 15 wherein the retinal image analysis further includes diabetic retinopathy classification.
17. The computer system method for modeling video content of claim 10 wherein the method is applied to processing X-ray images.
18. The computer system method for modeling video content of claim 10 wherein the method is applied to describing images featuring atherosclerotic plaque.