Method, system, and software for improving signal quality using pyramidal decomposition
View Patent ↗A method, system, and software are disclosed for improving the quality of a signal. A base signal is recursively decomposed for a desired number of pyramid levels. The decomposed signal from the lowest level is modified to generate a preprocessed signal. The preprocessed signal from the lowest level is used to improve signal components or characteristics of the decomposed signal of the next higher level of the pyramidal decomposition, resulting in a modified signal at the next higher level. In one embodiment, the preprocessed signal includes filter mask that is used to guide a filtering process on the decomposed signal of the next higher level. In another embodiment, the preprocessed signal includes a up-predicted signal that is combined with the decomposed signal of the next higher level. The preprocessed signal from a lower level is used to generate a modified signal at a higher level. The generation of a preprocessed signal and a modified signal is recursively repeated for each level until the highest level of the pyramidal decomposition is reached, resulting in an improved base signal. The present invention finds particular application in photography and digital film processing, whereby the illustrated method may be used to reduce image noise, thereby improving image quality.
1. A method including the steps of:
obtaining a base signal including a plurality of signal components;
performing a higher level pyramidal decomposition of the base signal to generate a higher level decomposed signal;
performing a lower level pyramidal decomposition of the first decomposed signal to generate a lower level decomposed signal;
increasing, using the lower level decomposed signal, a ratio of a desired signal component of the higher level decomposed signal to other signal components of the higher level decomposed signal to generate a first modified signal; and
increasing, using the first modified signal, a ratio of a desired signal component of the base signal to other signal components of the base signal to generate an improved base signal.
2. The method as in claim 1 , wherein increasing the ratio of a desired signal component includes reducing the other signal components.
3. The method as in claim 1 , wherein increasing the ratio of a desired signal component includes filtering.
4. The method as in claim 1 , wherein either increasing step further includes the step of upsampling.
5. The method as in claim 1 , further including performing a lower level pyramidal decomposition for a plurality of levels.
6. The method as in claim 1 , wherein increasing the ratio of a desired signal component of the higher level decomposed signal includes the steps of:
up-predicting, using the lower level decomposed signal, the desired signal component of the higher level decomposed signal to generate a first preprocessed signal; and
combining the first preprocessed signal and the higher level decomposed signal to generate the first modified signal.
7. The method as in claim 6 , wherein the step of combining is based on the ratio of a desired signal component to other signal components.
8. The method as in claim 1 , wherein increasing the ratio of a desired signal component of a higher level decomposed signal includes the steps of:
generating, using the lower level decomposed signal, a first filter mask; and
filtering, using the first filter mask, the higher level decomposed signal to generate a first modified signal.
9. The method as in claim 8 , wherein the step of filtering includes using a match blur.
10. The method as in claim 8 , further including the step of combining the first modified signal and the higher level decomposed signal.
11. The method as in claim 1 , wherein the base signal is a digital representation of an analog signal.
12. A method including the steps of:
obtaining a base image including a plurality of image components;
performing a higher level pyramidal decomposition of the base image to generate a first decomposed image;
performing a lower level pyramidal decomposition of the first decomposed image to generate a second decomposed image;
increasing, using the second decomposed image, the signal-to-noise ratio of the first decomposed image to generate a first modified image;
increasing, using the first modified image, the signal-to-noise ratio of the base image to other image components of the base image to generate an improved base image.
13. The method as in claim 12 , wherein increasing the signal-to-noise ratio includes reducing noise.
14. The method as in claim 12 , wherein increasing the signal-to-noise ratio includes filtering the plurality of image components.
15. The method as in claim 12 , wherein either increasing step further includes the step of upsampling.
16. The method as in claim 12 , further including performing a lower level pyramidal decomposition for a plurality of levels.
17. The method as in claim 12 , wherein increasing the signal-to-noise ratio of the
higher level image includes the steps of: up-predicting, using the lower level decomposed image, the desired image
component of the higher level decomposed image to generate a first
preprocessed image; and combining the first preprocessed image and the higher level decomposed
image to generate the first image signal.
18. The method as in claim 17 , wherein the step of combining is based on the signal-to-noise ratio.
19. The method as in claim 12 , wherein increasing the signal-to-noise ratio of the higher level decomposed image includes the steps of:
generating, using the lower level decomposed image, a first filter mask; and
filtering, using the first filter mask, the higher level decomposed image to generate a first modified image.
20. The method as in claim 19 , wherein the step of filtering includes using a match blur.
21. The method as in claim 19 , further including the step of combining the first modified image and a higher level decomposed image.
22. The method as in claim 12 , wherein said base image is a digital representation of an image recorded in a physical medium.
23. A digital film development system comprising:
a film processing system, said film processing system including an image capturing station capable of obtaining sets of data representing an image formed in film; and
a data processing system, said data processing system including:
a processor;
memory operably coupled to said processor; and
a program of instructions capable of being stored in said memory and executed by said processor, said program of instructions including instructions to manipulate a processor to:
obtain a base image including a plurality of image components;
perform a higher level pyramidal decomposition of the base image to generate a first decomposed image;
perform a lower level pyramidal decomposition of the first decomposed image to generate a second decomposed image;
increase, using the second decomposed image, the signal-to-noise ratio of the first decomposed image to generate a first modified image;
increase, using the first modified image, the signal-to-noise ratio of the base image to other image components of the base image to generate an improved base image.
24. The digital film development system as in claim 23 , wherein the instructions to manipulate said processor to increase the signal-to-noise ratio includes instructions to manipulate said processor to reduce noise.
25. The digital film development system as in claim 24 , wherein the instructions to manipulate said processor to increase the ratio includes instructions to manipulate said processor to filter the other image components.
26. The digital film development system as in claim 23 , further including instructions in either increase step to manipulate said processor to upsample a signal.
27. The digital film development system as in claim 23 , further including instructions to manipulate said processor to perform a pyramidal decomposition for a plurality of lower levels.
28. The digital film development system as in claim 23 , wherein the instructions
to manipulate said processor to increase the signal-to-noise ratio further include instructions to manipulate said processor to:
up-predict, using the lower level decomposed image, the desired image component of the higher level decomposed image to generate a first preprocessed image; and
combine the first preprocessed image and the higher level decomposed image to generate the first modified signal.
29. The digital film development system as in claim 28 , wherein the instructions to manipulate said processor to combine are based on the signal-to-noise ratio.
30. The digital film development system as in claim 23 , further including instructions to manipulate said processor to:
generate, using the lower level decomposed image, a first filter mask; and
filter, using the first filter mask, the higher level decomposed image to generate a first modified image.
31. The digital film development system as in claim 30 , further including instructions to manipulate said processor to filter further includes instructions to manipulate said processor to use a match blur.
32. The digital film development system as in claim 30 , further including instructions to manipulate said processor to combine the first modified image and a higher level decomposed image.
33. The digital film development system as in claim 23 , wherein said base image is a digital representation of an image recorded in a physical medium.
34. A method of generating a digital image tangibly embodied in a computer readable medium, said method including the steps of:
obtaining a base image including a plurality of image components;
performing a higher level pyramidal decomposition of the base image to generate a first decomposed image;
performing a lower level pyramidal decomposition of the first decomposed image to generate a second decomposed image;
increasing, using the second decomposed image, the signal-to-noise ratio of the first decomposed image to generate a first modified image; and
increasing, using the first modified image, the signal-to-noise ratio of the base image to other image components of the base image to generate an improved base image.
35. The method of claim 34 , wherein the step of increasing the signal-to-noise ratio includes the step of reducing noise.
36. The method of claim 35 , wherein the step of increasing the signal-to-noise ratio includes the step of filtering the plurality of image components.
37. The method of claim 34 , wherein either increasing step further the step of upsampling.
38. The method of claim 34 , further including performing a pyramidal decomposition for a plurality of lower levels.
39. The method of claim 34 , wherein increasing the signal-to-noise ratio of the higher level image includes the steps of:
up-predicting, using the lower level decomposed image, the desired image component of the higher level decomposed image to generate a first preprocessed image; and
combining the first preprocessed image and the higher level decomposed image to generate the first image signal.
40. The method of claim 39 , wherein the step of combining is based on the signal-to-noise ratio.
41. The method of claim 34 , wherein the step of increasing the signal-to-noise ratio includes the steps of:
generating, using the lower level decomposed image, a first filter mask; and
filtering, using the first filter mask, the higher level decomposed image to generate a first modified image.
42. The method of claim 41 , wherein the step of filtering includes using a match blur.
43. The method of claim 41 , further including the step of combining the first modified image and the higher level decomposed image.
44. The method of claim 34 , wherein said base image is a digital representation of an image recorded in a physical medium.
45. A computer readable medium tangibly embodying a computer program of instructions
to manipulate a processor to:
obtain a base signal including a plurality of signal components;
perform a higher level pyramidal decomposition of the base signal to generate a higher level decomposed signal;
perform a lower level pyramidal decomposition of the first decomposed signal to generate a lower level decomposed signal;
increase, using a lower level decomposed signal, a ratio of a desired signal component of the higher level decomposed signal to other signal components of the higher level decomposed signal to generate a first modified signal; and
increase, using the first modified signal, a ratio of a desired signal component of the base signal to other signal components of the base signal to generate an improved base signal.
46. The computer readable medium as in claim 45 , wherein the instructions to manipulate said processor to increase the ratio includes instructions to manipulate said processor to reduce the other signal components.
47. The computer readable medium as in claim 46 , wherein the instructions to manipulate said processor to increase the ratio includes instructions to manipulate said processor to filter the other signal components.
48. The computer readable medium as in claim 45 , further including instructions in either increase step to manipulate said processor to upsample a signal.
49. The computer readable medium as in claim 45 , further including instructions to manipulate said processor to perform a pyramidal decomposition on a plurality of lower levels.
50. The computer readable medium as in claim 45 , wherein the instructions to
manipulate said processor to increase the ratio further include instructions to manipulate a said processor to:
up-predict, using the lower level decomposed signal, the desired signal component of the higher level decomposed signal to generate a first preprocessed signal; and
combine the first preprocessed signal and the higher level decomposed signal to generate the first modified signal.
51. The computer readable medium as in claim 50 , wherein the instructions to manipulate said processor to combine are based on the ratio of a desired signal component to other signal components.
52. The computer readable medium as in claim 45 , wherein the instructions to
manipulate said processor to increase the ratio further include instructions to manipulate said processor to:
generate, using the lower level decomposed signal, a first filter mask; and
filter, using the first filter mask, the higher level decomposed signal to generate a first modified signal.
53. The computer readable medium as in claim 52 , wherein the instructions to manipulate said processor to filter further include instructions to manipulate said processor to use a match blur.
54. The computer readable medium as in claim 52 , further including instructions to manipulate said processor to combine the first modified signal and the higher level decomposed signal.
55. The computer readable medium as in claim 45 , wherein said base signal is a digital representation of an analog signal.