Signal processing apparatus, signal processing method, output apparatus, output method, and program for learning and restoring signals with sparse coefficients
View Patent ↗There is provided a signal processing apparatus including a learning unit that learns a plurality of base signals of which coefficients become sparse, for each of features of signals, such that the signals are represented by a linear operation of the plurality of base signals.
1. A signal processing apparatus comprising:
circuitry configured to
learn a plurality of base image signals of which coefficients become sparse, for each of a plurality of features of each of the plurality of base image signals, such that the learned plurality of base image signals are represented by a linear operation of the plurality of base image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more objects within the plurality of base image signals.
2. The signal processing apparatus according to claim 1 ,
wherein the one or more frequency bands of the one or more learning blocks comprise one or more frequency bands selected from a group consisting of high frequency, intermediate frequency, and low frequency.
3. The signal processing apparatus according to claim 1 ,
wherein the features are features of scenes or photographing environments of the signals.
4. The signal processing apparatus according to claim 1 ,
wherein the features are features of spatial positions of images as the signals.
5. The signal processing apparatus according to claim 1 ,
wherein the features are features of time changes of moving images as the signals.
6. The signal processing apparatus according to claim 1 ,
wherein the features are features of terminals corresponding to the signals.
7. A signal processing method executed via a processor of a signal processing apparatus, the signal processing method comprising:
learning a plurality of base image signals of which coefficients become sparse, for each one of a plurality of features of image signals, such that the image signals are represented by a linear operation of the plurality of base image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more obiects within the plurality of base image signals.
8. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:
learning a plurality of base image signals of which coefficients become sparse, for each one of a plurality of features of image signals, such that the image signals are represented by a linear operation of the plurality of base image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more objects within the plurality of base image signals.
9. An output apparatus comprising:
circuitry configured to
operate coefficients of predetermined image signals, based on a plurality of base image signals of which the coefficients become sparse, learned for each one of a plurality of features of image signals such that the image signals are represented by a linear operation of the plurality of base image signals, and the predetermined image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more objects within the plurality of base image signals.
10. The output apparatus according to claim 9 ,
wherein the one or more frequency bands of the one or more learning blocks comprise one or more frequency bands selected from a group consisting of high frequency, intermediate frequency, and low frequency.
11. The output apparatus according to claim 9 ,
wherein the features are features of scenes or photographing environments of the signals.
12. The output apparatus according to claim 9 ,
wherein the features are features of spatial positions of images as the signals.
13. The output apparatus according to claim 9 ,
wherein the features are features of time changes of moving images as the signals.
14. The output apparatus according to claim 9 ,
wherein the features are features of terminals corresponding to the signals.
15. The output apparatus according to claim 9 , wherein the circuitry is further configured to
generate image signals corresponding to the predetermined image signals, using the coefficients operated by the operation unit and the plurality of base image signals.
16. The output apparatus according to claim 15 , wherein the circuitry is further configured to
recognize the predetermined image signals, based on differences of the generated image signals and the predetermined image signals.
17. An output method executed via a processor of an output apparatus, the output method comprising:
operating coefficients of predetermined image signals, based on a plurality of base image signals of which learned coefficients become sparse, wherein the coefficients are learned for each one of a plurality of features of image signals such that the image signals are represented by a linear operation of the plurality of base image signals, and the predetermined image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more objects within the plurality of base image signals.
18. A non-transitory computer-readable storage medium having embodied thereon a program which when executed by a computer causes the computer to execute a method, the method comprising:
operating coefficients of predetermined image signals, based on a plurality of base image signals of which coefficients become sparse, wherein the coefficients of each one of the plurality of base image signals are learned for each one of a plurality of features of image signals such that the image signals are represented by a linear operation of the plurality of base image signals, and the predetermined image signals,
wherein the plurality of features comprise a combination of one or more frequency bands indicating resolution of one or more learning blocks, each block of the one or more learning blocks comprising one or more of the plurality of base image signals, and depth direction position of one or more objects within the plurality of base image signals.
19. The signal processing apparatus according to claim 1 , wherein the depth direction position of the one or more objects indicates whether a depth value of the one or more objects is below a first threshold depth value or above a second threshold depth value, wherein the second threshold depth value is greater than the first threshold depth value.
20. The signal processing apparatus according to claim 9 , wherein the depth direction position of the one or more objects indicates whether a depth value of the one or more objects is below a first threshold depth value or above a second threshold depth value, wherein the second threshold depth value is greater than the first threshold depth value.