Three dimensional image generating method and apparatus
View Patent ↗There is provided a 3D image generation method and apparatus. A 3D image generation method according to an embodiment includes outputting a signal to an object from at least one point, receiving the signal reflected by the object at one or more points, and generating a 3D image of the object based on a temporal feature and a spectral feature of the signal reflected by the object.
1. A 3D image generation method comprising:
outputting a signal to an object from at least one point;
receiving the signal reflected by the object at one or more points; and
generating a 3D image of the object based on a temporal feature and a spectral feature of the signal reflected by the object,
wherein generating a 3D image of the object comprises:
extracting a feature map including the temporal feature and the spectral feature from the reflected signals; and
generating the 3D image of the object by processing the feature map.
2. The method of claim 1 , wherein extracting a feature map comprises:
generating at least one spectrogram by producing time-frequency representation of the reflected signal; and
extracting the feature map by processing the at least one spectrogram.
3. The method of claim 2 , wherein generating at least one spectrogram comprises
generating at least one spectrogram by converting the signal reflected by the object based on at least one window.
4. The method of claim 2 , wherein generating at least one spectrogram comprises
generating the at least one spectrogram by performing Fourier transform on the signal reflected by the object.
5. The method of claim 1 , wherein extracting a feature map comprises:
extracting at least one feature map including the temporal feature and the spectral feature by performing at least one convolution operation on the reflected signal; and
combining the at least one feature map.
6. The method of claim 5 , wherein combining the at least one feature map comprises
concatenating the at least one feature map; and
performing a convolution operation on the concatenated at least one feature map.
7. The method of claim 5 , wherein extracting the at least one feature map further comprises
sampling the reflected signal on which at least one convolution operation is performed.
8. The method of claim 5 , wherein the at least one convolution operation comprises
a convolution operation of which a size of a receptive field is variable.
9. The method of claim 1 , wherein generating a 3D image by processing the feature map comprises:
generating a vector by converting the feature map; and
generating the 3D image by performing at least one convolution operation on the vector.
10. The method of claim 1 , wherein outputting a signal to an object from at least one point comprises
outputting an ultrasonic chirp to the object.
11. The method of claim 10 , outputting the ultrasonic chirp comprises
outputting the ultrasonic chirp by controlling at least one of a length, linearity, a number of harmonic bands, and an output period of the ultrasonic chirp.
12. A 3D image generation apparatus comprising:
a transmitter that outputs a signal to an object from at least one point;
a receiver that receives the signal reflected by the object at one or more points; and
a processor that generates a 3D image of the object based on a temporal feature and a spectral feature of the signal reflected by the object,
wherein the processor is configured to
extract a feature map including the temporal feature and the spectral feature from the reflected signal, and generate the 3D image of the object by processing the feature map.
13. The 3D image generation apparatus of claim 12 , wherein the processor is configured to
generate at least one spectrogram by producing time-frequency representation of the reflected signal, and extract the feature map by processing the at least one spectrogram.
14. The 3D image generation apparatus of claim 13 , wherein the processor is configured to
generate at least one spectrogram by converting the signal reflected by the object based on at least one window.
15. The 3D image generation apparatus of claim 13 , wherein the processor is configured to
generate the at least one spectrogram by performing Fourier transform on the signal reflected by the object.
16. The 3D image generation apparatus of claim 12 , wherein the processor is configured to
extract at least one feature map including the temporal feature and the spectral feature by performing at least one convolution operations on the reflected signal, and combine the at least one feature map.
17. The 3D image generation apparatus of claim 16 , wherein the processor is configured to
concatenate the at least one feature map, and perform a convolution operation on the at least one concatenated feature map.
18. The 3D image generation apparatus of claim 16 , wherein the processor is configured to
sample the reflected signal on which at least one convolution operation is performed.
19. The 3D image generation apparatus of claim 16 , wherein the at least one convolution operation comprises
a convolution operation of which a size of a receptive field is variable.
20. The 3D image generation apparatus of claim 12 , wherein the processor is configured to
generate a vector by converting the feature map, and generate the 3D image by performing at least one convolution operation on the vector.
21. The 3D image generation apparatus of claim 12 , wherein the transmitter is configured to
output an ultrasonic chirp to the object.
22. The 3D image generation apparatus of claim 21 , wherein the transmitter is configured to
output the ultrasonic chirp by controlling at least one of a length, linearity, a number of harmonic bands, and an output period of the ultrasonic chirp.