Method and apparatus for two-dimensional to three-dimensional image conversion
View Patent ↗A method and apparatus provide two-dimensional to three-dimensional image conversion. The apparatus can include an input configured to receive a first image. The apparatus can include a controller configured to segment the first image into a plurality of regions, configured to perform a Fast Fourier Transform on at least one of the regions, and configured to determine a relative horizontal displacement distance between a first frame and a second frame of at least one region based on performing the Fast Fourier Transform.
1. A method comprising:
receiving a first image;
segmenting the first image into a plurality of regions, each region of the first image comprising a frame;
performing, on a first region of the plurality of regions, the first region comprising a first frame, a Fast Fourier Transform that comprises summing high frequency coefficients of averaged Fast Fourier Transform spectra of the first region to provide a summed high frequency coefficient of the first region;
determining, from the summed high frequency coefficient of the first region and a summed high frequency coefficient of a second region, a largest summed high frequency coefficient;
using a ratio of the largest summed high frequency coefficient to the summed high frequency coefficient of the first region, determining a horizontal displacement distance for the first region;
generating a second image, the second image also comprising the plurality of regions, wherein a first region of the second image corresponds to the first region of the first image, and wherein the first region of the second image comprises a second frame, the second frame being a copy of the first frame displaced by the determined horizontal shift; and
creating a stereoscopic image by combining the first frame and the second frame.
2. The method according to claim 1 , wherein the frames of each region of the first image are original frames the plurality of regions of the first image.
3. The method according to claim 1 , further comprising:
performing a Fast Fourier Transform on a first portion of the first region;
performing a Fast Fourier Transform on a second portion of the first region; and
ascertaining a tilt of the first region from the first portion to the second portion.
4. The method according to claim 3 , wherein the tilt of the first region is a depth relative to a plane parallel to the height and width of the first image.
5. The method according to claim 3 , further comprising:
adjusting a perceived tilt of the first region based on the ascertained tilt.
6. The method according to claim 1 , further comprising:
receiving a user input to adjust a depth of an adjustment region; and
adjusting a depth ranking of the adjustment region based on the user input.
7. The method according to claim 1 , wherein the horizontal displacement distance for the first region is a function of a depth of the first region determined from the Fast Fourier Transform process.
8. An apparatus comprising:
an input for receiving images;
a controller; and
a non-transitory storage medium storing instructions that, when executed by the controller, cause the apparatus to:
receive a first image;
segment the first image into a plurality of regions, each region of the first image comprising a frame;
perform, on a first region of the plurality of regions, the first region comprising a first frame, a Fast Fourier Transform that comprises summing high frequency coefficients of averaged Fast Fourier Transform spectra of the first region to provide a summed high frequency coefficient of the first region;
determine, from the summed high frequency coefficient of the first region and a summed high frequency coefficient of a second region, a largest summed high frequency coefficient;
use an a ratio of the largest summed high frequency coefficient to the summed high frequency coefficient of the first region to determine a horizontal displacement distance for the first region;
generate a second image, the second image also comprising the plurality of regions, wherein a first region of the second image corresponds to the first region of the first image, and wherein the first region of the second image comprises a second frame, the second frame being a copy of the first frame displaced by the determined horizontal shift; and
create a stereoscopic image by combining the first frame and the second frame.
9. The apparatus according to claim 8 , wherein the frames of each region of the first image are original frames the plurality of regions of the first image.
10. The apparatus according to claim 8 , wherein the non-transitory storage medium further stores instructions that, when executed by the processor, cause the apparatus to
perform a Fast Fourier Transform on a first portion of the first region;
perform a Fast Fourier Transform on a second portion of the first region; and
ascertain a tilt of the first region from the first portion to the second portion.
11. The apparatus according to claim 10 , wherein the tilt of the first region is a depth relative to a plane parallel to the height and width of the first image.
12. The apparatus according to claim 10 , wherein the non-transitory storage medium further stores instructions that, when executed by the processor, cause the apparatus to adjust a perceived tilt of the first region based on the ascertained tilt.
13. The apparatus according to claim 8 , wherein the non-transitory storage medium further stores instructions that, when executed by the processor, cause the apparatus to:
receive a user input to adjust a depth of an adjustment region; and
adjust a depth ranking of the adjustment region based on the user input.
14. The apparatus according to claim 8 , wherein the horizontal displacement distance for the first region is a function of a depth of the first region determined from the Fast Fourier Transform process.