Stereo image generating method and electronic apparatus utilizing the method

1. A stereo image generating method adapted to an electronic apparatus comprising a first camera and a second camera, the first camera and the second camera being capable of capturing stereo images, a resolution of the first camera being larger than a resolution of the second camera, the stereo image generating method comprising:

capturing a first image by the first camera and capturing a second image by the second camera;

upscaling the second image to the resolution of the first camera;

generating a depth map with use of the first image and the upscaled second image;

re-projecting the first image with reference to the depth map to reconstruct a reference image of the second image, comprising:

detecting a distance between two eyes of a user of the electronic apparatus;

calculating an adjusted value of a baseline distance between the first camera and the second camera according to the distance between the two eyes of the user and the baseline distance between the first camera and the second camera; and

re-projecting the first image with reference to the depth map and the adjusted value of the baseline distance to reconstruct the reference image of the second image, to enable disparity information between the first image and the reference image of the second image to comply with the distance between the two eyes of the user;

detecting an occlusion region in the reference image and compensating the occlusion region by using the upscaled second image; and

generating a stereo image including the first image and the compensated reference image.

2. The stereo image generating method according to claim 1 , wherein the step of re-projecting the first image with reference to the depth map to reconstruct the reference image of the second image further comprises:

obtaining the disparity information between the first image and the reference image of the second image with reference to depth information in the depth map and the baseline distance between the first camera and the second camera; and

re-projecting the first image in a three-dimensional space with the disparity information to reconstruct the reference image of the second image.

3. The stereo image generating method according to claim 1 , wherein the step of re-projecting the first image with reference to the depth map and the adjusted value of the baseline distance to reconstruct the reference image of the second image comprises:

adjusting a parallax between the first image and the second image according to the adjusted value of the baseline distance;

retrieving depth information in the depth map and converting a coordinate system of a coordinate of the depth information into a world coordinate system; and

re-projecting the first image with reference to the depth map according to the converted depth information and the adjusted parallax to reconstruct the reference image of the second image.

4. The stereo image generating method according to claim 1 , wherein the step of detecting the occlusion region in the reference image comprises:

matching the reference image with the upscaled second image; and

taking a region of the reference image not matched with the upscaled second image as the occlusion region.

5. The stereo image generating method according to claim 1 , wherein the step of detecting the occlusion region in the reference image comprises:

detecting a blank region in the reference image and taking the blank region as the occlusion region.

6. The stereo image generating method according to claim 1 , wherein after detecting the occlusion region in the reference image and compensating the occlusion region by using the upscaled second image, the method further comprises:

detecting main objects respectively in the first image and in the second image; and

adjusting the disparity information between the first image and the reference image of the second image to enable the main objects to be concentrated onto a display plane of the electronic apparatus.

7. An electronic device comprising:

a first camera and a second camera respectively capturing one of left-eye and right-eye images required for generating a stereo image, wherein a resolution of the first camera is greater than a resolution of the second camera;

an eye distance detecting module, detecting a distance between two eyes of a user of the electronic apparatus; and

an image processing circuit coupled to the first camera and the second camera, processing a first image and a second image respectively captured by the first camera and the second camera, the image processing circuit comprising:

a resolution upscaling module, upscaling the second image to the resolution of the first camera;

a depth generating module, generating a depth map with use of the first image and the upscaled second image;

an image reconstructing module, calculating an adjusted value of a baseline distance between the first camera and the second camera according to the distance between the two eyes of the user and the baseline distance between the first camera and the second camera and re-projecting the first image with reference to the depth map and the adjusted value of the baseline distance to reconstruct a reference image of the second image, to enable disparity information between the first image and the reference image of the second image to comply with the distance between the two eyes of the user;

an occlusion region detecting module, detecting an occlusion region in the reference image;

an occlusion region compensating module, compensating the occlusion region by using the upscaled second image; and

a stereo image generating module, generating the stereo image including the first image and the compensated reference image.

8. The electronic apparatus according to claim 7 , wherein the image reconstructing module obtains the disparity information between the first image and the reference image of the second image with reference to depth information in the depth map and the baseline distance between the first camera and the second camera and re-projects the first image in a three-dimensional space with the disparity information to reconstruct the reference image of the second image.

9. The electronic apparatus according to claim 7 , wherein the image reconstructing module further adjusts a parallax between the first image and the second image according to the adjusted value of the baseline distance, retrieves depth information in the depth map and converts a coordinate system of a coordinate of the depth information into a world coordinate system, and re-projects the first image according to the converted depth information and the adjusted parallax to reconstruct the reference image of the second image.

10. The electronic apparatus according to claim 7 , wherein the occlusion region detecting module matches the reference image with the upscaled second image and takes a region of the reference image not matched with the upscaled second image as the occlusion region.

11. The electronic apparatus according to claim 7 , wherein the occlusion region detecting module detects a blank region in the reference image and takes the blank region as the occlusion region.

12. The electronic apparatus according to claim 7 , wherein the image processing circuit further comprises:

an object detecting module, detecting main objects respectively in the first image and in the second image; and

a disparity adjusting module, adjusting the disparity information between the first image and the reference image of the second image to enable the main objects to be concentrated onto a display plane of the electronic apparatus.