Electronic apparatus and method for processing three-dimensional information using image
According to various embodiments, an electronic apparatus may comprise: a camera module for acquiring an image of an object; a display module; and a three-dimensional space determination module for acquiring three-dimensional model information on at least a part of a space of an object included in an image photographed through the camera module, acquiring altitude information on the at least a part of the space on the basis of the three-dimensional model information, determining at least one feature region located in the at least a part of the space on the basis of a change of the altitude information, and displaying a visual effect for a movement of the object through the display module, on the basis of the three-dimensional model information and the feature region. Other embodiments are available.
1. A method of processing three-dimensional (3-D) information in an electronic device comprising:
obtaining 3-D model information about at least part of a space of a subject included in an image taken by a camera functionally connected to the electronic device;
obtaining altitude information about the at least part of a space based on the 3-D model information;
identifying at least one characteristic area located at the at least part of a space based on variation of the altitude information; and
displaying a visual effect related to movement of an object on a display functionally connected to the electronic device, based on the 3-D model information and the characteristic area,
wherein obtaining altitude information comprises obtaining an altitude map including information about a height on a plane of a 3-D model based on the 3-D model transformed based on a depth map including information about a depth from the camera to a surface of the subject.
2. The method of claim 1 , wherein identifying at least one characteristic area comprises one of the following:
identifying the characteristic area as an obstacle when altitude is rapidly increased compared with adjacent space;
identifying the characteristic area as an uphill when the altitude is gradually increased compared with the adjacent space;
identifying the characteristic area as a pit when the altitude is rapidly decreased compared with the adjacent space; and
identifying the characteristic area as a downhill when the altitude is gradually decreased compared with the adjacent space.
3. The method of claim 1 , wherein obtaining 3-D model information comprises:
creating the depth map including information about the depth from the camera to the surface of the subject, by using the image; and
transforming the at least part of a space to a 3-D model of a set of voxels, by using the depth information.
4. The method of claim 3 , wherein transforming the at least part of a space to a 3-D model comprises:
setting voxel size;
dividing the at least part of a space into voxels based on the set voxel size; and
performing discretization by mapping the depth map to the respective voxels of the at least part of a space.
5. The method of claim 4 , wherein setting the voxel size comprises:
monitoring a process speed of obtaining of the 3-D model information and/or a process speed of obtaining of the altitude information; and
controlling the voxel size based on the process speed.
6. The method of claim 5 , wherein controlling the voxel size comprises:
adjusting a length of the voxel, parallel to an altitude axis (z-axis).
7. The method of claim 6 , wherein controlling the voxel size comprises at least one of the following:
setting, when the process speed is less than a threshold, the voxel in such a way that one edge parallel to the altitude axis (z-axis) is greater than other edges parallel to two other axes (x- and y-axes); and
setting, when the process speed is more than the threshold, the voxel in such a way that the one edge parallel to the altitude axis (z-axis) is shorter than the other edges parallel to the other two axes (x- and y-axes).
8. The method of claim 1 , wherein the transformation to an altitude map comprises:
determining a domain plane; and
for at least part of pixel planes in the domain plane, configuring at least one of the following: continuity and position occupied by a 3-D model of the subject in a pixel plane, along an altitude axis.
9. The method of claim 8 , wherein obtaining altitude information comprises:
identifying validity of the altitude information by using continuity information of the altitude map; and
removing at least part of the altitude information, based on the validity.
10. An electronic device comprising:
a camera;
a display; and
a processor configured to:
obtain three-dimension (3-D) model information about at least part of a space of the subject included in an image taken by the camera;
obtain altitude information about the at least part of a space based on the 3-D model information;
identify at least one characteristic area located at the at least part of a space based on variation of the altitude information; and
display a visual effect related to movement of an object on the display, based on the 3-D model information and the characteristic area,
wherein the processor is configured to obtain an altitude map including information about a height on a plane of a 3-D model based on the 3-D model transformed based on a depth map including information about a depth from the camera to a surface of the subject.
11. The electronic device of claim 10 , wherein the processor is configured to perform one of the following:
identify the characteristic area as an obstacle when altitude is rapidly increased compared with adjacent space;
identify the characteristic area as an uphill when the altitude is gradually increased compared with the adjacent space;
identify the characteristic area as a pit when the altitude is rapidly decreased compared with the adjacent space; and
identify the characteristic area as a downhill when the altitude is gradually decreased compared with the adjacent space.
12. The electronic device of claim 10 , wherein the processor is configured to:
create the depth map including information about the depth from the camera to the surface of the subject, by using the image; and
transform the at least part of a space to a 3-D model of a set of voxels, by using the depth information.
13. The electronic device of claim 12 , wherein the processor is configured to:
set voxel size;
divide the at least part of a space into voxels based on the set voxel size; and
perform discretization by mapping the depth map to the respective voxels of the at least part of a space.
14. The electronic device of claim 13 , wherein the processor is configured to:
monitor a process speed of obtaining of the 3-D model information and/or a process speed of obtaining of the altitude information; and
control the voxel size based on the process speed.
15. The electronic device of claim 14 , wherein the processor is configured to adjust a length of the voxel, parallel to an altitude axis to control the voxel size.
16. The electronic device of claim 15 , wherein the processor is configured to:
set, when the process speed is less than a threshold, the voxel in such a way that one edge parallel to the altitude axis (z-axis) is greater than other edges parallel to two other axes (x- and y-axes); or
set, when the process speed is more than the threshold, the voxel in such a way that the one edge parallel to the altitude axis (z-axis) is shorter than the other edges parallel to the other two axes (x- and y-axes).
17. The electronic device of claim 10 , wherein the processor is configured to
determine a domain plane; and
configure, for at least part of pixel planes in the domain plane, at least one of the following: continuity and position occupied by a 3-D model of the subject in a pixel plane, along an altitude axis.
18. The electronic device of claim 10 , wherein the processor is configured to:
identify validity of the altitude information by using continuity information of the altitude map; and
remove at least part of the altitude information, based on the validity.
19. A non-transitory, computer-readable recording medium storing instruction for executing a method of processing three-dimensional (3-D) information in an electronic device that, when executed by a processor of the electronic device, causes the processor of the electronic device to:
obtain 3-D model information about at least part of a space of a subject included in an image taken by a camera functionally connected to the electronic device;
obtain altitude information about the at least part of a space based on the 3-D model information;
identify at least one characteristic area located at the at least part of a space based on variation of the altitude information; and
display a visual effect related to movement of an object on a display functionally connected to the electronic device, based on the 3-D model information and the characteristic area,
wherein the program, when executed, further causes the processor of the electronic device to obtain an altitude map including information about a height on a plane of a 3-D model based on the 3-D model transformed based on a depth map including information about a depth from the camera to a surface of the subject.