Electronic device and method of identifying false image of object attributable to reflection in indoor environment thereof

1. An operating method of an electronic device, comprising:

obtaining a color image and a depth image;

detecting an interested area indicative of at least one object in the color image;

detecting at least one reference surface in the depth image; and

comparing an interested depth of the interested area, detected based on the depth image, with a reference depth of the reference surface and processing the interested area,

wherein the processing of the interested area comprises at least any one of:

determining that the interested area comprises an actual object if the interested depth is less than the reference depth, or

determining that the interested area comprises a false image in which the object is reflected if the interested depth is the reference depth or more, and

wherein the determining of the false image comprises:

determining that the interested area comprises a false image in which the object is reflected by a mirror if the interested depth exceeds the reference depth, and

determining that the interested area comprises a false image in which the object is displayed on the reference surface if the interested depth is identical with the reference depth.

2. The operating method of claim 1 , wherein the processing of the interested area further comprises neglecting the interested area if the interested area is determined to comprise the false image.

3. The operating method of claim 1 , wherein the reference surface comprises at least any one of a wall surface, bottom surface or ceiling of an indoor environment.

4. The operating method of claim 3 , wherein the detecting of the reference surface comprises:

generating a point cloud by projecting the depth image onto a three-dimensional (3D) space;

detecting at least one plane by clustering points of the point cloud; and

detecting the reference surface in the plane.

5. The operating method of claim 3 , the detecting of the reference surface comprises:

calculating a pixel probability for each pixel from the depth image;

generating a mask based on the pixel probability;

detecting at least one plane in depth pixels detected by multiplying the depth image by the mask; and

detecting the reference surface in the plane.

6. The operating method of claim 1 , further comprising:

identifying the interested depth of the interested area by mapping the interested area to the depth image; and

identifying the reference depth of the reference surface in the depth image.

7. The operating method of claim 6 ,

wherein the identifying of the interested depth comprises calculating an intermediate value of depth values of pixels, corresponding to the interested area, as the interested depth, and wherein the identifying of the reference depth comprises calculating an intermediate value of depth values of pixels, corresponding to the reference surface, as the reference depth.

8. An electronic device comprising:

a camera module; and

a processor connected to the camera module and configured to obtain a color image and a depth image through the camera module,

wherein the processor is configured to:

obtain a color image and a depth image;

detect an interested area indicative of at least one object in the color image;

detect at least one reference surface in the depth image; and

compare an interested depth of the interested area, detected based on the depth image, with a reference depth of the reference surface and process the interested area,

wherein the processor is configured to:

determine that the interested area comprises an actual object if the interested depth is less than the reference depth,

determine that the interested area comprises a false image in which the object is reflected if the interested depth is the reference depth or more, and

neglect the interested area if it is determined that the interested area includes the false image; and

wherein the processor is configured to:

determine that the interested area comprises a false image in which the object is reflected by a mirror if the interested depth exceeds the reference depth, and

determine that the interested area comprises a false image in which the object is displayed on the reference surface if the interested depth is identical with the reference depth.

9. The electronic device of claim 8 , wherein the reference surface comprises at least any one of a wall surface, bottom surface or ceiling of an indoor environment.

10. The electronic device of claim 9 , wherein the processor is configured to:

generate a point cloud by projecting the depth image onto a three-dimensional (3D) space;

detect at least one plane by clustering points of the point cloud; and

detect the reference surface in the plane.

11. The electronic device of claim 9 , wherein the process is configured to:

calculate a pixel probability for each pixel from the depth image,

generate a mask based on the pixel probability,

detect at least one plane in depth pixels detected by multiplying the depth image by the mask, and

detect the reference surface in the plane.

12. The electronic device of claim 8 , wherein the processor is configured to:

identify the interested depth of the interested area by mapping the interested area to the depth image; and

identify the reference depth of the reference surface in the depth image.

13. The electronic device of claim 12 , wherein the processor is configured to:

calculate an intermediate value of depth values of pixels, corresponding to the interested area, as the interested depth, and

calculate an intermediate value of depth values of pixels, corresponding to the reference surface, as the reference depth.

14. The electronic device of claim 8 , wherein the camera module comprises:

a first camera module configured to capture the color image; and

a second camera module configured to capture the depth image.

15. The electronic device of claim 8 , wherein:

the camera module comprises a plurality of color pixels and a plurality of infrared pixels,

the color image is generated through the color pixels, and

the depth image is generated through the infrared pixels.

16. A non-transitory computer-readable storage medium for storing one or more programs for:

obtaining a color image and a depth image;

detecting an interested area indicative of at least one object in the color image;

detecting at least one reference surface in the depth image; and

comparing an interested depth of the interested area, detected based on the depth image, with a reference depth of the reference surface and processing the interested area,

wherein the processing of the interested area comprises at least any one of:

determining that the interested area comprises an actual object if the interested depth is less than the reference depth, or,

determining that the interested area comprises a false image in which the object is reflected if the interested depth is the reference depth or more, and

wherein the determining of the false image comprises:

determining that the interested area comprises a false image in which the object is reflected by a mirror if the interested depth exceeds the reference depth, and

determining that the interested area comprises a false image in which the object is displayed on the reference surface if the interested depth is identical with the reference depth.