Augmented reality device and method of controlling the same

1. An augmented reality device comprising:

a light source;

a camera;

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions to:

turn on the light source and obtain a first image from the camera,

turn off the light source and obtain a second image from the camera,

estimate depth information based on the first image, and

estimate posture information based on the second image.

2. The augmented reality device of claim 1 , wherein the processor is further configured to execute the one or more instructions to selectively operate the camera as an active sensor or a passive sensor as the light source flickers.

3. The augmented reality device of claim 1 , wherein the processor is further configured to execute the one or more instructions to alternately obtain the first image and the second image as the light source flickers.

4. The augmented reality device of claim 1 , wherein the processor is further configured to execute the one or more instructions to process, in a time-division manner, a first process of obtaining the first image in a turned-on period of the light source and a second process of obtaining the second image in a turned-off period of the light source.

5. The augmented reality device of claim 4 , wherein the processor is further configured to execute the one or more instructions to obtain the first image and the second image by:

setting a first length of the turned-on period to be equal to a second length of the turned- off period, and

setting a first exposure time of the camera in the turned-on period to be equal to a second exposure time of the camera in the turned-off period.

6. The augmented reality device of claim 4 , wherein the processor is further configured to execute the one or more instructions to obtain the first image and the second image by:

setting a first length of the turned-on period to be equal to a second length of the turned- off period, and

setting a first exposure time of the camera in the turned-on period to be different from a second exposure time of the camera in the turned-off period.

7. The augmented reality device of claim 4 , wherein the processor is further configured to execute the one or more instructions to obtain the first image and the second image by:

setting a first length of the turned-on period to be different from a second length of the turned-off period, and

setting a first frame rate of the first image to be different from a second frame rate of the second image.

8. The augmented reality device of claim 4 , wherein the processor is further configured to execute the one or more instructions to obtain the first image and the second image by:

setting a first length of the turned-on period to be different from a second length of the turned-off period, and

setting a first frame rate of the first image to be equal to a second frame rate of the second image.

9. The augmented reality device of claim 8 , wherein the processor is further configured to execute the one or more instructions to:

set an idle mode before and after a shooting mode in the turned-off period, and

obtain the second image in the shooting mode.

10. The augmented reality device of claim 1 , wherein the camera is a mono camera, and the processor is further configured to execute the one or more instructions to:

estimate the depth information with respect to the first image by using a time-of-flight (ToF) method, and

estimate the posture information by applying mono-simultaneous localization and mapping (SLAM) to the second image.

11. The augmented reality device of claim 1 , wherein the camera comprises a first stereo camera and a second stereo camera, and

the processor is further configured to execute the one or more instructions to:

estimate the depth information with respect to at least one of a plurality of first images by using a time-of-flight (ToF) method, and

estimate the posture information by applying stereo-simultaneous localization and mapping (SLAM) to a plurality of second images,

wherein the plurality of first images and the plurality of second images are captured by the camera.

12. The augmented reality device of claim 1 , wherein the light source is configured to project light with a certain pattern towards a subject, and the camera comprises a first stereo camera and a second stereo camera, and

the processor is further configured to execute the one or more instructions to:

estimate the depth information with respect to a plurality of first images by using a stereo vision method, and

estimate the posture information by applying stereo-simultaneous localization and mapping (SLAM) to a plurality of second images,

wherein the plurality of first images and the plurality of second images are captured by the camera.

13. The augmented reality device of claim 1 , wherein the first image comprises an optical pattern projected towards a subject from the light source and the second image comprises no optical pattern.

14. A control method of an augmented reality device, the control method comprising:

obtaining a first image from a camera by turning on a light source;

obtaining a second image from the camera by turning off the light source;

estimating depth information based on the first image; and

estimating posture information based on the second image.

15. A non-transitory computer-readable recording medium storing a program executable by a computer, the non-transitory computer-readable recording medium comprising:

instructions to obtain a first image from a camera by turning on a light source;

instructions to obtain a second image from the camera by turning off the light source;

instructions to estimate depth information, based on the first image; and

instructions to estimate posture information, based on the second image.

16. The augmented reality device of claim 1 , wherein the first image is captured during a first time period when the light source is turned on, and

wherein the second image is captured during a second time period when the light source is turned off.

17. The augmented reality device of claim 1 , wherein the first image is captured by the camera during a first time period when an optical pattern is projected in a field of view of the camera, and

wherein the second image is captured during a second time period when the optical pattern is not projected in the field of view of the camera.

18. The augmented reality device of claim 1 , wherein the first image comprises an a target object and an optical pattern overlapping the target object, and

wherein the second image comprises the target object and does not include the optical pattern overlapping the target object.