Electronic device including camera and method for operating the same
An electronic device is provided. The electronic device includes a display, a first module for an operation of a camera and an operation of an optical sensor disposed under the display, and at least one processor. The first module may include an image sensor, an infrared filter, and the optical sensor disposed close to the image sensor and inside an area of the infrared filter. The at least one processor may be configured to separate a time to output one frame into a first time period for the operation of the camera and a second time period for the operation of the optical sensor, perform the operation of the camera in the first time period using the first module, and perform the operation of the optical sensor in the second time period using the first module.
1. An electronic device comprising:
a display;
a first module for an operation of a camera and an operation of an optical sensor disposed under the display;
memory storing instructions; and
at least one processor,
wherein the first module includes:
an image sensor,
an infrared filter, and
the optical sensor disposed close to the image sensor and inside an area of the infrared filter, the optical sensor including an infrared light emitting unit disposed close to the image sensor and inside an area of the infrared filter, and
wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to:
separate a time to output one frame into a first time period for the operation of the camera and a second time period for the operation of the optical sensor,
perform the operation of the camera in the first time period using the first module, and
perform the operation of the optical sensor in the second time period using the first module.
2. The electronic device of claim 1 , wherein the infrared filter is configured to include a wavelength band capable of receiving an infrared optical signal in the optical sensor.
3. The electronic device of claim 1 ,
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
receive an optical signal through a light receiving unit of the optical sensor during a time of receiving image data through the image sensor, and
compensate for the image data received from the image sensor based on the received optical signal, in the first time period.
4. The electronic device of claim 3 ,
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
determine the time of receiving the image data through the image sensor in the first time period, according to a shutter speed time.
5. The electronic device of claim 1 ,
wherein in a case where the first module is disposed under a predetermined area set to have a transmittance capable of the operation of the camera and the operation of the optical sensor in the display, and
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
if a plurality of duty cycles are operated in the display during the time to output the one frame, use at least one remaining duty cycle, except for a last duty cycle among the plurality of duty cycles, as the first time period, and
use the last duty cycle as the second time period.
6. The electronic device of claim 5 ,
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
if identifying a request for the operation of the camera when a sync signal is received, perform the operation of the camera of receiving image data through the image sensor in at least one display off time of the at least one remaining duty cycle used as the first time period, and
if identifying a request for the operation of the optical sensor when the sync signal is received, perform the operation of the optical sensor in a display off time of the last duty cycle used as the second time period.
7. The electronic device of claim 1 ,
wherein, in a case where the first module is disposed under a predetermined area set to have a transmittance capable of the operation of the camera and the operation of the optical sensor in the display, and
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
if one duty cycle is operated in the display during the time to output the one frame, separate a display off time of the one duty cycle into the first time period and the second time period.
8. The electronic device of claim 7 ,
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
use a time from a time when the display off starts to a time, a predetermined time before a time of reception of a next frame, as the first time period, and
use the predetermined time as the second time period, in the display off time of the one duty cycle.
9. The electronic device of claim 1 ,
wherein in a case where the first module is disposed under a predetermined area formed as a hole in the display, and
wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to:
if at least one duty cycle is operated in the display during the time to output the one frame, use a time from a time when a display on of a first duty cycle starts to a time, a predetermined time before a time of reception of a next frame, as the first time period, and
use the predetermined time as the second time period.
10. The electronic device of claim 9 , wherein the predetermined time is configured to be included in a display off time of a last duty cycle among the at least one duty cycle.
11. A method for performing an operation of a camera and an operation of an optical sensor using one module in an electronic device, the method comprising:
dividing a time to output one frame into a first time period for the operation of the camera and a second time period for the operation of the optical sensor;
performing the operation of the camera in the first time period using a first module of the electronic device; and
performing the operation of the optical sensor in the second time period using the first module,
wherein the first module includes:
an image sensor,
an infrared filter, and
the optical sensor disposed close to the image sensor and inside an area of the infrared filter, the optical sensor including an infrared light emitting unit disposed close to the image sensor and inside an area of the infrared filter.
12. The method of claim 11 , wherein the infrared filter includes a wavelength band capable of receiving an infrared optical signal in the optical sensor.
13. The method of claim 11 , wherein the performing of the operation of the camera includes:
receiving an optical signal through a light receiving unit of the optical sensor during a time of receiving image data through the image sensor; and
compensating for the image data received from the image sensor based on the received optical signal, in the first time period.
14. The method of claim 13 , wherein the time of receiving the image data through the image sensor in the first time period is determined according to a shutter speed time.
15. The method of claim 11 , further comprising:
in a case where the first module is disposed under a predetermined area set to have a transmittance capable of the operation of the camera and the operation of the optical sensor in a display, if a plurality of duty cycles are operated in the display during the time to output the one frame, using at least one remaining duty cycle, except for a last duty cycle among the plurality of duty cycles, as the first time period; and
using the last duty cycle as the second time period.
16. The method of claim 15 , further comprising:
if identifying a request for the operation of the camera when a sync signal is received, performing the operation of the camera of receiving image data through the image sensor in at least one display off time of the at least one remaining duty cycle used as the first time period; and
if identifying a request for the operation of the optical sensor when the sync signal is received, performing the operation of the optical sensor in a display off time of the last duty cycle used as the second time period.
17. The method of claim 11 , further comprising:
in a case where the first module is disposed under a predetermined area set to have a transmittance capable of the operation of the camera and the operation of the optical sensor in a display, if one duty cycle is operated in the display during the time to output the one frame, separating a display off time of the one duty cycle into the first time period and the second time period.
18. The method of claim 17 , further comprising:
using a time from a time when the display off starts to a time, a predetermined time before a time of reception of a next frame, as the first time period; and
using the predetermined time as the second time period, in the display off time of the one duty cycle.
19. The method of claim 11 , further comprising:
in a case where the first module is disposed under a predetermined area formed as a hole in a display, if at least one duty cycle is operated in the display during the time to output the one frame, using a time from a time when a display on of a first duty cycle starts to a time, a predetermined time before a time of reception of a next frame, as the first time period; and
using the predetermined time as the second time period.
20. The method of claim 19 , wherein the predetermined time is included in a display off time of a last duty cycle among the at least one duty cycle.