Electronic device synchronizing lens driving information and images
An electronic device includes a lens, an image sensor configured to generate image data from incident light that is incident through the lens, an actuator configured to drive the lens, at least one processor configured to output a first signal including lens driving information for controlling the actuator to drive the lens, a first interface configured to present, by the at least one processor, the first signal to the actuator, and a second interface configured to present, by the at least one processor, the first signal to the image sensor.
1. An electronic device comprising:
a lens;
an image sensor configured to generate image data from incident light that is incident through the lens;
an actuator configured to drive the lens;
at least one processor configured to acquire lens driving information from the image sensor and output a first signal including the lens driving information for controlling the actuator to drive the lens;
a first interface configured to present, by the at least one processor, the first signal to the actuator; and
a second interface configured to present, by the at least one processor, the first signal to the image sensor.
2. The electronic device of claim 1 , wherein the actuator comprises an auto focus (AF) module and an optical image stabilization (OIS) module.
3. The electronic device of claim 2 , wherein the lens comprises a liquid lens, and
wherein the at least one processor is further configured to:
perform an AF function by controlling the AF module to deform a shape of the liquid lens, and
perform an OIS function by controlling the OIS module to deform the shape of the liquid lens.
4. The electronic device of claim 2 , further comprising a motion sensor configured to detect a movement of the electronic device,
wherein the at least one processor is further configured to:
acquire, from the motion sensor, motion data corresponding to the movement of the electronic device, and
perform, based on the motion data, an OIS function by controlling the OIS module to move a position of the lens.
5. The electronic device of claim 1 , wherein the first interface and the second interface comprise a common section.
6. The electronic device of claim 1 , wherein the first interface and the second interface are at least one of an inter-integrated circuit (I2C), an improved inter-integrated circuit (I3C), or a serial peripheral interface (SPI).
7. The electronic device of claim 1 , wherein the image sensor is further configured to:
generate the image data from the incident light;
acquire the first signal from the at least one processor through the second interface; and
generate an image frame comprising the image data and the lens driving information.
8. The electronic device of claim 7 , further comprising a third interface configured to present, by the image sensor, the image frame to the at least one processor.
9. The electronic device of claim 8 , wherein the third interface comprises a mobile industry processor interface (MIPI).
10. The electronic device of claim 7 , wherein the lens driving information comprises first lens driving information acquired by the image sensor from the at least one processor before exposure of the image sensor, and second lens driving information acquired from the at least one processor before reading-out of the image data after exposure of the image sensor, and
wherein the lens driving information is included in an embedded header or embedded footer of the image frame.
11. The electronic device of claim 7 , wherein the image frame comprises the image data corresponding to a plurality of lines, and
wherein the lens driving information is included in a packet header or packet footer of each of the plurality of lines.
12. The electronic device of claim 2 , wherein the at least one processor comprises an application processor (AP) and an OIS control circuit,
wherein the AP is configured to control the AF module to perform an AF function, and
wherein the OIS control circuit is configured to control the OIS module to perform an OIS function.
13. The electronic device of claim 12 , wherein the AP is further configured to:
generate a second signal for controlling the image sensor; and
present the second signal to the image sensor through a fourth interface.
14. An electronic device comprising:
a lens;
an image sensor configured to generate image data from incident light that is incident through the lens;
an actuator configured to drive the lens;
at least one processor configured to output a first signal including lens driving information for controlling the actuator to drive the lens;
a first interface configured to present, by the at least one processor, the first signal to the actuator; and
a second interface configured to acquire, by the image sensor and from the actuator, lens position information corresponding to a position of the lens,
wherein the at least one processor is further configured to acquire, from the image sensor, an image frame comprising the image data and the lens position information.
15. The electronic device of claim 14 , wherein the actuator comprises a Hall sensor configured to detect the position of the lens, and
wherein the image sensor is further configured to:
request, to the actuator through the second interface, the lens position information; and
in response to the request, receive, from the actuator through the second interface, the lens position information acquired by the Hall sensor.
16. An electronic device comprising:
a lens;
an image sensor configured to generate image data from incident light that is incident through the lens;
an actuator configured to drive the lens; and
at least one processor connected by an interface with the image sensor and the actuator,
wherein the at least one processor is configured to:
present, to the actuator through at least a first path of the interface, a first signal comprising lens driving information for controlling the actuator to drive the lens;
present, through at least a second path of the interface, the first signal to the image sensor; and
acquire, from the image sensor, an image frame comprising the image data and the lens driving information.
17. The electronic device of claim 16 , wherein the at least one processor is further configured to perform at least one of video digital image stabilization (VDIS), temporal noise reduction (TNR), chromatic aberration correction, or lens distortion correction, for the image data, based on the lens driving information.
18. The electronic device of claim 16 , wherein the lens driving information comprises at least one of auto focus (AF) position information for performing, by the at least one processor, an AF function through the actuator, or optical image stabilization (OIS) position information for performing, by the at least one processor, an OIS function through the actuator.
19. The electronic device of claim 16 , wherein the lens driving information comprises first lens driving information acquired by the image sensor from the at least one processor before exposure of the image sensor, and second lens driving information acquired from the at least one processor before reading-out of the image data after exposure of the image sensor, and
wherein the lens driving information is included in an embedded header or embedded footer of the image frame.
20. The electronic device of claim 16 , wherein the image frame comprises the image data corresponding to a plurality of lines, and
wherein the lens driving information is included in a packet header or packet footer region of each of the plurality of lines.