Electronic device and control method thereof
An electronic device includes a light source, a lens group, a display screen, and a camera module. The light source emits a first light ray to an eyeball of a user, the first light ray is reflected by the eyeball and enters the camera module through the lens group, and a second light ray emitted by the display screen is partly reflected or transmitted into the camera module through the lens group. A control method includes controlling the display screen to display based on a display periodicity which includes display time periods and black insertion time periods that are alternately arranged; and controlling the camera module to perform exposure in the black insertion time period to obtain the first light ray, and to stop exposure in the display time period; and forming an eyeball image based on the first light ray.
1 . A control method for an electronic device, and comprising:
controlling a display screen of the electronic device to display based on a display periodicity, wherein the display periodicity comprises display time periods and black insertion time periods that are alternately arranged;
controlling a camera of the electronic device to perform exposure in one or more of the black insertion time periods to obtain a first light ray, wherein the camera is a near-infrared light and visible light dual-pass camera;
controlling the camera to stop exposure in one or more of the display time periods, wherein a light source of the electronic device comprises a visible light source and a near-infrared light source;
forming an eyeball image based on the first light ray;
controlling, in response to a user recognition instruction, the visible light source to emit the first light ray, wherein the camera performs exposure to obtain a first eyeball image, and wherein the first eyeball image is for sclera recognition; and
controlling, in response to an eye movement tracking instruction, the near-infrared light source to emit the first light ray, wherein the camera performs exposure to obtain a second eyeball image, and wherein the second eyeball image is for eye movement tracking.
2 . The control method of claim 1 , wherein before controlling the camera to perform exposure, the control method further comprises lighting the light source of the electronic device.
3 . The control method of claim 2 , wherein lighting the light source comprises lighting the light source in a lighting time period, wherein the lighting time period covers the one or more of the display time periods and the one or more of the black insertion time periods.
4 . The control method of claim 2 , wherein lighting the light source comprises lighting the light source in a lighting time period, wherein the lighting time period covers the one or more of the black insertion time periods.
5 . The control method of claim 1 , wherein the control method further comprises:
comparing the first eyeball image with a pre-stored image; and
invoking, when the first eyeball image matches the pre-stored image, pre-stored eye movement calibration data, wherein the pre-stored eye movement calibration data corresponds to the pre-stored image.
6 . The control method of claim 5 , wherein the control method further comprises calibrating, when the first eyeball image does not match the pre-stored image, eye movement of a user to obtain eye movement calibration data.
7 . The control method of claim 6 , wherein the control method further comprises storing the eye movement calibration data in an eye movement calibration database.
8 . The control method of claim 1 , wherein when the electronic device displays a startup interface, the control method further comprises:
comparing the first eyeball image with a pre-stored image; and
unlocking, when the first eyeball image matches the pre-stored image, the electronic device to enter a home interface.
9 . The control method of claim 1 , wherein the display time periods are time periods when the display screen is in a turned-on state, and wherein the black insertion time periods are time periods when the display screen is in a turned-off state.
10 . The control method of claim 1 , wherein forming the eyeball image comprises forming the eyeball image based on accumulative exposure by the camera across the one or more of the black insertion time periods in each of a plurality of frames.
11 . An electronic device comprising:
a lens group comprising a light-emitting side and a second side opposite the light-emitting side;
a camera comprising a light-incident side facing the lens group, wherein the camera is a near-infrared light and visible light dual-pass camera;
a display screen disposed on the light-emitting side of the lens group and configured to emit a second light ray, wherein a display periodicity of the display screen comprises display time periods and black insertion time periods that are alternately arranged;
a light source disposed on the second side of the lens group and comprising:
a visible light source; and
a near-infrared light source, wherein the light source is configured to emit a first light ray to an eyeball of a user to cause the first light ray to be reflected by the eyeball and enter the camera through the lens group and to cause the second light ray to be partly reflected or transmitted into the camera through the lens group; and
a controller electrically connected to the light source, the camera, and the display screen, wherein the controller is configured to:
control the camera to perform exposure in one or more of the black insertion time periods to obtain the first light ray;
stop exposure in one or more of the display time periods;
form an eyeball image based on the first light ray;
control, in response to a user recognition instruction, the visible light source to emit the first light ray, wherein the camera performs exposure to obtain a first eyeball image, and wherein the first eyeball image is for sclera recognition; and
control, in response to an eye movement tracking instruction, the near-infrared light source to emit the first light ray, wherein the camera performs exposure to obtain a second eyeball image, and wherein the second eyeball image is for eye movement tracking.
12 . The electronic device of claim 11 , wherein the lens group comprises:
a lens comprising a lens light-emitting side; and
a partial-reflection partial-transmission film disposed on the lens light-emitting side.
13 . The electronic device of claim 12 , wherein a transmittance of the partial-reflection partial-transmission film in a first band is greater than 95%, wherein a reflectivity is less than 1%, and wherein the first band is a frequency band in which near-infrared light is located.
14 . The electronic device of claim 12 , wherein the lens further comprises a lens light-incident side, wherein the lens group further comprises:
a first wave plate disposed on the lens light-incident side; and
a reflective polarizer disposed on the first wave plate,
wherein the camera further comprises:
a second wave plate; and
a first linear polarizer located between the second wave plate and a camera lens of the camera, wherein a polarization direction of the reflective polarizer is the same as a polarization direction of the first linear polarizer, and wherein both the first wave plate and the second wave plate are quarter wave-plates.
15 . The electronic device of claim 12 , wherein the lens further comprises a lens light-incident side, wherein the lens group further comprises:
a first wave plate disposed on the lens light-incident side; and
a reflective polarizer disposed on the first wave plate,
wherein the camera further comprises a first circular polarizer, wherein rotation directions of the first circular polarizer and the first wave plate are the same, and wherein polarization directions of the first circular polarizer and the reflective polarizer are the same.
16 . The electronic device of claim 12 , wherein the lens further comprises a lens light-incident side, wherein the lens group further comprises:
a first wave plate disposed on the lens light-incident side; and
a reflective polarizer disposed on the first wave plate,
wherein the camera further comprises:
a second wave plate; and
a first linear polarizer located between the second wave plate and a camera lens of the camera, wherein a polarization direction of the reflective polarizer is perpendicular to a polarization direction of the first linear polarizer, and wherein both the first wave plate and the second wave plate are quarter wave-plates.
17 . The electronic device of claim 12 , wherein the lens further comprises a lens light-incident side, wherein the lens group further comprises:
a first wave plate disposed on the lens light-incident side; and
a reflective polarizer disposed on the first wave plate,
wherein the camera further comprises a first circular polarizer, wherein rotation directions of the first circular polarizer and the first wave plate are the same, and wherein polarization directions of the first circular polarizer and the reflective polarizer are perpendicular to each other.
18 . The electronic device of claim 11 , wherein the display screen comprises a screen light-emitting side, wherein the electronic device further comprises:
a second linear polarizer disposed on the screen light-emitting side; and
a third wave plate disposed between the second linear polarizer and the lens group.
19 . The electronic device of claim 11 , wherein the display time periods are time periods when the display screen is in a turned-on state, and wherein the black insertion time periods are time periods when the display screen is in a turned-off state.
20 . An electronic device comprising:
a light source comprising:
a visible light source; and
a near-infrared light source; and
a controller configured to cause the electronic device to:
control a display screen of the electronic device to display based on a display periodicity, wherein the display periodicity comprises display time periods and black insertion time periods that are alternately arranged;
control a camera of the electronic device to perform exposure in one or more of the black insertion time periods to obtain a first light ray, wherein the camera is a near-infrared light and visible light dual-pass camera;
control the camera to stop exposure in one or more of the display time periods;
form an eyeball image based on the first light ray;
control, in response to a user recognition instruction, the visible light source to emit the first light ray, wherein the camera performs exposure to obtain a first eyeball image, and wherein the first eyeball image is for sclera recognition; and
control, in response to an eye movement tracking instruction, the near-infrared light source to emit the first light ray, wherein the camera performs exposure to obtain a second eyeball image, and wherein the second eyeball image is for eye movement tracking.