IP Library Granted Patent US 11,204,668
Granted Patent B2
US 11,204,668 · App. 15/930,545 · Granted Dec 21, 2021

Electronic device and method for acquiring biometric information using light of display

Inventors: Woojhon Choi (Gyeonggi-do, KR); Duseon Oh (Gyeonggi-do, KR); Dasom Kim (Gyeonggi-do, KR); Jinho Kim (Gyeonggi-do, KR); Jiwoon Jung (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/0421G06F3/0414G06F3/0416G06F3/0425G06K9/0004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,204,668
App. No.
15/930,545
Granted
Dec 21, 2021
Kind
B2
Abstract

An electronic device according to an embodiment may include a housing, a display exposed through at least part of a first surface of the housing, an image sensor, a processor operatively connected with the display and the image sensor, and a memory operatively connected with the processor, wherein the memory may store instructions that, when executed, cause the processor to detect a touch of a finger of a user on the image sensor, while displaying a user interface using the display, in response to detecting the touch, while the touch of the finger is maintained on the image sensor, change the user interface in an area of the display within a preset distance from the image sensor, and acquire biometric information of the user based on reflection light of light emitted from the display, where the reflection light is acquired using the image sensor.

Claims (77)

1. An electronic device comprising:

a housing;

a display exposed through at least part of a first surface of the housing, the display including an opening;

an image sensor exposed through the opening in the display and at least part of the first surface of the housing;

a processor operatively connected with the display and the image sensor; and

a memory operatively connected with the processor,

wherein the memory stores instructions that, when executed, cause the processor to:

detect a touch of a finger of a user on the image sensor, while displaying a user interface using the display,

in response to detecting the touch, while the touch of the finger is maintained on the image sensor, change the user interface in first area and a second area of the display, the first area adjacent to the opening in the display within a preset distance from the image sensor, and the second area proximate to the first area, and

acquire biometric information of the user based on reflected light of light emitted from the first area and from the second area of the display, wherein the reflected light is acquired using the image sensor,

wherein a size of the first area adjacent to the opening for emission of the light is set based in part on a size of a contact area of the detected touch, and

wherein the light is emitted from the first area and the second area according to at least one of: illumination at different times, and illumination using different colors.

2. The electronic device of claim 1 , wherein the instructions further cause the processor to:

emit light with a first intensity in the first area of the display within the preset distance from the image sensor before detecting the touch, and

in response to detecting the touch, emit light with a second intensity higher than the first intensity in the first area of the display within the preset distance from the image sensor.

3. The electronic device of claim 1 , wherein the instructions further cause the processor to:

in response to receiving, at the image sensor, light other than the reflected light, display another user interface to guide the user to retouch the display.

4. The electronic device of claim 1 , wherein the instructions further cause the processor to:

in response to detecting the touch, identify third area where the finger of the user touches on the display, and

based on the identified third area, set the first area of the display within the preset distance from the image sensor.

5. The electronic device of claim 1 , wherein the image sensor is disposed in a display area of the display, when viewed in a front view of the housing.

6. The electronic device of claim 1 , wherein the instructions further cause the processor to:

in response to detecting the touch, while the touch of the finger is maintained on the image sensor, change the user interface at designated time intervals.

7. The electronic device of claim 1 , wherein the instructions further cause the processor to:

in response to detecting the touch, emit light of a first intensity from the first area of the display within the preset distance from the image sensor, and

in response to detecting the touch, emit light of a second intensity higher than the first intensity from the second area of the display.

8. The electronic device of claim 1 , wherein the instructions further cause the processor to:

receive an input,

based on the received input, identify first biometric information to be acquired from the user, and

in response to detecting the touch, emit light corresponding to the identified first biometric information from the first area of the display within the preset distance from the image sensor.

9. An operating method of an electronic device that includes a housing, the method comprising:

displaying a user interface using a display including an opening, the display exposed through at least part of a first surface of the housing,

detecting a touch of a finger of a user on an image sensor exposed through opening in the display and at least part of the first surface of the housing;

in response to detecting the touch, while the touch of the finger is maintained on the image sensor, changing the user interface in a first area and a second area of the display, the first area adjacent to the opening in the display within a preset distance from the image sensor, and the second area proximate to the first area; and

acquiring biometric information of the user based on reflected light of light emitted from the first area and from the second area of the display, wherein the reflected light is acquired using the image sensor,

wherein a size of the first area adjacent to the opening for emission of the light is set based in part on a size of a contact area of the detected touch, and

wherein the light is emitted from the first area and the second area according to at least one of: illumination at different times, and illumination using different colors.

10. The method of claim 9 , wherein light with a first intensity is emitted in the first area of the display within the preset distance from the image sensor before detecting the touch, and

in response to detecting the touch, light with a second intensity higher than the first intensity is emitted in the first area of the display within the preset distance from the image sensor.

11. The method of claim 9 , further comprising:

in response to receiving, at the image sensor, light other than the reflected light, displaying another user interface to guide the user to retouch the display.

12. The method of claim 9 , further comprising:

in response to detecting the touch, identifying an area where the finger of the user touches on the display; and

based on the identified area, setting the first area of the display within the preset distance from the image sensor.

13. The method of claim 9 , wherein the image sensor is disposed in a display area of the display, when viewed in a front view of the housing.

14. The method of claim 9 , further comprising:

in response to detecting the touch, emitting light of a first intensity from the first area of the display within the preset distance from the image sensor; and

in response to detecting the touch, emitting light of a second intensity higher than the first intensity from the second area of the display.

15. The method of claim 9 , further comprising:

receiving an input;

based on the received input, identifying first biometric information to be acquired from the user; and

in response to detecting the touch, emitting light corresponding to the identified first biometric information from the first area of the display within the preset distance from the image sensor.

16. The method of claim 9 , further comprising:

identifying asymmetry with respect to a reference direction of an image acquired by the image sensor based on the reflected light;

in response to identifying the asymmetry with respect to the reference direction of the image, identifying a degree of the asymmetry with respect to the reference direction of the image; and

based on the identified degree of the asymmetry, changing the first area of the display within the preset distance.

17. An electronic device comprising:

a housing;

a display exposed through at least part of a first surface of the housing, the display including an opening;

an image sensor exposed through the opening in the display and disposed in a display area of the display, when viewing the first surface of the housing;

a processor operatively connected with the display and the image sensor; and

a memory operatively connected with the processor,

wherein the memory stores instructions that, when executed, cause the processor to:

display an indicator indicating a preset touch request area, on a user interface displayed on the display,

detect a touch of a finger of a user, in at least part of the touch request area after the indicator is displayed in the user interface,

in response to detecting the touch, control the display to emit light of a preset intensity in a preset second area adjacent to the opening in the display through which the image sensor is exposed when viewed in a front view of the housing, and in a preset third area proximate to the preset second area, and

acquire biometric information of the user based on reflected light of the light of the preset intensity emitted from preset second area and the preset third area of the display, wherein the reflected light is acquired using the image sensor,

wherein a size of the preset second area adjacent to the opening for emission of the light is set based in part on a size of a contact area of the detected touch, and

wherein the light is emitted from the preset second area and the preset third area according to at least one of: illumination at different times, and illumination using different colors.

18. The electronic device of claim 17 , wherein characteristics of light emitted from the preset second area are different from characteristics of light emitted from the preset third area.

19. The electronic device of claim 17 , wherein the instructions further cause the processor to:

in response to receiving, at the image sensor, light other than the reflected light, display another user interface to guide the user to retouch the display.

20. The electronic device of claim 17 , wherein the instructions further cause the processor to:

adjust a position of the indicator, based on an image acquired by the image sensor based on the reflected light,

display the indicator at the adjusted position, on the user interface displayed on the display,

after displaying the indicator at the adjusted position, detect a retouch of the finger of the user, and

in response to detecting the retouch of the finger of the user, when biometric information of the user based on the reflected light is acquired, store the adjusted position of the indicator on the user interface, in the memory.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2020
From: CHOI, WOOJHON; OH, DUSEON; KIM, DASOM; KIM, JINHO; JUNG, JIWOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 052646/0720 →
Priority Claims (1)
KR KR10-2019-0056177 · May 14, 2019 · national
Continuity (1)
Related Publication 20200363902A1 · Nov 19, 2020