IP Library Granted Patent US 10,185,391
Granted Patent B2
US 10,185,391 · App. 14/209,399 · Granted Jan 22, 2019

Facial recognition display control method and apparatus

Inventors: Wooyong Lee (Hwaseong-si, KR); Gyuhee Han (Seoul, KR); Kwangkyu Park (Suwon-si, KR); Seungjoon Jeon (Yongin-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/013G06F1/325G06F1/3212G06F1/3231G06F3/012G06F3/0304Y02D10/173Y02D10/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,185,391
App. No.
14/209,399
Granted
Jan 22, 2019
Kind
B2
Abstract

A screen display control method is provided for controlling screen display of an electronic device more efficiently. A screen display control method includes determining a resolution of a camera, recognizing a face of a user using the camera operating at the determined resolution, and controlling screen display of the electronic device based on the face.

Claims (70)

1. A screen display control method of an electronic device, the method comprising:

determining a resolution operation mode of a camera, the camera being configured to operate in a high resolution mode by activating all pixels of an image sensor of the camera and a low resolution mode by activating a predetermined number of pixels less than the all pixels of the image sensor of the camera;

performing a first facial recognition operation when it is determined that the camera is operating in the high resolution mode;

performing a second facial recognition operation when it is determined that the camera is operating in the low resolution mode; and

controlling a screen display of the electronic device based on the first facial recognition operation or the second facial recognition operation,

wherein the first facial recognition operation includes determining a gaze position of a user,

wherein the second facial recognition operation includes:

setting first configuration values of the camera,

determining whether the user is present,

when the user is present, changing the first configuration values of the camera to a second configuration value, and

determining a face position of the user with respect to the electronic device while operating the camera in the low resolution mode with the second configuration value, and

wherein the changing of the first configuration values of the camera to the second configuration value comprises changing at least one of frames per second, a shutter speed, or an exposure value.

2. The method of claim 1 , further comprising:

determining a power state of the electronic device; and

selecting the high resolution mode or the low resolution mode based on the determined power state of the electronic device.

3. The method of claim 2 , wherein the determining of the power state comprises:

determining, when the power state of the electronic device is equal to or greater than a threshold or the electronic device is connected to an external device, the power state as a high power state; and

determining, when the power state of the electronic device is less than the threshold value and the electronic device is not connected to the external device, the power state as a low power state.

4. The method of claim 3 ,

wherein the high resolution mode is selected when the electronic device is in the high power state, and

wherein the low resolution mode is selected when the electronic device is in the low power state.

5. The method of claim 1 , when the screen display is controlled based on the gaze position, the method further comprising:

acquiring coordinate information by mapping the gaze position to a display of the electronic device; and

controlling the screen display further based on the coordinate information.

6. The method of claim 5 , further comprising:

determining at least one of direction information or speed information based on a change of the coordinate information over time; and

controlling the screen display further based on the direction information or the speed information.

7. The method of claim 1 , further comprising:

acquiring sensor data using at least one sensor;

acquiring coordinate information through mapping to the display of the electronic device based on the sensor data and the face position;

determining at least one of direction information and speed information based on a change of the coordinate information; and

controlling the screen display further based on the at least one of the direction information and the speed information.

8. The method of claim 1 , wherein, in the high resolution mode, the method further comprising:

acquiring sensor data from a sensor;

assigning priorities to image information provided by the camera and the sensor data; and

controlling the screen display further using the image information sorted in a descending order of the priorities.

9. The method of claim 1 , wherein the controlling of the screen display comprises controlling at least one of scroll, playback, pause, zoom-in, zoom-out, stay, and response control operations in association with the screen display.

10. An electronic device comprising:

a camera configured to operate in a plurality of resolution operation modes, the plurality of resolution operation modes including a high resolution mode based on an activation of all pixels of an image sensor of the camera and a low resolution mode based on an activation of a predetermined number of pixels less than the all pixels of the image sensor of the camera;

a display configured to display a screen; and

at least one processor configured to:

determine the resolution operation mode of the camera,

perform a first facial recognition operation when it is determined that the camera is operating in the high resolution mode,

perform a second facial recognition operation when it is determined that the camera is operating in the low resolution mode, and

control the display based on the first facial recognition operation or the second facial recognition operation,

wherein the first facial recognition operation includes determining a gaze position of a user,

wherein the second facial recognition operation includes:

setting first configuration values of the camera,

determining whether the user is present,

when the user is present, changing the first configuration values of the camera to a second configuration value, and

determining a face position of the user with respect to the electronic device while operating the camera in the low resolution mode with the second configuration value, and

wherein the changing of the first configuration values of the camera to the second configuration value comprises changing at least one of frames per second, a shutter speed or an exposure value.

11. The electronic device of claim 10 , wherein the at least one processor is further configured to:

determine a power state of the electronic device as one of a high power state and a low power state based on whether power of the electronic device is equal to or greater than a threshold or whether the electronic device is connected to an external device, and

select the high resolution mode of the camera when the electronic device is in the high power state and the low resolution mode when the electronic device is in the low power state.

12. The electronic device of claim 10 , wherein the at least one processor is further configured to:

operate the camera in the high resolution mode to acquire coordinate information by mapping the gaze position to the display of the electronic device, and

control the screen further based on the coordinate information.

13. The electronic device of claim 10 , further comprising:

at least one sensor configured to provide sensor data,

wherein the at least one processor is further configured to:

acquire coordinate information through mapping to the display of the electronic device based on the sensor data and the face position,

determine at least one of direction information or speed information based on change of the coordinate information, and

control the screen further based on the at least one of the direction or speed information.

14. The electronic device of claim 10 , wherein, in the high resolution mode, the electronic device further comprising:

at least one sensor configured to provide sensor data,

wherein the at least one processor is further configured to:

assign priorities to image information provided by the camera and the sensor data, and

control the screen further using the image information sorted in a descending order of the priorities.

15. The electronic device of claim 10 , wherein the at least one processor is further configured to control at least one of scroll, playback, pause, zoom-in, zoom-out, stay, and response control operations in association with the screen.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2014
From: LEE, WOOYONG; HAN, GYUHEE; PARK, KWANGKYU; JEON, SEUNGJOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 032432/0770 →
Priority Claims (2)
KR 10-2013-0027592 · Mar 14, 2013 · national
KR 10-2014-0025929 · Mar 5, 2014 · national
Continuity (1)
Related Publication 20140267021A1 · Sep 18, 2014