IP Library › Granted Patent US 11,422,622
Granted Patent B2
US 11,422,622 · App. 17/334,130 · Granted Aug 23, 2022

Electronic device and operating method thereof

Inventors: Youngmo Jeong (Suwon-si, KR); Bonkon Koo (Suwon-si, KR); Sunghwan Shin (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/013G06T3/40G06T7/73H04L67/38G06T2200/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,422,622
App. No.
17/334,130
Granted
Aug 23, 2022
Kind
B2
Abstract

An electronic device that outputs at least one calibration point through a display, obtains gaze information corresponding to the at least one calibration point by using a gaze tracking sensor in response to an output of guide information instructing a user wearing the electronic device to gaze at the at least one calibration point, obtains a gaze accuracy corresponding to the at least one calibration point based on the obtained gaze information, determines a gaze zone-specific resolution based on the gaze accuracy corresponding to the at least one calibration point, and outputs an image through the display based on the determined gaze zone-specific resolution.

Claims (69)

1. An electronic device comprising:

a display;

a sensor configured to obtain gaze information of an eye of a user;

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions stored in the memory to:

output at least one calibration point through the display;

obtain the gaze information corresponding to the at least one calibration point by using the sensor based on an output of guide information instructing the user wearing the electronic device to gaze at the at least one calibration point;

obtain a gaze accuracy corresponding to the at least one calibration point, based on the obtained gaze information;

determine a gaze zone-specific resolution based on the gaze accuracy corresponding to the at least one calibration point; and

output an image through the display, based on the determined gaze zone-specific resolution.

2. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to:

determine at least one gaze point corresponding to the at least one calibration point, based on the obtained gaze information; and

calculate the gaze accuracy corresponding to the at least one calibration point by using a distance between the at least one calibration point and the at least one gaze point corresponding to the at least one calibration point.

3. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to:

generate a gaze accuracy map indicating a difference between gaze zone-specific gaze accuracies based on the gaze accuracy corresponding to the at least one calibration point; and

determine the gaze zone-specific resolution, based on the gaze accuracy map.

4. The electronic device of claim 3 , wherein the processor is further configured to execute the one or more instructions to:

determine a central region and a peripheral region in an entire display region of the display based on the gaze accuracy map; and

determine a resolution of the peripheral region to be lower than a resolution of the central region.

5. The electronic device of claim 1 , wherein the gaze information comprises left-eye gaze information and right-eye gaze information, and

the processor is further configured to execute the one or more instructions to:

obtain a gaze accuracy of a left eye based on the left-eye gaze information and a gaze accuracy of a right eye based on the right-eye gaze information; and

determine a gaze zone-specific resolution of the left eye based on the gaze accuracy of the left eye and determine a gaze zone-specific resolution of the right eye based on the gaze accuracy of the right eye.

6. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to:

identify a type of an application being executed by the electronic device; and

determine an adjustment level for the gaze zone-specific resolution based on the type of the application.

7. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to:

identify an action state of the user wearing the electronic device; and

determine an adjustment level for the gaze zone-specific resolution based on the action state of the user.

8. The electronic device of claim 7 , wherein the action state of the user comprises at least one of a stationary state, a walking state, a running state, or a vehicle driving state.

9. An operating method of an electronic device, the operating method comprising:

outputting at least one calibration point through a display;

obtaining gaze information corresponding to the at least one calibration point by using a sensor in response to an output of a guide information instructing a user wearing the electronic device to gaze at the at least one calibration point;

obtaining a gaze accuracy corresponding to the at least one calibration point based on the obtained gaze information;

determining a gaze zone-specific resolution based on the gaze accuracy corresponding to the at least one calibration point; and

outputting an image through the display based on the determined gaze zone-specific resolution.

10. The operating method of claim 9 , wherein the obtaining of the gaze accuracy comprises:

determining at least one gaze point corresponding to the at least one calibration point based on the obtained gaze information; and

calculating the gaze accuracy corresponding to the at least one calibration point by using a distance between the at least one calibration point and the at least one gaze point corresponding to the at least one calibration point.

11. The operating method of claim 9 , wherein the determining of the gaze zone-specific resolution comprises:

generating a gaze accuracy map indicating a difference between gaze zone-specific gaze accuracies based on the gaze accuracy corresponding to the at least one calibration point; and

determining the gaze zone-specific resolution, based on the gaze accuracy map.

12. The operating method of claim 11 , wherein the determining of the gaze zone-specific resolution comprises:

determining a central region and a peripheral region in an entire display region of the display based on the gaze accuracy map; and

determining a resolution of the peripheral region to be lower than a resolution of the central region.

13. The operating method of claim 9 , wherein

the gaze information comprises left-eye gaze information and right-eye gaze information;

the obtaining of the gaze accuracy comprises obtaining a gaze accuracy of a left eye based on the left-eye gaze information and obtaining a gaze accuracy of a right eye based on the right-eye gaze information; and

the determining of the gaze zone-specific resolution comprises determining a gaze zone-specific resolution of the left eye based on the gaze accuracy of the left eye and determining a gaze zone-specific resolution of the right eye based on the gaze accuracy of the right eye.

14. The operating method of claim 9 , wherein the determining of the gaze zone-specific resolution comprises:

identifying a type of an application being executed by the electronic device; and

determining an adjustment level for the gaze zone-specific resolution based on the type of the application.

15. The operating method of claim 9 , wherein the determining of the gaze zone-specific resolution comprises:

identifying an action state of the user wearing the electronic device; and

determining an adjustment level for the gaze zone-specific resolution based on the action state of the user.

16. The operating method of claim 15 , wherein the action state of the user comprises at least one of a stationary state, a walking state, a running state, or a vehicle driving state.

17. A non-transitory computer-readable recording medium having recorded thereon a program for executing the operating method of claim 9 on a computer.

18. An operating method of an electronic device, the operating method comprising:

displaying at least one calibration point for a user wearing the electronic device, to look at the at least one calibration point;

obtaining line of sight line information of the user wearing the electronic device, the line of sight information comprising a plurality of line of sight points collected while the user looks at the at least one calibration point;

transmitting the line of sight information to an external server;

receiving a line of sight zone-specific resolution from the external server determined using a line of sight accuracy calculated by the external server based on a difference between the at least one calibration point and the plurality of line of sight points; and

displaying an image based on the received line of sight zone-specific resolution.

19. The operating method of claim 18 , wherein,

the image comprises a central portion and a peripheral portion, the peripheral portion being a part of the image not including the central portion;

the central portion has a first line of sight accuracy, and the peripheral portion has a second line of sight accuracy that is lower than the first line of sight accuracy;

the central portion of the image is displayed at a first resolution;

the peripheral portion of the image is displayed at a second resolution; and

the first resolution is higher than the second resolution.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2021
From: JEONG, YOUNGMO; KOO, BONKON; SHIN, SUNGHWAN
To: SAMSUNG ELECTRONICS CO., LTD
Reel/Frame 056387/0615 →
Priority Claims (1)
KR 10-2020-0140700 · Oct 27, 2020 · national
Continuity (2)
Provisional Application 63031125 · May 28, 2020
Related Publication 20210373658A1 · Dec 2, 2021
Cited By (2)
US 12,444,111 US 12,693,529