IP Library › Granted Patent US 11,928,257
Granted Patent B2
US 11,928,257 · App. 17/689,423 · Granted Mar 12, 2024

Method and electronic device for tracking eye

Inventors: Dongok Choi (Suwon-si, KR); Hyoungil Song (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/013G02B27/0172G02B27/0179H04N23/56G02B2027/0132G02B2027/0138G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,928,257
App. No.
17/689,423
Granted
Mar 12, 2024
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a light source module, a display module including at least one layer, a camera module, and a processor operatively connected to the light source module, the display module, and the camera module. The processor may emit light through the light source module along a waveguide formed in the at least one layer of the display module, may use the camera module to detect, based on at least one pattern structure formed in the waveguide, at least a part of the light, which has been reflected from a user's eyeball, and may track the movement of the user's eyeball, based on the detected light.

Claims (54)

1. An electronic device comprising:

a light source module;

a display module comprising at least one layer and being divided into a first display region, in which at least one object related to an augmented reality service is displayed, and a second display region, which corresponds to a remaining region of a display region of the display module other than the first display region;

a camera module; and

a processor operatively connected to the light source module, the display module, and the camera module,

wherein the processor is configured to:

control the light source module to emit light along a waveguide formed in the at least one layer of the display module,

use the camera module to detect, based on at least one pattern structure formed in the waveguide, at least a part of the light, which has been reflected from a user's pupil, and

track movement of the user's pupil, based on the detected light, and

wherein the waveguide is at least partially formed based on the second display region of the display module.

2. The electronic device of claim 1 ,

wherein the camera module comprises at least one infrared camera, and

wherein the processor is configured to use the at least one infrared camera to detect an infrared ray emitted from the light source module.

3. The electronic device of claim 1 ,

wherein the light source module is disposed at one end of the display module, and

wherein the light source module is configured to emit an infrared ray along the waveguide formed in the display module.

4. The electronic device of claim 1 , wherein the waveguide is formed in a layer disposed closest to the user's pupil among the at least one layer included in the display module.

5. The electronic device of claim 1 ,

wherein the at least one pattern structure is configured to reflect, toward the user's pupil, light emitted from the light source module, and

wherein the at least one pattern structure is configured such that an intensity of light reflected toward the pupil from along the waveguide is substantially constant.

6. The electronic device of claim 1 ,

wherein the at least one pattern structure is formed in a progressively larger size as the pattern structure is located farther away from the light source module, and

wherein the at least one pattern structure is configured such that an amount of the reflected light increases based on the size of the pattern structure.

7. The electronic device of claim 1 , wherein the at least one pattern structure is configured such that an intensity of the reflected light is determined based on at least one among a type of the pattern structure, a size of the pattern structure, or an interval of the pattern structure.

8. The electronic device of claim 1 , wherein the waveguide comprises a waveguide tube disposed in a vicinity of a periphery of the display module.

9. The electronic device of claim 1 , wherein the at least one pattern structure comprises one of:

a first pattern comprising at least one protruding pattern structure,

a second pattern comprising at least one hole structure,

a third pattern comprising a mix of at least one protruding pattern structure and at least one hole structure, or

a fourth pattern comprising protruding pattern structures having different sizes.

10. The electronic device of claim 9 ,

wherein a size of the at least one hole structure of the second pattern is determined based on a distance between the at least one hole structure and the light source module, and

wherein the size of the at least one hole structure increases as the distance increases.

11. The electronic device of claim 9 , further comprising a protective panel laminated on a surface of the display module.

12. The electronic device of claim 1 ,

wherein the electronic device is in a form of eyeglasses or goggles, and

wherein the display module comprises a first transparent member corresponding to a left eye and a second transparent member corresponding to a right eye.

13. A method for tracking a gaze by an electronic device, the method comprising:

controlling a light source module to emit light through the light source module along a waveguide formed in at least one layer included in a display module;

using a camera module to detect, based on at least one pattern structure formed in the waveguide, at least a part of the emitted light, which has been reflected from a user's pupil; and

tracking movement of the user's pupil, based on the detected light,

wherein the display module is divided into a first display region, in which at least one object related to an augmented reality service is displayed, and a second display region, which corresponds to a remaining region of a display region of the display module other than the first display region, and

wherein the waveguide is at least partially formed based on the second display region of the display module.

14. The method of claim 13 ,

wherein the camera module comprises at least one infrared camera, and

wherein the detecting of the light reflected from the user's pupil comprises detecting an infrared ray included in the emitted light by using the at least one infrared camera.

15. The method of claim 13 , wherein the waveguide is formed in a layer disposed closest to the user's pupil among the at least one layer included in the display module.

16. The method of claim 13 ,

wherein the at least one pattern structure reflects, toward the user's pupil, light emitted from the light source module, and

wherein the at least one pattern structure is configured such that an intensity of light reflected toward the pupil from along the waveguide is substantially constant.

17. The method of claim 13 ,

wherein the at least one pattern structure is formed in a progressively larger size as the pattern structure is located farther away from the light source module, and

wherein the at least one pattern structure is configured such that an amount of the reflected light increases based on the size of the pattern structure.

18. The method of claim 13 , wherein an intensity of the reflected light is determined based on at least one among a type of the pattern structure, a size of the pattern structure, or an interval of the pattern structure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2022
From: CHOI, DONGOK; SONG, HYOUNGIL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059197/0934 →
Priority Claims (1)
KR 10-2021-0021027 · Feb 17, 2021 · national
Continuity (2)
Continuation PCTKR2022001779 · Feb 4, 2022
Related Publication 20220261076A1 · Aug 18, 2022