IP Library Granted Patent US 12,416,970
Granted Patent B2
US 12,416,970 · App. 18/290,858 · Granted Sep 16, 2025

Electronic device and operation method of the electronic device

Inventors: Hisao Ikeda (Zama, JP); Yoshiyuki Kurokawa (Sagamihara, JP)
Assignee: Semiconductor Energy Laboratory Co., Ltd.
G06F3/013G06T7/70G06T2207/30201G06V40/18H10K39/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,416,970
App. No.
18/290,858
Granted
Sep 16, 2025
Kind
B2
Abstract

An electronic device capable of gaze tracking is provided. The electronic device includes a display apparatus, an image processing portion, and a control portion. The display apparatus includes a light-emitting device and a light-receiving device. The light-emitting device has a function of emitting light to a user's eye as a display image. The light-receiving device has a function of capturing a retina of the user's eye as a captured image. The image processing portion has a function of detecting a macula included in the retina from the captured image and a function of calculating position data of the macula. The control portion has a function of obtaining a position of a user's gaze destination on the display image from the position data of the macula.

Claims (18)

1. An electronic device comprising a display apparatus, an image processing portion, and a control portion,

wherein the display apparatus comprises a first light-emitting device, a second light-emitting device as a light source, and a light-receiving device,

wherein the first light-emitting device is configured to emit light to a user's eye as a display image,

wherein the light-receiving device is configured to capture light from the second light-emitting device reflected by a retina of the user's eye as a captured image,

wherein the first light-emitting device, the second light-emitting device, and the light-receiving device are provided on a same layer,

wherein the image processing portion is configured to detect a macula included in the retina from the captured image and is configured to calculate position data of the macula, and

wherein the control portion is configured to obtain a position of a user's gaze destination on the display image from the position data of the macula.

2. The electronic device according to claim 1 ,

wherein from the captured image, the image processing portion is configured to detect a defocused object included in the captured image and is configured to sense a user's eye blinking.

3. The electronic device according to claim 1 ,

wherein the image processing portion comprises a product-sum operation circuit and a circuit performing an arithmetic operation of an activation function.

4. An electronic device comprising a display apparatus, an image processing portion, and a control portion,

wherein the display apparatus comprises a first light-emitting device, a second light-emitting device as a light source, and a light-receiving device,

wherein the first light-emitting device is configured to emit light to a user's eye as a display image,

wherein the light-receiving device is configured to capture light from the second light-emitting device reflected by a retina of the user's eye as a captured image,

wherein the first light-emitting device, the second light-emitting device, and the light-receiving device are provided over a support plate,

wherein the image processing portion is configured to detect a macula included in the retina from the captured image and is configured to calculate position data of the macula, and

wherein the control portion is configured to obtain a position of a user's gaze destination on the display image from the position data of the macula.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2024
From: IKEDA, HISAO; KUROKAWA, YOSHIYUKI
To: SEMICONDUCTOR ENERGY LABORATORY CO., LTD.
Reel/Frame 066199/0503 →
Priority Claims (1)
JP 2021-128917 · Aug 5, 2021 · national
Continuity (1)
Related Publication 20240264665A1 · Aug 8, 2024
References Cited (16)
US 5982555A · Melville · 1999 [cited by examiner]
US 10254829B2 · Miyaguchi · 2019 [cited by applicant]
US 20100045933A1 · Eberl et al. · 2010 [cited by applicant]
US 20130135181A1 · Eberl et al. · 2013 [cited by applicant]
US 20170206412A1 · Kaehler · 2017 [cited by examiner]
US 20180246566A1 · Bitauld · 2018 [cited by examiner]
US 20200150408A1 · Fard · 2020 [cited by examiner]
US 20210279449A1 · Yamazaki · 2021 [cited by examiner]
US 20230368022A1 · Yamazaki et al. · 2023 [cited by applicant]
JP 06308371A · 1994 [cited by applicant]
JP 2011107482A · 2011 [cited by applicant]
JP 2018151443A · 2018 [cited by applicant]
WO WO2002031581 · 2002 [cited by applicant]
WO WO2019243955 · 2019 [cited by applicant]
International Search Report (Application No. PCT/IB2022/056781) Dated Oct. 18, 2022. [cited by applicant]
Written Opinion (Application No. PCT/IB2022/056781) Dated Oct. 18, 2022. [cited by applicant]