IP Library Granted Patent US 12,455,613
Granted Patent B2
US 12,455,613 · App. 17/979,906 · Granted Oct 28, 2025

Method and system for indicating system state in camera-under-display configurations

Inventors: Koji Kawakita (Kanagawa, JP); Sean C. Kelly (Morrisville, NC)
Assignee: Lenovo (Singapore) Pte. Ltd.
G06F1/3296G06F1/1686G06F1/3231G06F21/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,455,613
App. No.
17/979,906
Granted
Oct 28, 2025
Kind
B2
Abstract

A computer system includes a display panel, at least one camera disposed under the display panel, and a processing system. The processing system includes a display driver circuit, a system processor, and a vision chip. The vision chip, independently from the system processor, processes image data captured by the at least one camera through the display panel, updates a state of the computer system based on the image data, and instructs the display driver circuit to drive the display panel to display a system state indicator symbol indicating the state of the computer system.

Claims (72)

1. A computer system, comprising:

a display panel;

an infrared camera and a visible camera both disposed under the display panel; and

a processing system, comprising:

a display driver circuit;

a system processor; and

a vision chip that independently from the system processor:

processes image data captured by the visible camera or the infrared camera through the display panel,

updates a state of the computer system based on the image data, and

instructs the display driver circuit to drive the display panel to display a system state indicator, wherein

updating the state of the computer system comprises, when the computer system is in a low power state:

selecting and displaying a first system state indicator including a first indicator for a human presence detection (HPD) mode and a second indicator for an inactive camera state, wherein

the first indicator is displayed around the visible camera in an first area of the display panel that overlaps the visible camera that provided the image data, and

the second indicator is displayed around the infrared camera in a second area of the display panel that overlaps the infrared camera, the infrared camera being disabled in the lower power state;

executing the HPD mode based on the image data;

in response to successfully performing a user identification by the HPD mode, causing the computer system to transition from the low power state to a power on state; and

in response to unsuccessfully performing the user identification by the HPD mode, selecting and displaying a second system state indicator including a third indicator for failed user identification and the second indicator for the inactive camera state, wherein

the third indicator is displayed around the visible camera in the first area while the computer system remains in the low power state, and

the second indicator is displayed around the infrared camera in the second area while the computer system remains in the low power state.

2. The computer system of claim 1 , wherein:

the low power state is characterized by the system processor being in sleep mode, and

the power on state is characterized by the system processor being in active mode.

3. The computer system of claim 1 , wherein the vision chip further:

based on determining that a predefined period has elapsed, instructs the display driver circuit to drive the display panel to move the system state indicator.

4. The computer system of claim 3 , wherein moving the system state indicator comprises:

periodically moving a position of the system state indicator by one or two pixels.

5. The computer system of claim 1 , wherein updating the state of the computer system comprises, when the computer system is in a power on state and executing a camera application by the system processor:

instructing the display driver circuit to drive the display panel to display a third indicator for camera on around at least one of the visible camera and the infrared camera in an area of the display panel that overlaps the at least one of the visible camera and the infrared camera that is on,

receiving a request to activate a camera privacy mode,

based on the receiving of the request:

causing the computer system to transition to the camera privacy mode, and

selecting and displaying a fourth indicator for camera privacy in the area of the display panel that overlaps the at least one of the visible camera and the infrared camera that is on.

6. The computer system of claim 1 , wherein updating the state of the computer system comprises, when the computer system is in a power on state and executing a face authentication application by the system processor:

selecting a fifth indicator for face authentication mode,

successfully performing a first face authentication, and

based on the successful first face authentication, selecting and displaying a sixth indicator for successful face authentication.

7. The computer system of claim 6 , wherein updating the state of the computer system comprises:

unsuccessfully performing a second face authentication, and

based on the unsuccessful second face authentication, selecting and displaying a seventh indicator for failed face authentication.

8. A method for indicating a state of a computer system including a display panel with an infrared camera and a visible camera both disposed under the display panel, the method comprising:

processing image data obtained from the visible camera or the infrared camera, by a vision chip independently from a system processor;

updating the state of the computer system, by the vision chip independently from the system processor, based on the image data; and

instructing a display driver circuit, by the vision chip independently from the system processor, to drive the display panel to display a system state indicator, wherein

updating the state of the computer system comprises, when the computer system is in a low power state:

selecting and displaying a first system state indicator including a first indicator for a human presence detection (HPD) mode and a second indicator for an inactive camera state, wherein

the first indicator is displayed around the visible camera in an first area of the display panel that overlaps the visible camera that provided the image data, and

the second indicator is displayed around the infrared camera in a second area of the display panel that overlaps the infrared camera, the infrared camera being disabled in the lower power state;

executing the HPD mode based on the image data;

in response to successfully performing a user identification by the HPD mode, causing the computer system to transition from the low power state to a power on state; and

in response to unsuccessfully performing the user identification by the HPD mode, selecting and displaying a second system state indicator including a third indicator for failed user identification and the second indicator for the inactive camera state, wherein

the third indicator is displayed around the visible camera in the first area while the computer system remains in the low power state, and

the second indicator is displayed around the infrared camera in the second area while the computer system remains in the low power state.

9. The method of claim 8 , wherein:

the low power state is characterized by the system processor being in sleep mode; and

the power on state is characterized by the system processor being in active mode.

10. The method of claim 8 , wherein the vision chip further:

based on determining that a predefined period has elapsed, instructs the display driver circuit to drive the display panel to move the system state indicator.

11. The method of claim 10 , wherein moving the system state indicator comprises:

periodically moving a position of the system state indicator by one or two pixels.

12. The method of claim 8 , wherein updating the state of the computer system comprises, when the computer system is in a power on state and executing a camera application by the system processor:

instructing the display driver circuit to drive the display panel to display a third indicator for camera on around at least one of the visible camera and the infrared camera in an area of the display panel that overlaps the at least one of the visible camera and the infrared camera that is on,

receiving a request to activate a camera privacy mode,

based on the receiving of the request:

causing the computer system to transition to the camera privacy mode, and

selecting and displaying a fourth indicator for camera privacy in the area of the display panel that overlaps the at least one of the visible camera and the infrared camera that is on.

13. The method of claim 8 , wherein updating the state of the computer system comprises, when the computer system is in a power on state and executing a face authentication application by the system processor:

selecting a fifth indicator for face authentication mode,

successfully performing a first face authentication, and

based on the successful first face authentication, selecting and displaying a sixth indicator for successful face authentication.

14. The method of claim 13 , wherein updating the state of the computer system comprises:

unsuccessfully performing a second face authentication, and

based on the unsuccessful second face authentication, selecting and displaying a seventh indicator for failed face authentication.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2023
From: LENOVO (UNITED STATES) INC.
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 062570/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2022
From: KAWAKITA, KOJI; KELLY, SEAN C.
To: LENOVO (UNITED STATES) INC.
Reel/Frame 061980/0664 →
Continuity (1)
Related Publication 20240152198A1 · May 9, 2024
References Cited (13)
US 11153427B2 · Chi · 2021 [cited by examiner]
US 11551634B1 · Seethaler · 2023 [cited by examiner]
US 11671692B2 · Hou · 2023 [cited by examiner]
US 12166916B2 · Cui · 2024 [cited by examiner]
US 20140281607A1 · Tse · 2014 [cited by examiner]
US 20180367656A1 · Kim et al. · 2018 [cited by applicant]
US 20210132769A1 · Parikh et al. · 2021 [cited by applicant]
US 20210149441A1 · Bartscherer · 2021 [cited by examiner]
US 20220116546A1 · Gummadi · 2022 [cited by examiner]
US 20220268567A1 · Zang · 2022 [cited by examiner]
US 20230054033A1 · Lee · 2023 [cited by examiner]
WO 2021258394A1 · 2021 [cited by applicant]
Extended European Search Report issued in corresponding European Patent Application No. 23203213.6, dated Jan. 4, 2024 (11 pages). [cited by applicant]