IP Library Granted Patent US 11,627,262
Granted Patent B2
US 11,627,262 · App. 16/672,766 · Granted Apr 11, 2023

Handheld computing device

Inventors: Piotr Stec (Galway, IE); Petronel Bigioi (Galway, IE); Istvan Andorko (Galway, IE)
H04N5/33G06F21/32G06V40/166G06V40/19H04N5/2254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,262
App. No.
16/672,766
Granted
Apr 11, 2023
Kind
B2
Abstract

A handheld computing device comprises a display comprising an array of pixels illuminated by a plurality of visible light sources, and a plurality of infra-red light sources interleaved between the visible light sources, the IR light sources being actuable to emit diffuse IR light with a first intensity. A camera has an image sensor comprising an array of pixels responsive to infra-red light and a lens assembly with an optical axis extending from the image sensor through the surface of the display. A dedicated illumination source is located outside the display and is actuable to emit infra-red light with a second greater intensity. A processor is configured to switch between an iris region processing mode in which a subject is illuminated at least by the dedicated light source and a face region processing mode in which a subject is illuminated by the plurality of IR light sources.

Claims (30)

1. A handheld computing device comprising:

a display comprising an array of pixels illuminated by a plurality of visible light sources within the display, and further comprising a plurality of infra-red (IR) light sources within the display and interleaved between said visible light sources, said IR light sources being actuable to emit diffuse IR light with a first intensity through a surface of said display,

a camera having an image sensor comprising an array of pixels responsive to at least infra-red light and a lens assembly with an optical axis extending from said image sensor through said surface of said display,

a dedicated illumination source located outside said display and being actuable to emit infra-red light with a second intensity and through a half-angle encompassing said optical axis, said second intensity being greater than said first intensity of diffuse IR light emitted by said IR light sources within the display, and

a processor configured to distinctly switch between (i) an iris region processing mode in which at least one iris is illuminated at least by said dedicated illumination source at said second intensity, (ii) a first face region processing mode in which a face is illuminated by said plurality of IR light sources at said first intensity, the iris region processing mode being distinct from the first face region processing mode, and (iii) a second face region processing mode where a face is detected at a greater distance from the handheld computing device than in said first face region processing mode, wherein in said second face region processing mode, a subject is illuminated by at least said dedicated illumination source, and wherein the iris region processing mode, the first face region processing mode, and the second face region processing mode are three distinct processing modes.

2. The handheld computing device according to claim 1 wherein said dedicated illumination source is located adjacent said camera at a corner of said handheld computing device and configured to emit from the surface of the display.

3. The handheld computing device according to claim 1 wherein said dedicated illumination source is located at a corner of said handheld computing device opposite said camera and configured to emit from the surface of the display.

4. The handheld computing device according to claim 1 wherein said dedicated illumination source is located in a bezel of said handheld computing device adjacent said camera.

5. The handheld computing device according to claim 1 where, in said iris region processing mode, a subject is further illuminated by said plurality of IR light sources.

6. The handheld computing device according to claim 1 wherein said dedicated illumination source is further configured to emit visible light.

7. The handheld computing device according to claim 1 wherein said first and second face region processing modes are face recognition modes.

8. The handheld computing device according to claim 1 wherein said iris region processing mode is an iris recognition mode.

9. The handheld computing device according to claim 1 wherein said display is a backlit display comprising a backlighting layer with an array of light sources disposed behind said surface of said display, wherein a plurality of said light sources interleaved among visible light sources are actuable to emit infra-red IR light through a first half-angle from said surface of said display, said first half-angle being greater than said half-angle for said dedicated illumination source.

10. The handheld computing device according to claim 1 wherein said display is an edge light display wherein said plurality of IR light sources are interleaved between said visible light sources along at least one edge of said display.

11. The handheld computing device according to claim 1 wherein said image sensor comprises pixels sensitive to visible light.

12. The handheld computing device according to claim 11 wherein said processor is configured to refine visible image information acquired by said image sensor with infra-red information acquired by said image sensor.

13. The handheld computing device according to claim 1 wherein said display is a liquid crystal display.

14. The handheld computing device according to claim 1 wherein each of said plurality of visible light sources and said plurality of IR light sources are light emitting diodes (LEDs).

15. The handheld computing device according to claim 1 said dedicated illumination source comprises an LED.

16. A system comprising:

a display comprising an array of pixels illuminated by a plurality of visible light sources within the display, and further comprising a plurality of infra-red (IR) light sources within the display and interleaved between said visible light sources, said IR light sources being actuable to emit diffuse IR light with a first intensity through a surface of said display,

a camera having an image sensor comprising an array of pixels responsive to at least infra-red light and a lens assembly with an optical axis extending from said image sensor through said surface of said display,

a dedicated illumination source located outside said display and being actuable to emit infra-red light with a second intensity and through a half-angle encompassing said optical axis, said second intensity being greater than said first intensity of diffuse IR light emitted by said IR light sources within the display, and

a processor configured to distinctly switch between (i) an iris region processing mode in which at least one iris is illuminated at least by said dedicated illumination source at said second intensity, (ii) a first face region processing mode in which a face is illuminated by said plurality of IR light sources at said first intensity, the iris region processing mode being distinct from the first face region processing mode, and (iii) a second face region processing mode where a face is detected at a greater distance from the system than in said first face region processing mode, wherein in said second face region processing mode, a subject is illuminated by at least said dedicated illumination source, and wherein the iris region processing mode, the first face region processing mode, and the second face region processing mode are three distinct processing modes.

17. The system according to claim 16 wherein said display is a backlit display comprising a backlighting layer with an array of light sources disposed behind said surface of said display, wherein a plurality of said light sources interleaved among visible light sources are actuable to emit infra-red IR light through a first half-angle from said surface of said display, said first half-angle being greater than said half-angle for said dedicated illumination source.

18. The system according to claim 16 wherein said display is an edge light display wherein said plurality of IR light sources are interleaved between said visible light sources along at least one edge of said display.

19. The system according to claim 16 wherein said image sensor comprises pixels sensitive to visible light.

20. The system according to claim 16 wherein:

said first and second face region processing modes are face recognition mode modes; and

said iris region processing mode is an iris recognition mode.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Dec 5, 2024
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 069516/0394 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2019
From: STEC, PIOTR; BIGIOI, PETRONEL; ANDORKO, ISTVAN
To: FOTONATION LIMITED
Reel/Frame 050903/0926 →
Continuity (1)
Related Publication 20210136298A1 · May 6, 2021
Cited By (2)
US 12,206,994 US 12,406,384