IP Library Granted Patent US 10,878,548
Granted Patent B2
US 10,878,548 · App. 16/368,385 · Granted Dec 29, 2020

Specular reflection reduction using polarized light sources

Inventors: Raghunandan Pasula (Kansas City, MO); Reza R. Derakhshani (Shawnee, KS)
Assignee: Advanced New Technologies Co., Ltd.
G06T5/50G06F21/32G06K9/2027G06K9/4661H04N5/2354G06K9/00221G06K9/00604G06T2207/10152G06T2207/20221G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,878,548
App. No.
16/368,385
Granted
Dec 29, 2020
Kind
B2
Abstract

A method for generating a composite image includes receiving a first image that includes an eyeglass lens illuminated by a first illumination source radiating electromagnetic radiation in a first polarization state, and receiving a second image that includes the eyeglass lens illuminated by a second illumination source radiating electromagnetic radiation in a second polarization state. The second polarization state is different from the first polarization state, and the second illumination source is spatially separated from the first illumination source. The method also includes identifying, in the first image, a first portion that represents a reflection of the first illumination source on the eyeglass lens, and generating the composite image in which the first portion is replaced by a corresponding second portion from the second image. The first portion and the second portion represent substantially a same portion of the eyeglass lens.

Claims (55)

1. A method for generating a composite image from multiple images, the method comprising:

receiving, by one or more processing devices, a first image that includes an eyeglass lens, wherein the eyeglass lens is illuminated by a first illumination source radiating electromagnetic radiation in a first polarization state;

receiving, by the one or more processing devices, a second image that includes the eyeglass lens, wherein the eyeglass lens is illuminated by a second illumination source radiating electromagnetic radiation in a second polarization state, wherein:

a reflection of the second illumination source on the eyeglass lens and a reflection of the first illumination source on the eyeglass lens are at different locations,

the second polarization state is different from the first polarization state and

the second illumination source is spatially separated from the first illumination source;

identifying, by the one or more processing devices in the first image, a first portion that represents the reflection of the first illumination source on the eyeglass lens;

identifying, by the one or more processing devices in the second image, a second portion corresponding to the first portion of the first image, wherein:

the second portion does not represent the reflection of the second illumination source on the eyeglass lens, and

the first portion and the second portion represent a same portion of the eyeglass lens; and

generating, by the one or more processing devices, the composite image in which the first portion is replaced by the corresponding second portion from the second image.

2. The method of claim 1 , wherein the first illumination source radiates the electromagnetic radiation in the first polarization state during a first time period, and the second illumination source radiates the electromagnetic radiation in the second polarization state during a second time period that is at least partially non-overlapping with the first time period.

3. The method of claim 1 , wherein the first polarization state is substantially orthogonal to the second polarization state.

4. The method of claim 1 , further comprising performing a biometric authentication based on the composite image.

5. The method of claim 1 , further comprising:

identifying, in the second image, a third portion that represents the reflection of the second illumination source on the eyeglass lens; and

generating, by the one or more processing devices, a second composite image in which the third portion is replaced by a corresponding fourth portion from the first image, wherein the third portion and the fourth portion represent a same portion of the eyeglass lens.

6. The method of claim 1 , further comprising controlling at least one of: (i) a first polarizer disposed at the first illumination source and (ii) a second polarizer disposed at the second illumination source such that the reflection of the first illumination source on the eyeglass lens and the reflection of the second illumination source on the eyeglass lens are at different locations.

7. The method of claim 1 , wherein at least one of (i) the first polarization state and (ii) the second polarization state is adjusted based on an estimate of a strength of reflection associated with the reflection of the first illumination source on the eyeglass lens.

8. The method of claim 1 , wherein a wavelength associated with at least one of (i) the first illumination source and (ii) the second illumination source is adjusted based on an estimate of a strength of reflection associated with the reflection of the first illumination source on the eyeglass lens.

9. An imaging system comprising:

a first illumination source controllable to radiate electromagnetic radiation of multiple polarization states;

a second illumination source disposed spatially separated from the first illumination source, the second illumination source controllable to radiate electromagnetic radiation of multiple polarization states; and

one or more processing devices that:

receive a first image including a subject captured under illumination by the first illumination source radiating electromagnetic radiation in a first polarization state,

receive a second image including the subject under illumination by the second illumination source radiating electromagnetic radiation in a second polarization state different from the first polarization state, wherein a reflection of the second illumination source on the subject and a reflection of the first illumination source on the subject are at different locations,

identify, in the first image, a first portion that represents the reflection of the first illumination source,

identify, in the second image, a second portion corresponding to the first portion of the first image, wherein:

the second portion does not represent the reflection of the second illumination source on the subject, and

the first portion and the second portion represent a same portion of the subject; and

generate a composite image in which the first portion is replaced by the corresponding second portion from the second image.

10. The imaging system of claim 9 , wherein the first illumination source radiates the electromagnetic radiation in the first polarization state during a first time period, and the second illumination source radiates the electromagnetic radiation in the second polarization state during a second time period that is at least partially non-overlapping with the first time period.

11. The imaging system of claim 9 , wherein the first polarization state is substantially orthogonal to the second polarization state.

12. The imaging system of claim 9 , further comprising at least one camera that captures the first and second images.

13. The imaging system of claim 9 , further comprising an authentication engine that processes the composite image to perform a biometric authentication process to regulate access to a secure system.

14. The imaging system of claim 9 , wherein the one or more processing devices are configured to:

identify, in the second image, a third portion that represents the reflection of the second illumination source; and

generate a second composite image in which the third portion is replaced by a corresponding fourth portion from the first image, wherein the third portion and the fourth portion represent a same portion of the subject.

15. The imaging system of claim 9 , further comprising:

at least one of: (i) a first polarizer disposed at the first illumination source and (ii) a second polarizer disposed at the second illumination source.

16. The imaging system of claim 15 , further comprising at least one motor that controls one or more of the first and second polarizers such that the reflection of the first illumination source on the subject and the reflection of the second illumination source on the subject are at different locations.

17. The imaging system of claim 9 , wherein at least one of (i) the first polarization state and (ii) the second polarization state is adjusted based on an estimate of a strength of reflection associated with the reflection of the first illumination source.

18. The imaging system of claim 9 , wherein at least one of (i) the first illumination source and (ii) the second illumination source is a multispectral source controllable to radiate illumination at multiple different wavelengths.

19. The imaging system of claim 18 , wherein a wavelength associated with at least one of (i) the first illumination source and (ii) the second illumination source is adjusted based on an estimate of a strength of reflection associated with the reflection of the first illumination source.

20. One or more non-transitory machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform operations comprising:

receiving a first image that includes an eyeglass lens, wherein the eyeglass lens is illuminated by a first illumination source radiating electromagnetic radiation in a first polarization state;

receiving a second image that includes the eyeglass lens, wherein the eyeglass lens is illuminated by a second illumination source radiating electromagnetic radiation in a second polarization state, wherein:

a reflection of the second illumination source on the eyeglass lens and a reflection of the first illumination source on the eyeglass lens are at different locations,

the second polarization state is different from the first polarization state, and

the second illumination source is spatially separated from the first illumination source;

identifying, in the first image, a first portion that represents tie reflection of the first illumination source on the eyeglass lens;

identifying, in the second image, a second portion corresponding to the first portion of the first image, wherein:

the second portion does not represent the reflection of the second illumination source on the eyeglass lens, and

the first portion and the second portion represent a same portion of the eyeglass lens; and

generating a composite image in which the first portion is replaced by tie corresponding second portion from the second image.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: ADVANCED NEW TECHNOLOGIES CO., LTD.
To: JUMIO CORPORATION
Reel/Frame 061004/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2022
From: EYEVERIFY INC.
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 061295/0117 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2022
From: EYEVERIFY INC.
To: JUMIO CORPORATION
Reel/Frame 060991/0737 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2020
From: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
To: ADVANCED NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053754/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053743/0464 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2020
From: PASULA, RAGHUNANDAN; DERAKHSHANI, REZA R.
To: EYEVERIFY INC.
Reel/Frame 051704/0071 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2020
From: EYEVERIFY INC.
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 051704/0154 →