IP Library › Granted Patent US 10,789,714
Granted Patent B2
US 10,789,714 · App. 16/032,447 · Granted Sep 29, 2020

Apparatus and method for detecting reflection

Inventors: Dongwoo Kang (Seoul, KR); Dong Kyung Nam (Yongin-si, KR); Jingu Heo (Yongin-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/11G06F3/013G06K9/0061G06K9/2018G06K9/2027G06T5/50G06K9/00832G06K2009/3291G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,789,714
App. No.
16/032,447
Granted
Sep 29, 2020
Kind
B2
Abstract

A method and apparatus for detecting a reflection are provided. The method includes acquiring an input image of an object, based on an activation of an infrared light source, acquiring a reference image of the object, based on a deactivation of the infrared light source, and extracting a reflection region from the input image, based on the input image and the reference image.

Claims (75)

1. A method of detecting a reflection, the method being performed by an apparatus for detecting the reflection, and the method comprising:

acquiring an input image of an object, based on an activation of an infrared light source;

acquiring a reference image of the object, based on a deactivation of the infrared light source; and

extracting a reflection region from the input image, based on the input image and the reference image.

2. The method of claim 1 , wherein the acquiring of the input image comprises activating the infrared light source during an on interval, and

the acquiring of the reference image comprises deactivating the infrared light source during an off interval.

3. The method of claim 2 , wherein the acquiring of the input image further comprises generating the input image, based on a first plurality of rays received from the object, during the on interval, and

the acquiring of the reference image further comprises generating the reference image, based on a second plurality of rays received from the object, during the off interval.

4. A method of detecting a reflection, the method being performed by an apparatus for detecting the reflection, and the method comprising:

acquiring an input image of an object, based on an activation of an infrared light source;

acquiring a reference image of the object, based on a deactivation of the infrared light source; and

extracting a reflection region from the input image, based on the input image and the reference image,

wherein the acquiring of the input image comprises activating the infrared light source during an on interval,

wherein the acquiring of the reference image comprises deactivating the infrared light source during an off interval,

wherein the acquiring of the input image further comprises generating the input image, based on a first plurality of rays received from the object, during the on interval, and

wherein the acquiring of the reference image further comprises generating the reference image, based on a second plurality of rays received from the object, during the off interval,

wherein the generating of the input image comprises:

collecting first intensities of the first plurality of rays that is received from the object, during a first portion of first frames in the on interval; and

determining the first intensities as first pixel values of first pixels of the input image, to generate the input image, and

wherein the generating of the reference image comprises:

collecting second intensities of the second plurality of rays that is received from the object, during a second portion of second frames in the off interval; and

determining second intensities as second pixel values of second pixels of the reference image, to generate the reference image.

5. The method of claim 1 , wherein the extracting of the reflection region comprises:

generating a difference map by subtracting first pixel values of the reference image from second pixel values of the input image respectively corresponding to the first pixel values, the difference map indicating a difference between the input image and the reference image; and

extracting the reflection region from the input image, based on the difference map.

6. The method of claim 5 , wherein the extracting of the reflection region further comprises:

determining elements of the difference map, the elements having difference values exceeding a threshold; and

determining, as the reflection region, pixels of the input image that correspond to the elements.

7. The method of claim 1 , further comprising:

tracking a position of the object; and

designating at least one of a plurality of infrared light sources included in an infrared ray array, the at least one of the plurality of infrared light sources corresponding to the position that is tracked,

wherein the acquiring of the input image comprises activating the at least one of the plurality of infrared light sources that is designated, during an on interval, and

wherein the acquiring of the reference image comprises deactivating the at least one of the plurality of infrared light sources that is designated, during an off interval.

8. A method of detecting a reflection, the method being performed by an apparatus for detecting the reflection, and the method comprising:

acquiring an input image of an object, based on an activation of an infrared light source;

acquiring a reference image of the object, based on a deactivation of the infrared light source; and

extracting a reflection region from the input image, based on the input image and the reference image,

wherein the acquiring of the input image comprises acquiring the input image, based on an infrared region of a first ray that is received from the object during an on interval in which the infrared light source is activated, and

wherein the acquiring of the reference image comprises acquiring the reference image, based on a visible ray region of a second ray that is received from the object during an off interval in which the infrared light source is deactivated.

9. The method of claim 1 , further comprising dynamically adjusting a first length of an on interval in which the infrared light source is activated and a second length of an off interval in which the infrared light source is deactivated.

10. The method of claim 1 , further comprising:

removing the reflection region from the input image; and

tracking a gaze of a user, based on the input image from which the reflection region is removed.

11. The method of claim 1 , wherein the infrared light source and an image acquirer are arranged so that a predetermined angle is formed by a first direction in which the infrared light source emits a first ray to the object and by a second direction in which the image acquirer receives a second ray from the object.

12. The method of claim 1 , further comprising:

gradually increasing a ray intensity of the infrared light source from a first start timing to a first intermediate timing in an on interval in which the infrared light source is activated;

gradually decreasing the ray intensity from the first intermediate timing to a first end timing in the on interval;

gradually decreasing the ray intensity from a second start timing to a second intermediate timing in an off interval in which the infrared light source is deactivated; and

gradually increasing the ray intensity from the second intermediate timing to a second end timing in the off interval.

13. The method of claim 1 , further comprising periodically deactivating the infrared light source, in response to a detection of a transparent object that causes a light reflection between a user and the apparatus.

14. The method of claim 1 , wherein the acquiring of the input image comprises increasing an intensity of the infrared light source from an off level to an on level, during an on interval; and

the acquiring of the reference image comprises decreasing the intensity of the infrared light source from the on level to the off level, during an off interval.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

16. An apparatus for detecting a reflection, the apparatus comprising:

an image acquirer configured to:

acquire an input image of an object, based on an activation of an infrared light source; and

acquire a reference image of the object, based on a deactivation of the infrared light source; and

a processor configured to extract a reflection region from the input image, based on the input image and the reference image.

17. An apparatus for detecting a reflection, the apparatus comprising:

an image acquirer configured to:

acquire an input image of an object, based on an activation of an infrared light source; and

acquire a reference image of the object, based on a deactivation of the infrared light source; and

a processor configured to extract a reflection region from the input image, based on the input image and the reference image,

wherein the processor is further configured to:

generate a difference map by subtracting first pixel values of the reference image from second pixel values of the input image respectively corresponding to the first pixel values, the difference map indicating a difference between the input image and the reference image; and

extract the reflection region from the input image, based on the difference map.

18. The apparatus of claim 16 , further comprising an infrared ray array spaced apart from the image acquirer so that a predetermined angle is formed by a first direction in which the infrared ray array emits a first ray to the object and a second direction in which the image acquirer receives a second ray from the object,

wherein the processor is further configured to activate at least one of a plurality of infrared light sources included in the infrared ray array, so that the predetermined angle is maintained at a position of the object, in response to a movement of the object being detected.

19. A method of detecting a reflection, the method being performed by an apparatus for detecting the reflection, and the method comprising:

acquiring an input image of an object, based on an activation of an infrared light source;

acquiring a reference image of the object, based on a deactivation of the infrared light source;

generating a difference map by subtracting first pixel values of the reference image from second pixel values of the input image respectively corresponding to the first pixel values;

determining elements of the difference map, the elements having difference values exceeding a threshold; and

removing a reflection region from the input image, the reflection region corresponding to the elements.

20. The method of claim 19 , further comprising adjusting a first length of an on interval in which the infrared light source is activated to be shorter than a second length of an off interval in which the infrared light source is deactivated.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD ASSIGNOR'S DATE OF ASSIGNMENT PREVIOUSLY RECORDED ON REEL 052963 FRAME 0718. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECTIVE ASSIGNMENT. Recorded Jun 24, 2020
From: KANG, DONGWOO; NAM, DONG KYUNG; HEO, JINGU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053022/0806 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 046321 FRAME: 0138. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 17, 2020
From: KANG, DONGWOO; NAM, DONG KYUNG; HEO, JINGU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 052963/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: KANG, DONGWOO; NAM, DONG KYUNG; HEO, JINGU
To: SAMSUNG ELECTRONICS CO.. LTD.
Reel/Frame 046321/0138 →
Priority Claims (1)
KR 10-2017-0177131 · Dec 21, 2017 · national
Continuity (1)
Related Publication 20190197690A1 · Jun 27, 2019
Cited By (2)
US 12,197,646 US 12,632,107