IP Library › Granted Patent US 9,525,811
Granted Patent B2
US 9,525,811 · App. 13/932,844 · Granted Dec 20, 2016

Display device configured as an illumination source

Inventor: Stepan N. Moskovchenko (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N5/2256H04N5/2354H04N7/142H04N9/73H04N21/4223H04N21/4318H04N21/4788H04N21/4854H04N2007/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,525,811
App. No.
13/932,844
Granted
Dec 20, 2016
Kind
B2
Abstract

The disclosed technology relates to an electronic device configured to use the device's own display to provide an illumination source for front-facing image sensors and to a method of using the same. An electronic device for capturing a digital image using a front-facing image sensor and a digital display device includes a command input module configured to receive a command to capture the digital image, an illumination adjustment module configured to adjust the display device to an imaging illumination condition in response to the command, and a front-facing image sensor module configured capture the digital image using the front-facing image sensor under the predetermined illumination condition.

Claims (84)

1. A method for capturing one or more digital images of a user using a mobile device including a front-facing image sensor and a touch screen, the method comprising:

receiving a command to capture the one or more digital images of the user;

determining that the one or more digital images include at least a face of the user;

illuminating the user by displaying an illumination image on the touch screen;

capturing a preview image using the front-facing image sensor;

adjusting a color of the illumination image based on a comparison between an average chrominance value of the preview image of the user and a target chrominance value to generate an adjusted illumination image; and

capturing the one or more digital images of the user using the front-facing image sensor while the user is illuminated by the adjusted illumination image displayed on the touch screen.

2. The method of claim 1 , wherein a face-detection algorithm is used to determine that the one or more digital images include at least the face of the user.

3. The method of claim 1 , wherein the illumination image is based on an even distribution of colored light on the user.

4. The method of claim 3 , wherein the illumination image comprises a white color.

5. The method of claim 1 , wherein the command comprises a gesture or a motion of the user.

6. The method of claim 1 , wherein the adjusted illumination image is based on an even distribution of colored light on the user.

7. The method of claim 1 , wherein the illumination image is based on a test frame of the user captured by the front-facing image sensor, the test frame including at least the user's face.

8. The method of claim 7 , wherein the test frame is captured using a fixed f-number and exposure time.

9. The method of claim 7 , further comprising:

determining an average chrominance value of the user's face in the test frame;

determining a difference between the average chrominance value of the user's face and a chrominance criteria; and

determining the color of the illumination image based on the difference.

10. The method of claim 1 , further comprising:

determining an average luminance value of the user's face;

determining a difference between the average luminance value and a target luminance value; and

adjusting an intensity of the illumination image displayed on the touch screen based on the difference.

11. The method of claim 1 , further comprising:

adjusting an intensity of the illumination image displayed on the touch screen based on a distance between the user and the mobile device.

12. The method of claim 1 , wherein the illumination image is provided by the user.

13. The method of claim 1 , wherein the illumination image comprises a stored image of the user.

14. A non-transitory computer-readable medium configured to store instructions that, when executed by a processor of a mobile device including a front-facing image sensor and a touch screen, causes the mobile device to perform operations comprising:

receiving a command to capture the one or more digital images of the user;

determining that the one or more digital images include at least a face of the user;

illuminating the user by displaying an illumination image on the touch screen;

capturing a preview image using the front-facing image sensor;

adjusting a color of the illumination image based on a comparison between an average chrominance value of the preview frame of the user and a target chrominance value to generate an adjusted illumination image; and

capturing the one or more digital images of the user using the front-facing image sensor while the user is illuminated by the adjusted illumination image displayed on the touch screen.

15. The non-transitory computer-readable medium of claim 14 , wherein execution of the instructions causes the mobile device to perform operations further comprising:

invoking a face-detection algorithm to determine that the one or more digital images include at least the face of the user.

16. The non-transitory computer-readable medium of claim 14 , wherein the illumination image is based on an even distribution of colored light on the user.

17. The non-transitory computer-readable medium of claim 16 , wherein the illumination image comprises a white color.

18. The non-transitory computer-readable medium of claim 14 , wherein the command comprises a gesture or a motion of the user.

19. The non-transitory computer-readable medium of claim 14 , wherein the adjusted illumination image is based on an even distribution of colored light on the user the preview frame of the user.

20. The non-transitory computer-readable medium of claim 14 , wherein the illumination image is based on a test frame of the user captured by the front-facing image sensor, the test frame including at least the user's face.

21. The non-transitory computer-readable medium of claim 20 , wherein the test frame is captured using a fixed f-number and exposure time.

22. The non-transitory computer-readable medium of claim 20 , wherein execution of the instructions causes the mobile device to perform operations further comprising:

determining an average chrominance value of the user's face in the test frame;

determining a difference between the average chrominance value of the user's face and a chrominance criteria; and

determining the color of the illumination image based on the difference.

23. The non-transitory computer-readable medium of claim 14 , wherein execution of the instructions causes the mobile device to perform operations further comprising:

determining an average luminance value of the user's face;

determining a difference between the average luminance value and a target luminance value; and

adjusting an intensity of the illumination image displayed on the touch screen based on the difference.

24. The non-transitory computer-readable medium of claim 14 , wherein execution of the instructions causes the mobile device to perform operations further comprising:

adjusting an intensity of the illumination image displayed on the touch screen based on a distance between the user and the mobile device.

25. The non-transitory computer-readable medium of claim 14 , wherein the illumination image is provided by the user.

26. The non-transitory computer-readable medium of claim 14 , wherein the illumination image comprises a stored image of the user.

27. A mobile device for capturing one or more digital images of a user, the mobile device comprising:

a front-facing image sensor;

a touch screen;

a processor; and

a memory configured to store instructions that, when executed by the processor, causes the mobile device to:

receive a command to capture the one or more digital images of the user;

determine that the one or more digital images include at least a face of the user;

illuminate the user by displaying an illumination image on the touch screen;

capture a preview image using the front-facing image sensor;

adjust a color of the illumination image based on a comparison between an average chrominance value of the preview frame of the user and a target chrominance value to generate an adjusted illumination image; and

capture the one or more digital images of the user using the front-facing image sensor while the user is illuminated by the adjusted illumination image displayed on the touch screen.

28. The mobile device of claim 27 , wherein execution of the instructions causes the mobile device to:

invoke a face-detection algorithm to determine that the one or more digital images include at least the face of the user.

29. The mobile device of claim 27 , wherein the illumination image is based on an even distribution of colored light on the user.

30. The mobile device of claim 29 , wherein the illumination image comprises a white color.

31. The mobile device of claim 27 , wherein the command comprises a gesture or a motion of the user.

32. The mobile device of claim 27 , wherein the adjusted illumination image is based on an even distribution of colored light on the user.

33. The mobile device of claim 27 , wherein the illumination image is based on a test frame of the user captured by the front-facing image sensor, the test frame including at least the user's face.

34. The mobile device of claim 33 , wherein the test frame is captured using a fixed f-number and exposure time.

35. The mobile device of claim 33 , wherein execution of the instructions causes the mobile device to:

determine an average chrominance value of the user's face in the test frame;

determine a difference between the average chrominance value of the user's face and a chrominance criteria; and

determine the color of the illumination image based on the difference.

36. The mobile device of claim 27 , wherein execution of the instructions causes the mobile device to further:

determine an average luminance value of the user's face;

determine a difference between the average luminance value and a target luminance value; and

adjust an intensity of the illumination image displayed on the touch screen based on the difference.

37. The mobile device of claim 27 , wherein execution of the instructions causes the mobile device to further:

adjust an intensity of the illumination image displayed on the touch screen based on a distance between the user and the mobile device.

38. The mobile device of claim 27 , wherein the illumination image is provided by the user.

39. The mobile device of claim 27 , wherein the illumination image comprises a stored image of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2013
From: MOSKOVCHENKO, STEPAN N.
To: QUALCOMM INCORPORATED
Reel/Frame 030756/0333 →
Continuity (1)
Related Publication 20150002735A1 · Jan 1, 2015