IP Library › Granted Patent US 9,225,916
Granted Patent B2
US 9,225,916 · App. 12/727,089 · Granted Dec 29, 2015

System and method for enhancing video images in a conferencing environment

Inventors: Joseph T. Friel (Ardmore, PA); J. William Mauchly (Berwyn, PA); Dihong Tian (San Jose, CA)
Assignee: CISCO TECHNOLOGY, INC.
H04N5/332H04N3/09H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,225,916
App. No.
12/727,089
Granted
Dec 29, 2015
Kind
B2
Abstract

A method is provided in one example and includes receiving image data for a field of view associated with a display. The image data is used to generate a plurality of red green blue (RGB) frames. The method also includes emitting infrared energy onto the field of view in order to generate a plurality of infrared frames, the plurality of RGB frames and the plurality of infrared frames are generated by a single camera. The plurality of RGB frames can be combined with the plurality of infrared frames in order to generate a video data stream. In a more particular embodiment, the emitting of the infrared energy is synchronized with the camera such that the infrared energy is emitted onto the field of view at one half of an existing frame rate of the camera.

Claims (38)

1. A method, comprising:

receiving image data for a field of view associated with a display, wherein the image data is used to generate a red green blue (RGB) frame;

emitting infrared energy onto the field of view in order to generate an infrared frame, wherein the RGB frame and infrared frame are alternately generated by a single camera and wherein the emitting occurs such that the infrared energy is directed away from the camera and toward the field of view to illuminate the entire field of view; and

combining the RGB frame with the infrared frame in order to generate a video data stream;

wherein the emitting of the infrared energy is synchronized with the camera such that the infrared energy is emitted onto the field of view at one half of an existing frame rate of the camera.

2. The method of claim 1 , wherein an infrared phase associated with emitting the infrared energy has a shorter exposure time than a RGB phase associated with generating the RGB frame such that the camera has unequal shutter times.

3. The method of claim 1 , wherein every other video frame generated by the camera is an infrared frame for which the infrared energy was provided.

4. The method of claim 1 , further comprising:

executing image denoising to reduce temporal noise or spatial noise associated with the RGB frame.

5. The method of claim 1 , further comprising:

adding infrared video image data on a pixel basis to generate enhanced video frames included in the video data stream.

6. The method of claim 1 , wherein the emitting infrared energy onto the field of view is provided by an illumination element that comprises light emitting diodes (LEDs), which are covered by a diffuser.

7. Logic encoded in one or more non-transitory tangible media that includes code for execution and when executed by a processor operable to perform operations comprising:

receiving image data for a field of view associated with a display, wherein the image data is used to generate a red green blue (RGB) frame;

emitting infrared energy onto the field of view in order to generate an infrared frame, wherein the RGB frame and infrared frame are alternately generated by a single camera and wherein the emitting occurs such that the infrared energy is directed away from the camera and toward the field of view to illuminate the entire field of view; and

combining the RGB frame with the infrared frame in order to generate a video data stream;

wherein the emitting of the infrared energy is synchronized with the camera such that the infrared energy is emitted onto the field of view at one half of an existing frame rate of the camera.

8. The logic of claim 7 , wherein an infrared phase associated with emitting the infrared energy has a shorter exposure time than a RGB phase associated with generating the RGB frame such that the camera has unequal shutter times.

9. The logic of claim 7 , wherein every other video frame generated by the camera is an infrared frame for which the infrared energy was provided.

10. The logic of claim 7 , wherein the operations further comprise:

executing image denoising to reduce temporal noise or spatial noise associated with the RGB frame.

11. The logic of claim 7 , wherein the operations further comprise:

adding infrared video image data on a pixel basis to generate enhanced video frames included in the video data stream.

12. An apparatus, comprising:

a memory element configured to store data,

a processor operable to execute instructions associated with the data, and

an image processing module configured to:

receive image data for a field of view associated with a display, wherein the image data is used to generate a red green blue (RGB) frame, wherein infrared energy is emitted onto the field of view in order to generate an infrared frame, wherein the RGB frame and infrared frame are alternately generated by a single camera and wherein the emitting occurs such that the infrared energy is directed away from the camera and toward the field of view to illuminate the entire field of view; and

combine the RGB frame with the infrared frame in order to generate a video data stream;

wherein the emitting of the infrared energy is synchronized with the camera such that the infrared energy is emitted onto the field of view at one half of an existing frame rate of the camera.

13. The apparatus of claim 12 , wherein an infrared phase associated with emitting the infrared energy has a shorter exposure time than a RGB phase associated with generating the RGB frames such that the camera has unequal shutter times.

14. The apparatus of claim 12 , wherein every other video frame generated by the camera is an infrared frame for which the infrared energy was provided.

15. The apparatus of claim 12 , wherein the image processing module is further configured to:

execute image denoising to reduce temporal noise or spatial noise associated with the plurality of RGB frames.

16. The apparatus of claim 12 , wherein the image processing module is further configured to:

add infrared video image data on a pixel basis to generate enhanced video frames included in the video data stream.

17. The apparatus of claim 12 , further comprising:

an integrated component that includes the image processing module, the camera, and an illumination element that is configured to provide the infrared energy onto the field of view, wherein the illumination element further comprises light emitting diodes (LEDs), which are covered by a diffuser.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2010
From: FRIEL, JOSEPH T.; MAUCHLY, J. WILLIAM; TIAN, DIHONG
To: CISCO TECHNOLOGY, INC.
Reel/Frame 024104/0286 →
Continuity (1)
Related Publication 20110228096A1 · Sep 22, 2011