Enabling hybrid video capture of a scene illuminated with unstructured and structured illumination sources
What is disclosed is a system and method for enabling hybrid video capture of a scene being illuminated with structured and unstructured illumination sources over a wavelength range of interest that significantly intersects with each other. In one embodiment, the present system comprises a video capture device for capturing video of a scene being actively illuminated by both a structured and unstructured illumination source; a controller for controlling a manipulation of at least one structured and at least one unstructured illumination sources during capture of the video by the video capture device; and a processor in communication with the controller, the processor executing machine readable program instructions effectuating the manipulation. Various embodiments are disclosed.
1. A method for enabling hybrid video capture of a subject's exposed skin being illuminated with unstructured and structured illumination sources, the method comprising:
manipulating at least one structured illumination source with light projected through a patterned grid and at least one unstructured illumination source illuminating a subject's exposed skin being captured by a video capture device actively acquiring a video of said subject's exposed skin, said video comprising a first and second set of 2D images, wherein said two sets of images may share a subset of common images, each image frame of said first set of 2D images comprising an array of pixels with pixel values corresponding to detected reflected energy projected by said structured illumination source, each image frame of said second set of 2D images comprising an array of pixels with intensity values defining a map of said subject's vascular pattern containing blood vessels which transport hemoglobin and corresponding to detected reflected energy projected by said unstructured illumination source wherein said unstructured illumination source is an ambient light source and said manipulating includes spectrally multiplexing said illumination sources by making a wavelength range of said structured illumination sources narrower than a wavelength range of said unstructured illumination source such that reflected energy from both illumination sources can be recovered via filtering, said unstructured and structured illumination sources having overlapping spectral bands.
2. The method of claim 1 , wherein said manipulating includes sequentially alternating a projection of said structured and unstructured illumination sources such that neither of said illumination sources is projecting light concurrently and said alternating sequence is determined by one of: external events and a pre-selected sequence.
3. The method of claim 2 , wherein said external events include any of: a state change exceeding a pre-determined threshold, and a motion exceeding a pre-determined threshold.
4. The method of claim 1 , wherein said structured and unstructured illumination sources comprise one of: visible, infrared and a combination of visible and infrared.
5. The method of claim 1 , further comprising identifying at least one region of interest in said subject's exposed skin using any of: object identification, pixel classification, material analysis, texture identification, and pattern recognition.
6. A system for enabling hybrid video capture of a subject's exposed skin being illuminated with unstructured and structured illumination sources, the system comprising:
a video capture device for capturing video of a subject's exposed skin being actively illuminated by both a structured illumination source with light projected through a patterned grid and unstructured illumination source, said unstructured illumination source is an ambient light source, said unstructured and structured illumination sources having overlapping spectral bands and said video comprising a first and second set of 2D images, wherein said two sets of images may share a subset of common images, each image frame of said first set of 2D images comprising an array of pixels with pixel values corresponding to detected reflected energy projected by said structured illumination source, each image frame of said second set of 2D images comprising an array of pixels with intensity values defining a map of said subject's vascular pattern containing blood vessels which transport hemoglobin;
a controller for controlling a manipulation of at least one of said structured and unstructured illumination sources during capture of said video by said video capture device, and said manipulating includes spectrally multiplexing said illumination sources by making a wavelength range of said structured illumination sources narrower than a wavelength range of said unstructured illumination source such that reflected energy from both illumination sources can be recovered via filtering; and
a processor in communication with said controller, said processor executing machine readable program instructions effectuating said manipulation.
7. The system of claim 6 , wherein said unstructured illumination source is an ambient light source, said manipulating comprising sequentially alternating a projection of said structured illumination source onto said subject's exposed skin during video capture.
8. The system of claim 6 , wherein said manipulating includes sequentially alternating a projection of said structured and unstructured illumination sources such that neither of said illumination sources is projecting light concurrently and said alternating sequence is determined by one of: external events and a pre-selected sequence.
9. The system of claim 8 , wherein said external events include any of: a state change exceeding a pre-determined threshold, and a motion exceeding a pre-determined threshold.
10. The system of claim 6 , wherein said structured and unstructured illumination sources comprise one of: visible, infrared and a combination of visible and infrared.
11. A computer implemented method for enabling hybrid video capture of a subject's exposed skin being illuminated with unstructured and structured illumination sources, the method comprising:
manipulating at least one structured illumination source with light projected through a patterned grid and at least one unstructured illumination source illuminating a subject's exposed skin being captured by a video capture device actively acquiring a video of said subject's exposed skin, said video comprising a first and second set of 2D images, wherein said two sets of images may share a subset of common images, each image frame of said first set of 2D images comprising an array of pixels with pixel values corresponding to detected reflected energy projected by said structured illumination source, each image frame of said second set of 2D images comprising an array of pixels with intensity values defining a map of said subject's vascular pattern containing blood vessels which transport hemoglobin and corresponding to detected reflected energy projected by said unstructured illumination source wherein said unstructured illumination source is an ambient light source and said manipulating includes spectrally multiplexing said illumination sources by making a wavelength range of said structured illumination sources narrower than a wavelength range of said unstructured illumination source such that reflected energy from both illumination sources can be recovered via filtering, said unstructured and structured illumination sources having overlapping spectral bands.
12. The computer implemented method of claim 11 wherein manipulating includes sequentially alternating a projection of said structured and unstructured illumination sources such that neither of said illumination sources is projecting light concurrently and said wherein said alternating sequence is determined by one of: external events and a pre-selected sequence.
13. The computer implemented method of claim 12 , wherein said external events include any of: a state change exceeding a pre-determined threshold, and a motion exceeding a pre-determined threshold.
14. The computer implemented method of claim 12 , wherein said structured and unstructured illumination sources comprise one of: visible, infrared and a combination of visible and infrared.
15. The computer implemented method of claim 12 , further comprising identifying at least one region of interest in said subject's exposed skin using any of: object identification, pixel classification, material analysis, texture identification, and pattern recognition.