Device, system and method for generating a photoplethysmographic image carrying vital sign information of a subject

1. A device for generating a photoplethysmographic image carrying vital sign information of a subject, the device comprising:

an input interface circuit that obtains image data of a skin region of a subject in at least three different wavelength channels,

wherein the image data comprises two or more image frames acquired by detecting light transmitted through or reflected from the skin region over time,

wherein the image data comprises wavelength-dependent reflection or transmission information in the at least three different wavelength channels,

a combination circuit that combines, per group of one or more pixels of the image frames and per time instant, image data values of the at least three different wavelength channels to obtain a time-variant pulse signal per group,

wherein the combination circuit is configured to combine the image data values of the at least three different wavelength channels as a weighted combination of one of:

temporally normalized wavelength channels, and

logarithm of wavelength channels,

wherein the sum of the weights used for the combination is zero, and an image generation circuit that generates a photoplethysmographic image from a property of the respective pulse signals in a time window including at least two image frames.

2. The device as claimed in claim 1 ,

wherein the image generation circuit is configured to determine, per pulse signal, a function of one or more of the pulsatility, amplitude, phase, and standard deviation in the time window and

wherein the image generation circuit is configured to use the determined function of the one or more pulsatility, amplitude, phase, and standard deviation as image data value of the photoplethysmographic image at the spatial location corresponding to the respective pulse signal.

3. The device as claimed in claim 1 ,

wherein the image generation circuit is configured to compute at least one of an amplitude map and a phase map of the temporal variations of the time-variant pulse signals as the photoplethysmographic image.

4. The device as claimed in claim 3 ,

wherein the image generation circuit is configured to compute at least one of:

the amplitude map as an inner product of the respective pulse signal with a reference signal, and

the phase of the phase map with respect to a reference signal.

5. The device as claimed in claim 3 , wherein the computation circuit computes at least one of:

weights for determining the weighted sums and

the reference signal using a motion-robust photoplethysmography signal extraction algorithm.

6. The device as claimed in claim 5 ,

wherein the computation circuit is configured to compute the at least one of: the weights and the reference signal from a skin area covered by a plurality of pixels in the image frames using at least one of:

a normalized blood volume pulse vector signature based method,

a chrominance based method, a blind source separation method,

a principal component analysis, and

an independent component analysis.

7. The device as claimed in claim 3 ,

wherein the image generation circuit is configured to use one or more of the amplitude map, the phase map and the motion map to group image areas of the obtained image data showing at least one of:

motion artifacts below a predetermined motion artifact threshold,

motion artifacts below a smallest motion artifact,

a ballistocardiographic motion above a predetermined ballistocardiographic motion threshold,

a ballistocardiographic motion above a largest ballistocardiographic motion,

a photoplethysmographic information above a predetermined photoplethysmographic information threshold, and

a photoplethysmographic information above a strongest photoplethysmographic information.

8. A device for generating a photoplethysmographic image carrying vital sign information of a subject, the device comprising:

an input interface circuit that obtains image data of a skin region of a subject in at least two different wavelength channels, the image data comprising two or more image frames acquired by detecting light transmitted through or reflected from the skin region over time, wherein the image data comprise wavelength-dependent reflection or transmission information in the at least two different wavelength channels,

a combination circuit that combines, per a group of one or more pixels of the image frames and per time instant, image data values of the at least two different wavelength channels to obtain a time-variant pulse signal per group,

wherein the combination circuit is configured to combine the image data values of the at least two different wavelength channels as a weighted combination of one of:

temporally normalized wavelength channels, and

logarithm of wavelength channels,

wherein the sum of the weights used for the combination is zero, and

an image generation circuit that generates a photoplethysmographic image from a property of the respective pulse signals in a time window including at least two image frames;

wherein the image generation circuit is configured to compute at least one of an amplitude map and phase map of the temporal variations of the time-variant pulse signals as the photoplethysmographic image,

wherein the image generation circuit is configured to generate a motion map by computing at least one of:

a weighted difference between the generated amplitude map and a single-channel amplitude map generated from the image data of a single wavelength channel, and

a weighted sum of the image data values of the different wavelength channels.

9. A system for generating a photoplethysmographic image carrying vital sign information of a subject, the system comprising:

the device as claimed in claim 1 , and

an imaging circuit that acquires the image data.

10. The system as claimed in claim 9 ,

wherein the imaging circuit comprises an optical sensing array,

wherein the optical sensing array comprises at least one of:

a Bayer-pattern filter providing at the least three wavelength channels, wherein the at least three wavelength channels are nominally centered at one of:

450 nm, 550 nm and 650 nm, respectively, and

650 nm, 750 nm and 850 nm, respectively; and

separate two-dimensional image sensors for each of the respective at least three wavelength channels.

11. The system as claimed in claim 9 , further comprising an illumination circuit that illuminates the skin region of the subject with light in the at least three different wavelength channels.

12. The system as claimed in claim 11 , wherein the illumination circuit is configured to emit modulated light having a modulation frequency outside the frequency band of the subject's pulse.

13. The system as claimed in claim 12 , wherein the illumination circuit is configured to emit amplitude modulated light using a modulation signal of 1+β·sin(½πf), wherein 0.001<β<0.1.

14. A method for generating a photoplethysmographic image carrying vital sign information of a subject, the method comprising:

obtaining image data of a skin region of a subject in at least three different wavelength channels,

wherein the image data comprising two or more image frames acquired by detecting light transmitted through or reflected from the skin region over time,

wherein the image data comprise wavelength-dependent reflection or transmission information in the at least three different wavelength channels,

combining, per group of one or more pixels of the image frames and per time instant, image data values of the at least three different wavelength channels to obtain a time-variant pulse signal per group,

wherein the image data values of the at least three different wavelength channels are combined as a weighted combination of one of:

temporally normalized wavelength channels, and

logarithm of wavelength channels,

wherein the sum of the weights used for the combination is zero, and

generating a photoplethysmographic image from a property of the respective pulse signals in a time window including at least two image frames.

15. A non-transitory computer readable medium comprising program code that, when executed by a computer, causes the computer to;

obtain image data of a skin region of a subject in at least three different wavelength channels,

wherein the image data comprising two or more image frames acquired by detecting light transmitted through or reflected from the skin region over time,

wherein the image data comprise wavelength-dependent reflection or transmission information in the at least three different wavelength channels,

combine, per group of one or more pixels of the image frame and per time instant, image data values of the at least three different wavelength channels to obtain a time-variant pulse signal per group,

wherein the image data values of the at least three different wavelength channels are combined as a weighted combination of one of:

temporally normalized wavelength channels, and

logarithm of wavelength channels,

wherein the sum of the weights used for the combination is zero, and

generate a photoplethysmographic image from a property of the respective pulse signals in a time window including at least two image frames.