IP Library › Granted Patent US 12,220,220
Granted Patent B2
US 12,220,220 · App. 17/772,294 · Granted Feb 11, 2025

Body surface optical imaging for respiratory monitoring

Inventors: Dimitris Visvikis (Brest, FR); Erwan L'Her (Brest, FR); Souha Nazir (Brest, FR)
Assignees: CENTRE HOSPITALIER RÉGIONAL ET UNIVERSITAIRE DE BREST; UNIVERSITÉ DE BRETAGNE OCCIDENTALE
A61B5/0803A61B5/0077A61B5/0816A61B5/091A61B5/1128A61B5/1135A61B5/7203A61B5/7278G01S17/894G06T3/60G06T7/33G06T7/80A61B2560/0223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,220,220
App. No.
17/772,294
Granted
Feb 11, 2025
Kind
B2
Abstract

A method for measuring respiratory parameters of a subject using a range imaging sensor, wherein the method includes: receiving from the range imaging sensor at least one raw image of at least one portion of the torso of the subject, wherein each point of the raw image represents the distance between the range imaging sensor and the subject; generating a surface image of at least one portion of a surface of the torso of the subject by surface interpolation of the raw image; estimating a respiratory signal as a function of time calculated as the spatial average, in a given region of interest (ROI) defined on the torso of the subject, of the differences between the depth values of the surface image at a given time and the depth values of a reference surface image; and estimating a lung volume.

Claims (31)

1. A computer-implemented method for estimating respiratory parameters of a subject, wherein said method comprises:

receiving a set of acquisitions derived from a range imaging sensor, said set of acquisitions comprising at least one raw image and a reference surface image of at least one portion of a torso of the subject, wherein each point of said at least one raw image represents a distance between the range imaging sensor and the subject; said reference surface image comprising depth values;

generating, for each raw image of said at least one raw image, a surface image of at least one portion of a surface of the torso of the subject by surface interpolation of said at least one raw image;

estimating a respiratory signal as a function of time by;

for each surface image, calculating the differences between depth values comprised in a given region of interest (ROI) defined on the surface image, said region of interest (ROI) comprising at least portion of the torso of the subject, at a given time, and the depth values of said reference surface image, and

calculating the spatial average of the obtained differences;

estimating respiratory parameters including at least a lung volume as a function of time by multiplying the respiratory signal by a surface of the region of interest; and

providing as output said respiratory parameters.

2. The method according to claim 1 , further comprising estimating a tidal volume as the difference between the maximum value and the minimum value in one respiratory cycle of the respiratory signal multiplied by the surface of the region of interest.

3. The method according to claim 1 , further comprising estimating a respiratory rate calculated from the detection of inhalation peaks in the respiratory signal.

4. The method according to claim 1 , wherein surface interpolation of said at least one raw image is obtained using basis spline functions.

5. The method according to claim 1 , further comprising filtering said at least one raw image so as to remove noise originating from other objects in a scene.

6. The method according to claim 1 , wherein said at least one raw image is derived from the range imaging sensor being a time-of-flight camera.

7. The method according to claim 6 , wherein the method further comprises calibrating by applying a rotation matrix to said at least one raw image so as to align the subject torso in said at least one raw image with a xy plane of the time-of-flight camera.

8. The method according to claim 1 , wherein said at least one raw image is derived from the range imaging sensor being placed in front of the torso of the subject.

9. A non-transitory computer readable medium comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method according to claim 1 .

10. A system for estimating respiratory parameters of a subject comprising:

at least one input selected from the group consisting of hardware, software, firmware and combinations thereof, said at least one input being configured to receive a set of acquisitions derived from a range imaging sensor, said set of acquisitions comprising at least one raw image and a reference image of at least one portion of a torso of the subject, wherein each point of the at least one raw image represents a distance between the range imaging sensor and the subject, said reference surface image comprising depth values;

at least one processor configured to:

generate, for each raw image of said at least one raw image, a surface image of at least one portion of a surface of the torso of the subject by surface interpolation of said at least one raw image,

estimate a respiratory signal as a function of time by:

for each surface image, calculating the differences between depth values comprised in a given region of interest (ROI) defined on the surface image, said region of interest (ROI) comprising at least portion of the torso of the subject, at a given time, and the depth values of said reference surface image, and

calculating the spatial average of the obtained differences,

calculate respiratory parameters including at least a lung volume as a function of time by multiplying the respiratory signal by the surface of the region of interest; and

at least one output selected from the group consisting of hardware, software, firmware and combinations thereof, said at least one output being configured to output said respiratory parameters.

11. The system according to claim 10 , wherein the at least one processor is configured to further calculate a respiratory rate calculated from the detection of inhalation peaks in the respiratory signal.

12. The system according to claim 11 , wherein the range imaging sensor is placed in front of the torso of the subject.

13. The system according to claim 10 , wherein the range imaging sensor is a time-of-flight camera and the at least one processor is further configured to apply a rotation matrix to said at least one raw image so as to align the subject torso in said at least one raw image with the xy plane of the range imaging sensor.

14. The system according to claim 10 , wherein the at least one processor is further configured to calculate a tidal volume as the difference between the maximum value and the minimum value in one respiratory cycle of the respiratory signal multiplied by the surface of the region of interest.

15. The system according to claim 10 , wherein the at least one processor is further configured to filter said at least one raw image so as to remove noise originating from other objects in a scene.

16. The system according to claim 10 , wherein surface interpolation of said at least one raw image is obtained using basis spline functions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2022
From: VISVIKIS, DIMITRIS; L'HER, ERWAN; NAZIR, SOUHA
To: CENTRE HOSPITALIER RÉGIONAL ET UNIVERSITAIRE DE BREST; UNIVERSITÉ DE BRETAGNE OCCIDENTALE
Reel/Frame 060170/0298 →
Priority Claims (1)
EP 19306417 · Oct 31, 2019 · regional
Continuity (1)
Related Publication 20220378320A1 · Dec 1, 2022
References Cited (14)
US 10342464B2 · Niemeyer · 2019 [cited by applicant]
US 20100277571A1 · Xu · 2010 [cited by examiner]
US 20110060215A1 · Tupin, Jr. et al. · 2011 [cited by applicant]
US 20150265187A1 · Bernal et al. · 2015 [cited by applicant]
US 20160345867A1 · Aoki et al. · 2016 [cited by applicant]
US 20170055877A1 · Niemeyer · 2017 [cited by examiner]
US 20200000370A1 · Tao · 2020 [cited by examiner]
US 20200138336A1 · Shim · 2020 [cited by examiner]
US 20200187827A1 · Addison · 2020 [cited by examiner]
EP 3245943A1 · 2017 [cited by examiner]
WO 2010073129A1 · 2010 [cited by applicant]
T. Wentz et al, “Accuracy of dynamic patient surface monitoring using a time-of-flight camera and B-spline modeling for respiratory motion characterization”, Physics in Medicine and Biology, vol. 57, pp. 4175-4193, 2012… [cited by examiner]
C. Sun et al, “An Unobtrusive and Non-Contact Method for Respiratory Measurement With Respiratory Region Detecting Algorithm Based on Depth Images”, IEEE Access, vol. 7, pp. 8300-8315, Jan. 2019 (Year: 2019). [cited by examiner]
International Search Report issued on Apr. 11, 2020 in corresponding International application No. PCT/EP2020/076116; 3 pages. [cited by applicant]