IP Library Granted Patent US 10,716,496
Granted Patent B2
US 10,716,496 · App. 15/527,651 · Granted Jul 21, 2020

Determination of breathing signal from thermal images

Inventors: Hagen Kaiser (Munich, DE); Kajetan Berlinger (Munich, DE)
Assignee: BRAINLAB AG
A61B5/1128A61B5/0035A61B5/0064A61B5/0077A61B5/015A61B5/055A61B5/11A61B5/113A61B5/7292A61B6/032A61B6/5247A61N5/1049A61N5/1068G01J5/00G03B35/02G06T7/0012G06T7/33G06T7/70H04N13/204A61B2560/0223A61B2576/00A61B2576/02A61N5/1069G01J5/10G01J2005/0077G01J2005/0081G01R33/4808G06T2207/10004G06T2207/10028G06T2207/10048G06T2207/10081G06T2207/10088G06T2207/30196H04N13/239H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,716,496
App. No.
15/527,651
Granted
Jul 21, 2020
Kind
B2
Abstract

A data processing method performed by a computer for determining breathing signal data which represents a breathing cycle of a patient, comprising the steps of: —acquiring image data representing a sequence of training thermal images of at least a part of the surface of the patient's body over time, the sequence covering at least one half breathing cycle and being captured by a thermographic camera; and —tracking at least one tracked point in the image data over the sequence of training thermal images to find a trajectory of the tracked point as the breathing signal data, wherein the tracked point is a point on the surface of the patient's body.

Claims (29)

1. A method implemented by a computer having one or more processors, comprising:

acquiring image data representing a sequence of training thermal images of at least a part of a surface of a patient's body over time, the sequence covering at least one half breathing cycle and being captured by a thermographic camera;

tracking at least one tracked point in the image data over the sequence of training thermal images to find a trajectory of the at least one tracked point as breathing signal data, wherein the at least one tracked point is a point on the surface of the patient's body; and

defining a gating region in a live thermal image captured by the thermographic camera, wherein the gating region is an area of the live thermal image and wherein at least a part of the trajectory lies in the gating region;

finding a position of the at least one tracked point in the live thermal image; and

generating a gating signal indicating whether or not the at least one tracked point is within the gating region.

2. The method of claim 1 , further comprising the steps of defining a corridor around the trajectory in a live thermal image captured by the thermographic camera, finding the position of the at least one tracked point in the live thermal image and outputting a movement warning signal if the position of the at least one tracked point is outside the corridor.

3. The method of claim 1 , further comprising the steps of determining the speed of the at least one tracked point from at least two consecutive live thermal images captured by the thermographic camera, comparing the determined speed with the speed of the at least one tracked point at a corresponding position of the trajectory and outputting a speed warning if the difference of the speeds is above a predetermined threshold.

4. The method of claim 1 , further comprising a step of a dimension reduction of the trajectory into one dimension.

5. The method of claim 4 , wherein the dimension reduction step includes determining a main axis of the trajectory and projecting the trajectory onto the main axis.

6. The method of claim 1 , wherein the at least one tracked point is selected automatically.

7. The method of claim 6 , wherein the at least one tracked point is selected automatically within a user-defined area of the thermal image.

8. The method of claim 1 , wherein a plurality of tracked points are tracked in the sequence of training thermal images to find trajectories of each of the tracked points.

9. The method of claim 8 , wherein the plurality of tracked points comprises only tracked points with similar main axes of their trajectories.

10. The method of claim 8 , further comprising the steps of defining a gating region for each of the plurality of tracked points in a live thermal image captured by the thermographic camera, finding the positions of each of the tracked points in the live thermal image and generating a gating signal indicating whether or not all or the majority of the tracked points are within their respective gating region.

11. The method of claim 8 , further comprising the steps of determining a main axis of the trajectory of each of the tracked points, projecting the trajectories onto the respective main axis and averaging the projected trajectories to obtain one-dimensional breathing signal data.

12. The method of claim 1 , further comprising the step of correlating the trajectory to a movement of a tumour as described by a tumour movement model.

13. A non-transitory computer readable storage medium comprising stored instructions executable by at least one processor to:

acquire image data representing a sequence of training thermal images of at least a part of the surface of the patient's body over time, the sequence covering at least one half breathing cycle and being captured by a thermographic camera;

track at least one tracked point in the image data over the sequence of training thermal images to find a trajectory of the at least one tracked point as the breathing signal data, wherein the at least one tracked point is a point on the surface of the patient's body; and

define a gating region in a live thermal image captured by the thermographic camera, wherein the gating region is an area of the live thermal image and wherein at least a part of the trajectory lies in the gating region;

find a position of the at least one tracked point in the live thermal image; and

generate a gating signal indicating whether or not the at least one tracked point is within the gating region.

14. A system including memory and one or more processors operable to execute instructions stored in the memory, comprising instructions to:

acquire image data representing a sequence of training thermal images of at least a part of the surface of the patient's body over time, the sequence covering at least one half breathing cycle and being captured by a thermographic camera;

track at least one tracked point in the image data over the sequence of training thermal images to find a trajectory of the at least one tracked point as the breathing signal data, wherein the at least one tracked point is a point on the surface of the patient's body; and

define a gating region in a live thermal image captured by the thermographic camera, wherein the gating region is an area of the live thermal image and wherein at least a part of the trajectory lies in the gating region;

find a position of the at least one tracked point in the live thermal image; and

generate a gating signal indicating whether or not the at least one tracked point is within the gating region.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: BRAINLAB AG
To: BRAINLAB SE
Reel/Frame 073827/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2017
From: KAISER, HAGEN; BERLINGER, KAJETAN
To: BRAINLAB AG
Reel/Frame 043299/0542 →
Continuity (2)
Continuation In Part PCTEP2014076287 · Dec 2, 2014
Related Publication 20170354330A1 · Dec 14, 2017