Granted Patent B2

US 11,056,244 · App. 16/182,260 · Granted Jul 6, 2021

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Jason L. Harris (Lebanon, OH)

Assignee: Cilag GmbH International

G16H80/00A61B18/14A61B34/35A61B90/361G06F16/2365G06F16/2379G06T11/206G06T11/60G16H40/20G16H40/63G16H40/67G16H50/70A61B2017/00199A61B2017/00221A61B2018/00684A61B2018/00839G06T2210/41

Abstract

Claims (85)

1. A system for automatically fusing data from a medical procedure, the system comprising:

a first medical hub comprising at least one processor and at least one memory, and a remote server communicatively coupled to the first medical hub, wherein the at least one processor is configured to:

access a first dataset comprising data sampled at a first data sampling rate recorded during a sampling time period;

analyze the first dataset to determine that the first dataset has not been altered, by comparing the first dataset to valid medical data from a second medical hub and determining that a pattern within the first dataset is consistent with the valid medical data from the second medical hub;

access a second dataset comprising data sampled at a second data sampling rate that is slower than the first data sampling rate and is recorded during the sampling time period;

analyze the second dataset to determine that the second dataset has not been altered, by comparing the second dataset to second valid medical data from a third medical hub and determining that a pattern within the second dataset is consistent with the second valid medical data from the third medical hub;

scale the second dataset to match the first data sampling rate;

fuse the first dataset and the second dataset into a composite dataset;

align the first dataset and the second dataset in the composite dataset, such that data from both the first dataset and the second dataset is sequentially ordered in the composite dataset in an order in which the data was recorded;

cause display of the composite dataset;

generate a graphical overlay on top of the display of the composite dataset that provides an interpretation of the composite dataset; and

transmit the composite dataset to the remote server.

2. The system of claim 1 , wherein the first or the second dataset comprises one or more error data points, and wherein the at least one processor is further configured to smooth out the one or more error data points.

3. The system of claim 1 , wherein the graphical overlay comprises a horizontal axis and a vertical axis, and wherein the composite dataset is displayed in a graph form according to the horizontal and vertical axes.

4. The system of claim 3 , wherein the graphical overlay further comprises visual boundaries that indicate visual limits of the composite dataset.

5. The system of claim 1 , wherein the graphical overlay comprises a horizontal axis, a first vertical axis and a second vertical axis, wherein the first dataset comprises data related to a first measurement that is expressed by the first vertical axis over the horizontal axis, and wherein the second dataset comprises data related to a second measurement different than the first measurement that is expressed by the second vertical axis over the horizontal axis.

6. The system of claim 1 , wherein the at least one processor is further configured to:

access first metadata associated with the first dataset and recorded during the sampling time period;

access second metadata associated with the second dataset and recorded during the sampling time period;

transmit the first and second metadata to an offsite repository; and

store the first and second datasets in the at least one memory of the system.

7. The system of claim 1 , wherein the first dataset is recorded in a first format, wherein the second dataset is recorded in a second format different from the first format, and wherein the at least one processor is further configured to convert the first and second datasets into a common format.

8. The system of claim 1 , wherein the at least one processor is further configured to:

determine duplicate data from the first and the second datasets; and

remove all copies of the duplicate data before fusing the first and the second datasets into the composite dataset.

9. The system of claim 1 , wherein:

the first dataset is generated by a first device having a first internal clock;

the second dataset is generated by a second device having a second internal clock; and the first dataset and the second dataset do not have a common time period due to the first and the second datasets being recorded by their respective internal clocks;

wherein the at least one processor is further configured to:

access a synchronizer signal between the first and second device; and

align the first dataset and the second dataset using the synchronizer signal to interrelate the first dataset and the second dataset.

10. The system of claim 1 , wherein the at least one processor is further configured to:

access first metadata associated with the first dataset and recorded during the sampling time period;

access second metadata associated with the second dataset and recorded during the sampling time period;

transform the first dataset into first related aspect data using the first metadata; and transform the second dataset into second related aspect data using the second metadata;

wherein fusing the first dataset and the second dataset into the composite dataset comprises fusing the first related aspect data with the second related aspect data.

11. The system of claim 1 , wherein the remote server is configured to:

access updated parameters from one or more other medical hubs communicatively coupled to the remote server; and

propagate the updated parameters to the one or more other medical hubs;

wherein the one or more other medical hubs is configured to adjust the composite dataset according to the updated parameters.

12. A method of a system for automatically fusing data from a medical procedure, the system comprising a first medical hub comprising at least one processor and at least one memory, the method comprising:

accessing a first dataset comprising data sampled at a first data sampling rate recorded during a sampling time period;

analyzing the first dataset to determine that the first dataset has not been altered, by comparing the first dataset to valid medical data from a second medical hub and determining that a pattern within the first dataset is consistent with the valid medical data from the second medical hub;

accessing a second dataset comprising data sampled at a second data sampling rate that is slower than the first data sampling rate and is recorded during the sampling time period;

analyzing the second dataset to determine that the second dataset has not been altered, by comparing the second dataset to second valid medical data from a third medical hub and determining that a pattern within the second dataset is consistent with the second valid medical data from the third medical hub;

scaling the second dataset to match the first data sampling rate;

fusing the first dataset and the second dataset into a composite dataset;

aligning the first dataset and the second dataset in the composite dataset, such that data from both the first dataset and the second dataset is sequentially ordered in the composite dataset in an order in which the data was recorded;

causing display of the composite dataset;

generating a graphical overlay on top of the display of the composite dataset that provides an interpretation of the composite dataset; and

transmitting the composite dataset to a remote server.

13. The method of claim 12 , wherein the first or the second dataset comprises one or more error data points, and wherein the method further comprises smoothing out the error data points.

14. The method of claim 12 , wherein the graphical overlay comprises a horizontal axis, a first vertical axis and a second vertical axis, wherein the first dataset comprises data related to a first measurement that is expressed by the first vertical axis over the horizontal axis, and wherein the second dataset comprises data related to a second measurement different than the first measurement that is expressed by the second vertical axis over the horizontal axis.

15. The method of claim 12 , wherein the first dataset is recorded in a first format, wherein the second dataset is recorded in a second format different from the first format, and wherein the method further comprises converting the first and second datasets into a common format.

16. The method of claim 12 , further comprising:

determining duplicate data from the first and the second datasets; and

removing all copies of the duplicate data before fusing the first and the second datasets into the composite dataset.

17. The method of claim 12 , wherein:

the first dataset is generated by a first device having a first internal clock;

the second dataset is generated by a second device having a second internal clock; and

the first dataset and the second dataset do not have a common time period due to the first and the second datasets being recorded by their respective internal clocks;

wherein the method further comprises:

accessing a synchronizer signal between the first and second device; and

aligning the first dataset and the second dataset using the synchronizer signal to interrelate the first dataset and the second dataset.

18. The method of claim 12 , further comprising:

accessing first metadata associated with the first dataset and recorded during the sampling time period;

accessing second metadata associated with the second dataset and recorded during the sampling time period;

transforming the first dataset into first related aspect data using the first metadata; and

transforming the second dataset into second related aspect data using the second metadata;

wherein fusing the first dataset and the second dataset into the composite dataset comprises fusing the first related aspect data with the second related aspect data.

19. The method of claim 12 , further comprising:

accessing, by the remote server, updated parameters from one or more other medical hubs communicatively coupled to the remote server;

propagating, by the remote server, the updated parameters to the one or more other medical hubs;

and adjusting, by the one or more other medical hubs, the composite dataset according to the updated parameters.

20. A computer readable medium comprising no transitory signals and comprising instructions that, when executed by a processor, cause the processor to perform operations comprising:

accessing a first dataset comprising data sampled at a first data sampling rate recorded during a sampling time period from a first medical hub;

analyzing the first dataset to determine that the first dataset has not been altered, by comparing the first dataset to valid medical data from a second medical hub and determining that a pattern within the first dataset is consistent with the valid medical data from the second medical hub;

accessing a second dataset comprising data sampled at a second data sampling rate that is slower than the first data sampling rate and is recorded during the sampling time period;

analyzing the second dataset to determine that the second dataset has not been altered, by comparing the second dataset to second valid medical data from a third medical hub and determining that a pattern within the second dataset is consistent with the second valid medical data from the third medical hub;

scaling the second dataset to match the first data sampling rate;

fusing the first dataset and the second dataset into a composite dataset;

aligning the first dataset and the second dataset in the composite dataset, such that data from both the first dataset and the second dataset is sequentially ordered in the composite dataset in an order in which the data was recorded;

causing display of the composite dataset;

generating a graphical overlay on top of the display of the composite dataset that provides an interpretation of the composite dataset; and

transmitting the composite dataset to a remote server.

Assignments (2)

Cited By (49)

US 12,193,636 US 12,193,766 US 12,226,070 US 12,226,151 US 12,226,166 US 12,228,987 US 12,235,697 US 12,239,320 US 12,239,353 US 12,256,995 US 12,285,185 US 12,290,231 US 12,293,432 US 12,295,674 US 12,303,159 US 12,310,586 US 12,315,036 US 12,318,152 US 12,329,467 US 12,354,186 US 12,369,994 US 12,376,896 US 12,381,936 US 12,383,115 US 12,396,806 US 12,433,508 US 12,444,094 US 12,462,439 US 12,488,512 US 12,493,996 US 12,500,948 US 12,505,584 US 12,514,584 US 12,521,191 US 12,549,622 US 12,574,434 US 12,575,831 US 12,582,457 US 12,629,194 US 12,639,250 US 12,648,789 US 12,661,188 US 12,670,670 US 12,672,765 US 12,672,922 US 12,682,578 US 12,682,579 US 12,697,178 US 12,708,427