IP Library › Granted Patent US 12,178,759
Granted Patent B2
US 12,178,759 · App. 18/598,110 · Granted Dec 31, 2024

Relocation module and methods for surgical equipment

Inventors: Scott D. Augustine (Deephaven, MN); Susan D. Augustine (Deephaven, MN); Garrett J. Augustine (Deephaven, MN); Brent M. Augustine (Savage, MN); Ryan S. Augustine (Minneapolis, MN); Randall C. Arnold (Minnetonka, MN)
Assignee: Augustine Biomedical + Design, LLC.
A61G13/108A61B50/13A61B50/15A61M16/06A61M16/18G06T7/70G06V10/00G16H10/60G16H20/40G16H30/20A61B46/10A61B2050/155A61B90/50A61M16/01B01D46/0093G06F16/10G06F16/48G06T2207/20081G06T2207/30004G06T2210/41G16H20/17G16H30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,178,759
App. No.
18/598,110
Filed
Mar 7, 2024
Granted
Dec 31, 2024
Kind
B2
Art Unit
2666
USPC
382/128
Abstract

Module for housing electronic and electromechanical medical equipment including a portable digital camera and processing circuitry with machine vision and machine learning software for automatically documenting healthcare events and healthcare equipment operations in the electronic health record.

Claims (58)

1. An automated data consolidation module including a system to receive and record data produced by electronic and electromechanical medical equipment, the automated data consolidation module comprising:

a module;

at least one handheld digital camera configured to produce digital data; and

processing circuitry in wired or wireless electrical communication with the at least one handheld digital camera to receive the digital data, wherein the digital data is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software is configured to interpret the digital data by:

performing at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of an image of the digital data by matching a subject image of the digital data to known images stored in an image library, to create matched identified specific visual elements of the image that show an operating parameter of a medical item or device performing a dose event or the specific visual elements of an image that show a measurement of a response event;

add time stamps or other indicators of time to the identified specific visual elements so that the digital data can be temporally correlated during subsequent big data or clinical decision support analysis; and

automatically save information provided by the matched identified specific visual elements of the image or the image itself to an electronic record or database;

wherein the at least one handheld digital camera, processing circuitry and software are configured to photograph, analyze, and record at least one of a quick response (QR) code, a barcode, or other identifier that is attached to the medical item or device, and wherein the QR code, barcode, or other identifier identifies at least one of a type of item or device, a manufacturer of the item or device, and a model of the item or device, narrowing the ML or AI analysis by directing the ML or AI analysis to a folder containing images of a specific type, manufacturer, or model of the item or device associated with the identifier.

2. The automated data consolidation module of claim 1 , wherein the at least one handheld digital camera includes a pistol grip that is user graspable to aim the at least one handheld digital camera at a subject item or device.

3. The automated data consolidation module of claim 1 , wherein the at least one handheld digital camera includes a laser pointer to assist in aiming the at least one handheld digital camera at a subject item or device.

4. The automated data consolidation module of claim 1 , wherein the at least one handheld digital camera includes a liquid crystal display (LCD) projector, a laser projector, or a cluster of lasers configured to project an indicator image onto the medical item or device after an image of the medical item or device is successfully acquired by the at least one handheld digital camera.

5. The automated data consolidation module of claim 1 , wherein the QR code, barcode, or other identifier is attached to the medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the prescribed location of the QR code, barcode, or other identifier becomes a target for a laser pointer to standardize a scene and to orient the at least one handheld digital camera to match similarly structured scenes and camera orientations of the known images stored in an image library.

6. The automated data consolidation module of claim 1 , wherein the QR code, barcode, or other identifier identifies an area or areas of interest within a scene so that the ML or AI analysis can focus on the area or areas of interest on the medical item or device that show desired information.

7. The automated data consolidation module of claim 1 , wherein the at least one handheld digital camera, processing circuitry, and software includes machine vision capabilities for one or more of:

pill identification, pill counting, or observation of and verification of a patient taking pills.

8. An automated data consolidation module including a handheld digital camera comprising:

a module;

at least one handheld digital camera; and

processing circuitry in wired or wireless electrical communication with the at least one handheld digital camera to receive and record digital data produced by the at least one handheld digital camera, wherein the at least one handheld digital camera and the processing circuitry and software are configured to photograph, analyze, and record at least one of a QR code, a barcode or other identifier that is attached to a medical item or device, the QR code, barcode, or other identifier identifying at least one of a type of the medical item or device, a manufacturer of the medical item or device, and a model of the medical item or device;

wherein the digital data from the at least one handheld digital camera includes an image of the medical item or device that is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software are configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of the image by matching the image to known images stored in an image library to form matched specific visual elements of the image that show an operating parameter of the medical item or device performing a dose event or the specific visual elements of an image that show a measurement of a response event; and

automatically save information provided by the matched specific visual elements of the image or the image itself to an electronic record or database; and

wherein the QR code, barcode, or other identifier that is attached to the medical item or device narrows the ML and AI image analysis by directing a search of the analysis to a folder containing images of the type, manufacturer, or model of the medical item or device.

9. The automated data consolidation module of claim 8 , wherein the at least one handheld digital camera includes a pistol grip that is user graspable to aim the at least one handheld digital camera at a subject item or device.

10. The automated data consolidation module of claim 8 , wherein the at least one handheld digital camera includes a laser pointer to assist in aiming the at least one handheld digital camera at a subject item or device.

11. The automated data consolidation module of claim 8 , wherein the at least one handheld digital camera includes a liquid crystal display (LCD) projector, a laser projector, or a cluster of lasers configured to project an acquisition image onto an item or device after an image of the item or device is successfully acquired by the at least one handheld digital camera.

12. The automated data consolidation module of claim 8 , wherein the QR code, the barcode, or the other identifier is connected to the medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and wherein the prescribed location of the QR code, the barcode, or the other identifier becomes a target for a laser pointer so that a scene is standardized and the at least one handheld digital camera is oriented to match similarly structured scenes and camera orientations of the known images stored in the image library.

13. The automated data consolidation module of claim 8 , wherein the QR code, the barcode, or the other identifier is configured to identifies an area or areas of interest within a scene so that the ML or AI analysis can focus on the area or areas of interest on the medical item or device that show desired information.

14. The automated data consolidation module of claim 8 , wherein the identified specific visual elements of the image constitute dose events or response events and wherein the processing circuitry and software are configured to add time stamps or other indicators of time to the image so that data can be temporally correlated during subsequent big data or clinical decision support analysis.

15. The automated data consolidation module of claim 8 , wherein the at least one handheld digital camera, processing circuitry and software include machine vision capabilities for one or more of:

pill identification, pill counting, or observation of and verification of a patient taking pills.

16. An automated data consolidation module including a system to receive and record data produced by electronic and electromechanical medical equipment, the automated data consolidation module comprising:

a module;

at least one handheld digital camera configured to produce digital data, the at least one handheld digital camera including a laser pointer to assist in aiming the at least one handheld digital camera at a subject item or device; and

processing circuitry in wired or wireless electrical communication with the at least one handheld digital camera to receive the digital data, wherein the digital data is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software is configured to interpret the digital data by:

performing at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of an image of the digital data by matching a subject image of the digital data to known images stored in an image library, to create matched identified specific visual elements of the image that show an operating parameter of a medical item or device performing a dose event or the specific visual elements of an image that show a measurement of a response event;

add time stamps or other indicators of time to the identified specific visual elements so that the digital data can be temporally correlated during subsequent big data or clinical decision support analysis; and

automatically save information provided by the matched identified specific visual elements of the image or the image itself to an electronic record or database;

wherein the at least one handheld digital camera, processing circuitry and software are configured to photograph, analyze, and record at least one of a quick response (QR) code, a barcode, or other identifier that is attached to a medical item or device, and wherein the QR code, barcode, or other identifier identifies at least one of a type of item or device, a manufacturer of the item or device, and a model of the item or device, narrowing the ML or AI analysis by directing the ML or AI analysis to a folder containing images of a specific type, manufacturer, or model of the item or device associated with the identifier.

17. A The automated data consolidation module of claim 16 , wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” analysis.

18. A The automated data consolidation module of claim 16 , wherein the processing circuitry includes artificial intelligence or machine learning algorithms that compare the response event to the dose event and provide immediate feedback via a display or alert device.

19. A The automated data consolidation module of claim 16 , wherein the electronic record or database is configured to be accessed by artificial intelligence or machine learning algorithms to retrieve one or more temporally correlated dose-response events and compare the one or more temporally correlated dose-response events to other temporally correlated dose-response events across a population of patients and output big data correlation insights to at least one storage device or display.

20. A The automated data consolidation module of claim 16 , wherein the processing circuitry and software is configured to temporally correlate the dose events and response events and artificial intelligence (AI) analytics is configured to identify expected and unexpected physiologic responses to a given dose event.

21. An automated data consolidation module including a handheld digital camera comprising:

a module;

at least one handheld digital camera; and

processing circuitry in wired or wireless electrical communication with the at least one handheld digital camera to receive and record digital data produced by the at least one handheld digital camera, wherein the at least one handheld digital camera and the processing circuitry and software are configured to photograph, analyze, and record at least one of a QR code, a barcode or other identifier that is attached to a medical item or device, the QR code, barcode, or other identifier identifying at least one of a type of the medical item or device, a manufacturer of the medical item or device, and a model of the medical item or device;

wherein the digital data from the at least one handheld digital camera includes an image of the medical item or device that is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software are configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of the image by matching the image to known images stored in an image library to form matched specific visual elements of the image that show an operating parameter of the medical item or device performing a dose event or the specific visual elements of an image that show a measurement of a response event; and

automatically save information provided by the matched specific visual elements of the image or the image itself to an electronic record or database; and

wherein the QR code, barcode, or other identifier that is attached to the medical item or device narrows the ML and AI image analysis by directing a search of the analysis to a folder containing images of the type, manufacturer, or model of the medical item or device; and

wherein the QR code, barcode, or other identifier is attached to the medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the prescribed location of the QR code, barcode, or other identifier becomes a target for a laser pointer to standardize a scene and to orient the at least one handheld digital camera to match similarly structured scenes and camera orientations of the known images stored in an image library.

22. The automated data consolidation module of claim 21 , wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” analysis.

23. The automated data consolidation module of claim 21 , wherein the processing circuitry includes artificial intelligence or machine learning algorithms that compare the response event to the dose event and provide immediate feedback via a display or alert device.

24. The automated data consolidation module of claim 21 , wherein the electronic record or database is configured to be accessed by artificial intelligence or machine learning algorithms to retrieve one or more temporally correlated dose-response event and compare the one or more temporally correlated dose-response event to other temporally correlated dose-response events across a population of patients and output big data correlation insights to at least one storage device or display.

25. The automated data consolidation module of claim 21 , wherein the processing circuitry and software is configured to temporally correlate the dose events and response events and artificial intelligence (AI) analytics is configured to identify expected and unexpected physiologic responses to a given dose event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2024
From: AUGUSTINE, SCOTT D.; AUGUSTINE, SUSAN D.; AUGUSTINE, GARRETT J.; AUGUSTINE, BRENT M.; AUGUSTINE, RYAN S.; ARNOLD, RANDALL C.
To: AUGUSTINE BIOMEDICAL + DESIGN, LLC
Reel/Frame 066681/0980 →
Continuity (19)
Continuation 18142787 · May 3, 2023
Continuation 18099074 · Jan 19, 2023
Continuation 17874963 · Jul 27, 2022
Continuation 17873857 · Jul 26, 2022
Continuation 17528832 · Nov 17, 2021
Continuation In Part 17376469 · Jul 15, 2021
Continuation In Part 17199722 · Mar 12, 2021
Continuation 17092681 · Nov 9, 2020
Continuation 16879406 · May 20, 2020
Continuation In Part 16601924 · Oct 15, 2019
Continuation 16593033 · Oct 4, 2019
Continuation 16364884 · Mar 26, 2019
Continuation In Part 15935524 · Mar 26, 2018
Continuation In Part 17245942 · Apr 30, 2021
Continuation In Part 17167681 · Feb 4, 2021
Continuation In Part 17092681 · Nov 9, 2020
Continuation 16879406 · May 20, 2020
Provisional Application 62782901 · Dec 20, 2018
Related Publication 20240207122A1 · Jun 27, 2024
Cited By (3)
US 12,403,056 US 12,508,183 US 12,697,266