IP Library Granted Patent US 11,622,900
Granted Patent B2
US 11,622,900 · App. 17/873,857 · Granted Apr 11, 2023

Relocation module and methods for surgical equipment

Inventors: Scott D. Augustine (Deephaven, MN); Susan D. Augustine (Deephaven, MN); Garrett J. Augustine (Deephaven, MN); Brent M. Augustine (Savage, MN); Ryan S. Augustine (Minneapolis, MN); Randall C. Arnold (Minnetonka, MN)
Assignee: Augustine Biomedical + Design, LLC
A61G13/108A61B50/13A61B50/15A61M16/06A61M16/18G16H10/60G16H20/40G16H30/20A61B46/10A61B90/50A61B2050/155A61M16/01B01D46/0093G16H20/17
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,622,900
App. No.
17/873,857
Granted
Apr 11, 2023
Kind
B2
Abstract

Module for housing electronic and electromechanical medical equipment including a portable digital camera and processing circuitry with machine vision and machine learning software for automatically documenting healthcare events and healthcare equipment operations in the electronic health record.

Claims (56)

1. An automated data consolidation module including a module for housing electronic and electromechanical medical equipment and a portable digital camera, and a system to receive and record data produced by the electronic and electromechanical medical equipment and the portable digital camera, the automated data consolidation module comprising:

a housing configured to house electronic and electromechanical medical equipment;

a cowling that substantially confines the electronic and electromechanical medical equipment;

at least one portable digital camera; and

processing circuitry in wired or wireless electrical communication with the portable digital camera to receive digital data produced by the portable digital camera;

wherein the digital data is automatically delivered to the processing circuitry and software, and the processing circuitry and software is configured to interpret the digital data by:

performing at least one of machine learning (ML) and artificial intelligence (AI) analysis to identify specific visual elements of the image by matching the subject image to known images stored in an image library, wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” or clinical decision support analysis, and

automatically save the information provided by the matched specific visual elements of the image or the image itself to an electronic record or database.

2. The automated data consolidation module of claim 1 , wherein the portable digital camera, processing circuitry and software is configured to photograph, analyze and record at least one of a QR code, a barcode or other coding technology that is attached to a medical item or device.

3. The automated data consolidation module of claim 2 , wherein the QR code, barcode or other coding technology that is attached to a medical item or device identifies at least one of the type of item or device, the manufacturer of the item or device and the model of the item or device, vastly narrows the ML and AI image search by directing the search to a folder containing images of that specific make and model of item or device.

4. The automated data consolidation module of claim 1 , wherein the portable digital camera includes a pistol grip to assist in holding and aiming the camera at the subject item or device.

5. The automated data consolidation module of claim 1 , wherein the portable digital camera includes a laser pointer to assist in aiming the camera at the subject item or device.

6. The automated data consolidation module of claim 1 , wherein the portable digital camera includes a liquid crystal display (LCD) projector, a laser projector or cluster of lasers that can project an image onto an item or device after an image of the item or device is successfully acquired by the portable digital camera.

7. The automated data consolidation module of claim 2 , wherein the QR code, barcode or other coding technology is attached to a subject medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the location of the QR code, barcode or other coding technology becomes a target for the laser pointer so that the scene is standardized and the portable camera is oriented to match the similarly structured scenes and camera orientations of the known images stored in an image library.

8. The automated data consolidation module of claim 2 , wherein the QR code, barcode or other coding technology identifies the area or areas of interest within the scene so that the ML or AI functions can focus on the specific area or areas of interest on the item or device that show the desired information.

9. The automated data consolidation module of claim 1 , wherein the handheld digital camera, processing circuitry and software may include machine vision capabilities for one or more of: pill identification, pill counting or “observation” of and verification of a patient taking their pills.

10. An automated data consolidation module including a handheld digital camera comprising:

a housing configured to house electronic and electromechanical medical equipment; and

at least one handheld digital camera; and

processing circuitry in wired or wireless electrical communication with the handheld digital camera to receive and record digital data produced by the handheld digital camera; and

the handheld digital camera, processing circuitry and software is configured to photograph, analyze and record at least one of a QR code, a barcode or other coding technology that is attached to a medical item or device, identifying at least one of the type of item or device, the manufacturer of the item or device and the model of the item or device; and

the digital data from the handheld digital camera also includes an image of the item or device that is automatically delivered to the processing circuitry, and the processing circuitry and software is configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to identify specific visual elements of the image by matching the subject image to known images stored in an image library and automatically save the information provided by the matched specific visual elements of the image or the image itself to an electronic record or database;

wherein the QR code, barcode or other coding technology that is attached to a medical item or device that identifies at least one of the type of item or device, the manufacturer of the item or device and the model of the item or device, vastly narrows the ML and AI image search by directing the search to a folder containing images of that specific make and model of item or device.

11. The automated data consolidation module of claim 10 , wherein the portable digital camera includes a pistol grip to assist in holding and aiming the camera at the subject item or device.

12. The automated data consolidation module of claim 10 , wherein the handheld digital camera includes a laser pointer to assist in aiming the camera at the subject item or device.

13. The automated data consolidation module of claim 10 , wherein the handheld digital camera includes a liquid crystal display (LCD) projector, a laser projector or cluster of lasers that can project an image onto an item or device after an image of the item or device is successfully acquired by the handheld digital camera.

14. The automated data consolidation module of claim 10 , wherein the QR code, barcode or other coding technology is attached to a subject medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the location of the QR code, barcode or other coding technology becomes a target for the laser pointer so that the scene is standardized and the camera is oriented to match the similarly structured scenes and camera orientations of the known images stored in the image library.

15. The automated data consolidation module of claim 10 , wherein the QR code, barcode or other coding technology identifies the area or areas of interest within the scene so that the ML or AI functions can focus on the specific area or areas of interest on the item or device that show the desired information.

16. The automated data consolidation module of claim 10 , wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” or clinical decision support analysis.

17. The automated data consolidation module of claim 10 , wherein the handheld digital camera, processing circuitry and software may include machine vision capabilities for one or more of: pill identification, pill counting or “observation” of and verification of a patient taking their pills.

18. An automated data consolidation module including a handheld digital camera comprising:

a housing configured to house electronic and electromechanical medical equipment; and

at least one handheld digital camera; and

processing circuitry in wired or wireless electrical communication with the handheld digital camera to receive and record digital data produced by the handheld digital camera; and

the handheld digital camera, processing circuitry and software is configured to photograph, analyze and record at least one of a QR code, a barcode or other coding technology that is attached to a medical item or device, identifying at least one of the type of item or device, the manufacturer of the item or device and the model of the item or device; and

the digital data from the handheld digital camera also includes an image of the item or device that is automatically delivered to the processing circuitry, and the processing circuitry and software is configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to identify specific visual elements of the image by matching the subject image to known images stored in an image library;

wherein the QR code, barcode or other coding technology identifies the area or areas of interest within the scene so that the ML or AI functions can focus on the specific area or areas of interest on the item or device that show the desired information and automatically save the information provided by the matched specific visual elements of the image or the image itself to an electronic record or database.

19. The automated data consolidation module of claim 18 , wherein the portable digital camera includes a pistol grip to assist in holding and aiming the camera at the subject item or device.

20. The automated data consolidation module of claim 18 , wherein the portable digital camera includes a laser pointer to assist in aiming the camera at the subject item or device.

21. The automated data consolidation module of claim 18 , wherein the portable digital camera includes a liquid crystal display (LCD) projector, a laser projector or cluster of lasers that can project an image onto an item or device after an image of the item or device is successfully acquired by the portable digital camera.

22. The automated data consolidation module of claim 18 , wherein the QR code, barcode or other coding technology is attached to a subject medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the location of the QR code, barcode or other coding technology becomes a target for the laser pointer so that the scene is standardized and the portable camera is oriented to match the similarly structured scenes and camera orientations of the known images stored in the image library.

23. The automated data consolidation module of claim 18 , wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” analysis.

24. The automated data consolidation module of claim 18 , wherein the handheld digital camera, processing circuitry and software may include machine vision capabilities for one or more of: pill identification, pill counting or “observation” of and verification of a patient taking their pills.

25. An automated data consolidation module including a handheld digital camera comprising:

a housing configured to house electronic and electromechanical medical equipment; and

at least one handheld digital camera; and

processing circuitry in wired or wireless electrical communication with the handheld digital camera to receive and record digital data produced by the handheld digital camera; and

the handheld digital camera, processing circuitry and software is configured to photograph, analyze and record at least one of a QR code, a barcode or other coding technology that is attached to a medical item or device, identifying at least one of the type of item or device, the manufacturer of the item or device and the model of the item or device; and

the digital data from the handheld digital camera also includes an image of the item or device that is automatically delivered to the processing circuitry, and the processing circuitry and software is configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to identify specific visual elements of the image by matching the subject image to known images stored in an image library;

wherein the QR code, barcode or other coding technology is attached to a subject medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the location of the QR code, barcode or other coding technology becomes a target for a laser pointer so that the scene is standardized and the camera is oriented to match the similarly structured scenes and camera orientations of the known images stored in the image library; and

automatically save the information provided by the matched specific visual elements of the image or the image itself to an electronic record or database.

26. The automated data consolidation module of claim 25 , wherein the portable digital camera includes a pistol grip to assist in holding and aiming the camera at the subject item or device.

27. The automated data consolidation module of claim 25 , wherein the QR code, barcode or other coding technology identifies the area or areas of interest within the scene so that the ML or AI functions can focus on the specific area or areas of interest on the item or device that show the desired information.

28. The automated data consolidation module of claim 25 , wherein the identified specific visual elements of the image constitute dose events or response events and the processing circuitry is configured to add time stamps or other indicators of time so that unrelated data can be temporally correlated during subsequent “big data” or clinical decision support analysis.

29. The automated data consolidation module of claim 25 , wherein the handheld digital camera, processing circuitry and software may include machine vision capabilities for one or more of: pill identification, pill counting or “observation” of and verification of a patient taking their pills.

30. The automated data consolidation module of claim 25 , wherein the portable digital camera, processing circuitry and software may include machine vision capabilities for measuring distance or movement where the precise distance of the camera from a subject item or device is critical for accuracy and the portable digital camera includes two or more laser pointers mounted on opposite sides of the portable camera, separated from each other by one or more inches and the pointers are aimed inward to form a triangle with the two or more laser beams crossing each other at a prescribed point or distance in front of the portable camera where they form a single dot on the item or device when the portable camera is at the precise distance from the item or device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2022
From: AUGUSTINE, SCOTT D.; AUGUSTINE, SUSAN D.; AUGUSTINE, GARRETT J.; AUGUSTINE, BRENT M.; AUGUSTINE, RYAN S.; ARNOLD, RANDALL C.
To: AUGUSTINE BIOMEDICAL + DESIGN, LLC
Reel/Frame 060627/0800 →
Continuity (16)
Continuation 17528832 · Nov 17, 2021
Continuation In Part 17376469 · Jul 15, 2021
Continuation In Part 17199722 · Mar 12, 2021
Continuation 17092681 · Nov 9, 2020
Continuation 16879406 · May 20, 2020
Continuation In Part 16601924 · Oct 15, 2019
Continuation 16593033 · Oct 4, 2019
Continuation 16364884 · Mar 26, 2019
Continuation In Part 15935524 · Mar 26, 2018
Continuation In Part 17873857
Continuation In Part 17245942 · Apr 30, 2021
Continuation In Part 17167681 · Feb 4, 2021
Continuation In Part 17092681 · Nov 9, 2020
Continuation 16879406 · May 20, 2020
Provisional Application 62782901 · Dec 20, 2018
Related Publication 20220362085A1 · Nov 17, 2022