IP Library › Granted Patent US 12,403,056
Granted Patent B2
US 12,403,056 · App. 19/077,404 · Granted Sep 2, 2025

Relocation module and methods for surgical equipment

Inventors: Scott D. Augustine (Deephaven, MN); Susan D. Augustine (Deephaven, MN); Garrett J. Augustine (Deephaven, MN); Brent M. Augustine (Savage, MN); Ryan S. Augustine (Minneapolis, MN); Randall C. Arnold (Minnetonka, MN)
Assignee: Augustine Biomedical + Design, LLC
A61G13/108A61B50/13A61B50/15A61M16/06A61M16/18G06T7/70G06V10/00G16H10/60G16H20/40G16H30/20A61B46/10A61B2050/155A61B90/50A61M16/01B01D46/0093G06F16/10G06F16/48G06T2207/20081G06T2207/30004G06T2210/41G16H20/17G16H30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,403,056
App. No.
19/077,404
Granted
Sep 2, 2025
Kind
B2
Abstract

Module for housing electronic and electromechanical medical equipment including a portable digital camera and processing circuitry with machine vision and machine learning software for automatically documenting healthcare events and healthcare equipment operations in the electronic health record.

Claims (53)

1. A network of automated data consolidation modules including a system to receive and record data produced by medical equipment, the network of automated data consolidation modules comprising:

two or more modules, each module comprising:

at least one digital camera configured to produce digital data; and

processing circuitry in wired or wireless electrical communication with the at least one digital camera to receive the digital data, wherein the digital data is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software is configured to interpret the digital data by performing at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of an image of the digital data by matching a subject image of the digital data to known images stored in an image library, to create matched identified specific visual elements of the image that show an operating parameter of a medical item or device performing a dose event or the specific visual elements of the image that show a measurement of a response event;

add time stamps or other indicators of time to the identified specific visual elements so that the digital data can be temporally correlated during subsequent big data or clinical decision support analysis; and

automatically save information provided by the matched identified specific visual elements of the image or the image itself to an electronic record or database;

wherein the at least one digital camera, processing circuitry and software are configured to photograph, analyze, and record an identifier including at least one of a quick response (QR) code, a barcode, or other identifier that is attached to a medical item or device, and wherein the QR code, barcode, or other identifier identifies at least one of a type of item or device, a manufacturer of the item or device, a model of the item or device, and a content of the item or device, narrowing the ML or AI analysis by directing the ML or Al analysis to a folder containing images of a specific type, manufacturer, model, or content of the item or device associated with the identifier; and

wherein the two or more modules are in electronic communication with each other forming the network of automated consolidation modules.

2. The network of automated data consolidation modules of claim 1 , wherein the two or more modules are connected by one or more hard wires to support electronic communications between the two or more modules.

3. The network of automated data consolidation modules of claim 1 , wherein the two or more modules are configured to wirelessly communicate therebetween.

4. The network of automated data consolidation modules of claim 1 , wherein the two or more modules are locatable at patient care locations throughout an institutional healthcare setting, including one or more of an operating room (OR), an emergency department (ED), an intensive care unit (ICU), a ward, a radiology department, a physical therapy department, a laboratory, and a long-term care department.

5. The network of automated data consolidation modules of claim 4 , wherein the two or more modules are configured to interface with a patient as the patient passes through the institutional healthcare setting, and wherein the two or more modules are configured to communicate with each other through the network of automated consolidation modules.

6. The network of automated data consolidation modules of claim 5 , wherein the two or more modules are configured to:

determine a first module of the two or more modules with which the patient is interfacing;

determine a second module of the two or more modules with which the patient was interfacing;

determine whether the first module has received a patient data set associated with the patient from the second module; and

transmit the patient data set from the first module to the second module when the first module has not received the patient data set from the second module.

7. The network of automated data consolidation modules of claim 5 , wherein the two or more modules interfacing with the patient are configured to communicate directly with each other through the network as the patient passes through the institutional healthcare setting, allowing transfer of a patient data set directly to a module of the two or more modules currently interfacing with the patient and avoiding transfer of data through an electronic medical record of the institutional healthcare setting.

8. The network of automated data consolidation modules of claim 1 , wherein the two or more modules are configured to operate as nodes in batch computing, and are configured to cooperate to break big computing tasks into multiple smaller computing tasks.

9. A network of automated data consolidation modules including a digital camera comprising:

two or more modules, each module comprising:

at least one digital camera; and

processing circuitry in wired or wireless electrical communication with the at least one digital camera to receive and record digital data produced by the at least one digital camera, wherein the at least one digital camera and the processing circuitry and software are configured to photograph, analyze, and record an identifier including at least one of a QR code, a barcode or other identifier that is attached to a medical item or device, the QR code, barcode, or other identifier identifying at least one of a type of the medical item or device, a manufacturer of the medical item or device, a model of the medical item or device, and a content of a medical item or device;

wherein the digital data from the at least one digital camera includes an image of the medical item or device that is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software are configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of the image by matching the image to known images stored in an image library to form matched specific visual elements of the image that show an operating parameter of a medical item or device performing a dose event or the specific visual elements of the image that show a measurement of a response event; and

automatically save information provided by the matched specific visual elements of the image or the image itself to an electronic record or database; and

wherein the QR code, barcode, or other identifier that is attached to the medical item or device narrows the ML and Al image analysis by directing a search of the ML or AI analysis to a folder containing images of the type, manufacturer, model, or content of the medical item or device; and

wherein the two or more modules are in electronic communication with each other forming the network of automated consolidation modules.

10. The network of automated data consolidation modules of claim 9 , wherein the two or more modules include hard wire electronic communications to each other.

11. The network of automated data consolidation modules of claim 9 , wherein the two or more modules are configured to wireless communicate with each other.

12. The network of automated data consolidation modules of claim 9 , wherein the two or more modules are locatable at patient care locations throughout an institutional healthcare setting, including one or more of an operating room (OR), an emergency department (ED), an intensive care unit (ICU), a ward, a radiology department, a physical therapy department, a laboratory, and a long-term care department.

13. The network of automated data consolidation modules of claim 12 ,

wherein the two or more modules interfacing with a patient as the patient passes through the institutional healthcare setting are configured to communicate with each other through the network of automated consolidation modules.

14. A network of automated data consolidation modules including a digital camera comprising;

two or more modules, each module comprising

at least one digital camera; and

processing circuitry in wired or wireless electrical communication with the at least one digital camera to receive and record digital data produced by the at least one digital camera, wherein the at least one digital camera and the processing circuitry and software are configured to photograph, analyze, and record an identifier including at least one of a QR code, a barcode or other identifier that is attached to a medical item or device, the QR code, barcode, or other identifier identifying at least one of a type of the medical item or device, a manufacturer of the medical item or device, a model of the medical item or device, and a content of a medical item or device;

wherein the digital data from the at least one digital camera includes an image of the medical item or device that is automatically delivered to the processing circuitry and software, and wherein the processing circuitry and software are configured to perform at least one of machine learning (ML) and artificial intelligence (AI) analysis to:

identify specific visual elements of the image by matching the image to known images stored in an image library to form matched specific visual elements of the image that show an operating parameter of a medical item or device performing one or more dose event or the specific visual elements of the image that show a measurement of one or more response event; and

automatically save information provided by the matched specific visual elements of the image or the image itself to an electronic record or database;

wherein the QR code, barcode, or other identifier that is attached to the medical item or device narrows the ML and Al image analysis by directing a search of the analysis to a folder containing images of the type, manufacturer, model, or content of the medical item or device;

wherein the QR code, barcode, or other identifier is attached to a subject medical item or device in a prescribed location on the medical item or device relative to the specific visual elements to be identified and the prescribed location of the QR code, barcode, or other identifier becomes a target for a laser pointer to standardize a scene and to orient the at least one digital camera to match similarly structured scenes and camera orientations of the known images stored in an image library; and

wherein the two or more modules are in electronic communication with each other to form the network of automated consolidation modules.

15. The network of automated data consolidation modules of claim 14 , wherein the two or more modules are configured to communicate with each other through one or more hard wire connection between the two or more modules.

16. The network of automated data consolidation modules of claim 14 , wherein the two or more modules are configured for wireless electronic communications therebetween.

17. The network of automated data consolidation modules of claim 14 , wherein the two or more modules are configured to:

determine a first module of the two or more modules with which a patient is interfacing;

determine a second module of the two or more modules with which the patient was interfacing;

determine whether the first module has received a patient data set associated with the patient from the second module; and

transmit the patient data set from the first module to the second module when the first module has not received the patient data set from the second module.

18. The network of automated data consolidation modules of claim 14 , wherein the two or more modules interfacing with a patient are configured to communicate directly with each other through the network of automated consolidation modules as the patient passes through a treatment facility, allowing a transfer of a complete data set regarding the patient directly to a module currently interfacing with the patient and avoiding the transfer of acute data through a hospital electronic medical record.

19. The network of automated data consolidation modules of claim 14 , wherein the two or more modules are configured to operate as nodes in batch computing, and are configured to cooperate to break big computing tasks into multiple smaller computing tasks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2025
From: AUGUSTINE, SCOTT D.; AUGUSTINE, SUSAN D.; AUGUSTINE, GARRETT J.; AUGUSTINE, BRENT M.; AUGUSTINE, RYAN S.; ARNOLD, RANDALL C.
To: AUGUSTINE BIOMEDICAL + DESIGN, LLC
Reel/Frame 070486/0049 →
Continuity (20)
Continuation 18943055 · Nov 11, 2024
Continuation 18598110 · Mar 7, 2024
Continuation 18142787 · May 3, 2023
Continuation 18099074 · Jan 19, 2023
Continuation 17874963 · Jul 27, 2022
Continuation 17873857 · Jul 26, 2022
Continuation 17528832 · Nov 17, 2021
Continuation In Part 17376469 · Jul 15, 2021
Continuation In Part 17245942 · Apr 30, 2021
Continuation In Part 17199722 · Mar 12, 2021
Continuation In Part 17167681 · Feb 4, 2021
Continuation 17092681 · Nov 9, 2020
Continuation In Part 17092681 · Nov 9, 2020
Continuation 16879406 · May 20, 2020
Continuation In Part 16601924 · Oct 15, 2019
Continuation 16593033 · Oct 4, 2019
Continuation 16364884 · Mar 26, 2019
Continuation In Part 15935524 · Mar 26, 2018
Provisional Application 62782901 · Dec 20, 2018
Related Publication 20250205098A1 · Jun 26, 2025
References Cited (75)
US 12178759B2 · Augustine et al. · 2024 [cited by applicant]
US 20050261551A1 · Couvillon, Jr. · 2005 [cited by examiner]
US 20070253596A1 · Murata · 2007 [cited by examiner]
US 20080314978A1 · Fedorko · 2008 [cited by examiner]
US 20090141947A1 · Kyyko · 2009 [cited by examiner]
US 20100172550A1 · Gilley · 2010 [cited by examiner]
US 20110054310A1 · Taylor · 2011 [cited by examiner]
US 20110305376A1 · Neff · 2011 [cited by examiner]
US 20120177256A1 · Keefe · 2012 [cited by examiner]
US 20130277430A1 · Zumsteg · 2013 [cited by examiner]
US 20150209510A1 · Burkholz · 2015 [cited by examiner]
US 20160225144A1 · Spahn · 2016 [cited by examiner]
US 20160247277A1 · Kriheli · 2016 [cited by examiner]
US 20170147787A1 · Albrecht · 2017 [cited by examiner]
US 20170185717A1 · Williams · 2017 [cited by examiner]
US 20170235913A1 · Aly · 2017 [cited by examiner]
US 20180169327A1 · Iddon · 2018 [cited by examiner]
US 20200004027A1 · Grootjans · 2020 [cited by examiner]
US 20230360790A1 · Burkholz · 2023 [cited by examiner]
“U.S. Appl. No. 18/830,087, Notice of Allowance mailed Feb. 18, 2025”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/830,087, Response filed Jan. 22, 2025 to Non Final Office Action mailed Oct. 23, 2024”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 18/943,055, Non Final Office Action mailed Dec. 23, 2024”, 20 pgs. [cited by applicant]
“U.S. Appl. No. 18/943,055, Notice of Allowance mailed Jan. 28, 2025”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/943,055, Response filed Jan. 2, 2025 to Non Final Office Action mailed Dec. 23, 2024”, 14 pgs. [cited by applicant]
“European Application Serial No. 21807934.1, Response filed Jan. 24, 2025 to Extended European Search Report mailed Sep. 4, 2024”, 41 pgs. [cited by applicant]
U.S. Appl. No. 15/935,524, now U.S. Pat. No. 10,512,191, filed Mar. 26, 2018, Relocation Module for Patient Monitors and Surgical Equipment. [cited by applicant]
U.S. Appl. No. 16/529,283, now U.S. Pat. No. 10,638,638, filed Aug. 1, 2019, Relocation Module for Patient Monitors and Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/222,711, filed Jul. 17, 2023, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 16/364,884, now U.S. Pat. No. 10,507,153, filed Mar. 26, 2019, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 16/593,033, now U.S. Pat. No. 10,653,577, filed Oct. 4, 2019, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 16/601,924, now U.S. Pat. No. 10,702,436, filed Oct. 15, 2019, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 16/885,715, now U.S. Pat. No. 10,888,482, filed May 28, 2020, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 17/103,426, now U.S. Pat. No. 11,045,377, filed Nov. 24, 2020, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 17/308,437, now U.S. Pat. No. 11,285,065, filed May 5, 2021, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 17/523,549, now U.S. Pat. No. 11,426,319, filed Nov. 10, 2021, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 17/873,907, now U.S. Pat. No. 11,642,270, filed Jul. 26, 2022, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 18/191,115, now U.S. Pat. No. 11,766,373, filed Mar. 28, 2023, Relocation Modules and Methods for Surgical Field. [cited by applicant]
U.S. Appl. No. 16/879,406, now U.S. Pat. No. 10,869,800, filed May 20, 2020, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/830,087, filed Sep. 10, 2024, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/092,681, now U.S. Pat. No. 10,993,865, filed Nov. 9, 2020, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/199,722, now U.S. Pat. No. 11,173,089, filed Mar. 12, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/375,546, now U.S. Pat. No. 11,291,602, filed Jul. 14, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/697,398, now U.S. Pat. No. 11,523,960, filed Mar. 17, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/875,055, now U.S. Pat. No. 11,583,461, filed Jul. 27, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/099,475, now U.S. Pat. No. 11,666,500, filed Jan. 20, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/136,141, now U.S. Pat. No. 11,752,056, filed Apr. 18, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/218,344, now U.S. Pat. No. 12,121,478, filed Jul. 5, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/167,681, now U.S. Pat. No. 11,160,710, filed Feb. 4, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/332,523, now U.S. Pat. No. 11,219,569, filed May 27, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/550,611, now U.S. Pat. No. 11,426,320, filed Dec. 14, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/862,971, now U.S. Pat. No. 11,583,459, filed Jul. 12, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/099,500, now U.S. Pat. No. 11,744,755, filed Jan. 20, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/203,297, now U.S. Pat. No. 12,257,192, filed May 30, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 19/010,846, filed Jan. 6, 2025, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/245,942, now U.S. Pat. No. 11,426,318, filed Apr. 30, 2021, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 17/873,975, now U.S. Pat. No. 11,583,460, filed Jul. 26, 2022, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 18/099,557, now U.S. Pat. No. 11,679,052, filed Jan. 20, 2023, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 18/142,776, now U.S. Pat. No. 11,766,372, filed May 3, 2023, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 18/218,350, filed Jul. 5, 2023, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 18/243,820, filed Sep. 8, 2023, Medical Module Including Automated Dose-Response Record System. [cited by applicant]
U.S. Appl. No. 17/376,469, now U.S. Pat. No. 11,219,570, filed Jul. 15, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/550,696, now U.S. Pat. No. 11,432,983, filed Dec. 14, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/874,998, now U.S. Pat. No. 11,564,856, filed Jul. 27, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/092,532, now U.S. Pat. No. 11,701,282, filed Jan. 3, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/203,936, filed May 31, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/243,223, filed Sep. 7, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/678,550, now U.S. Pat. No. 11,446,196, filed Feb. 23, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/528,832, now U.S. Pat. No. 11,432,982, filed Nov. 17, 2021, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/873,857, now U.S. Pat. No. 11,654,070, filed Jul. 26, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 17/874,963, now U.S. Pat. No. 11,648,166, filed Jul. 27, 2022, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/099,074, filed Jan. 19, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/142,787, now U.S. Pat. No. 12,023,281, filed May 3, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/242,894, filed Sep. 6, 2023, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/598,110, now U.S. Pat. No. 12,178,759, filed Mar. 7, 2024, Relocation Module and Methods for Surgical Equipment. [cited by applicant]
U.S. Appl. No. 18/943,055, filed Nov. 11, 2024, Relocation Module and Methods for Surgical Equipment [cited by applicant]
Cited By (1)
US 12,697,266