IP Library Granted Patent US 12,678,558
Granted Patent B2
US 12,678,558 · App. 17/756,339 · Granted Jul 14, 2026

System and method utilizing an integrated camera with a fluid injector

Inventors: Christopher Jubic (Valencia, PA); Daniel Manzo (Succasunna, NJ); Michael Haegg (McKees Rocks, PA); Nicholas Doolittle (Mars, PA); Joanne Hoener (New Kensington, PA); Linda Van Roosmalen (Gibsonia, PA); Nolan Zinn (McMurray, PA); David Griffiths (Pittsburgh, PA); Arthur Uber, III (Pittsburgh, PA); Ling Yu Hung (Pittsburgh, PA); Edward Prem (Allison Park, PA)
Assignee: BAYER HEALTHCARE LLC
A61M5/14566A61M5/427A61M2205/6018
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,678,558
App. No.
17/756,339
Granted
Jul 14, 2026
Kind
B2
Abstract

A fluid injector system configured for use in administering at least one fluid to a patient, the fluid injector system including at least one image capture device configured for capturing image data in an environment surrounding the fluid injector system; and a control device comprising at least one processor programmed or configured to receive, with the at least one processor, the image data captured by the at least one image capture device; determine, with the at least one processor, whether the received image data comprises at least one predetermined characteristic; and perform, with the at least one processor, at least one action in response to determining whether the received image data comprises at least one predetermined characteristic.

Claims (60)

1 . A fluid injector system configured for use in administering at least one fluid to a patient, the fluid injector system comprising:

at least one image capture device configured for capturing image data or video data in an environment surrounding the fluid injector system; and

a control device comprising at least one processor programmed or configured to:

receive, with the at least one processor, the image data or the video data captured by the at least one image capture device;

determine, with the at least one processor, whether the received image data or the received video data comprises at least one predetermined characteristic; and

perform, with the at least one processor, at least one action in response to determining whether the received image data or the received video data comprises at least one predetermined characteristic,

wherein the control device is configured to:

receive, from the at least one image capture device, facial identification information or biometric information regarding a user based on an image or a video of the user positioned near the fluid injector system and an image or a video of a fluid container positioned near the fluid injector system,

compare the received facial identification or biometric identification information regarding the user to a stored facial identification information or biometric identification information to determine whether the user is an individual authorized to use the fluid injector system, and

display the received image or video of the fluid container on the preferred user interface,

wherein the control device is configured to set the fluid injector system to a preferred user interface upon receiving a confirmed match between the received facial identification information or the biometric identification information and the stored facial identification information or the biometric identification information, in which the preferred user interface is a user interface configuration that has been previously set on the fluid injector system corresponding to a specific user.

2 . The fluid injector system of claim 1 , wherein the at least one image capture device is at least one camera, the at least one camera being at least one of: a) integrally formed with an injector housing of the fluid injector system, and b) operatively connected to an injector housing of the fluid injector system via an extendable member that permits the at least one camera to be moved relative to the injector housing.

3 . The fluid injector system of claim 1 , wherein the control device is configured to:

receive, from the at least one image capture device, facial identification information or biometric identification information regarding a patient based on an image or a video of the patient positioned near the fluid injector system, and

retrieve patient records for the patient based on the facial identification information or the biometric identification information received by the control device regarding the patient.

4 . The fluid injector system of claim 1 , wherein the at least one image capture device is configured to capture at least one image of at least one of a label on an object, a barcode on the object, a color of the object, a color of a fluid contained in the object, a shape of the object, and a QR code of the object positioned near an injector housing of the fluid injector system.

5 . The fluid injector system of claim 4 , wherein the control device is configured to automatically document details regarding the object based on the shape, the color, the label, the barcode, or the QR code captured by the at least one image capture device.

6 . The fluid injector system of claim 4 , wherein the control device is configured to forward information regarding the object identified by the at least one image capture device to a central database to assist in inventory tracking of the object.

7 . The fluid injector system of claim 4 , further comprising a projection system provided on the injector housing of the fluid injector system, wherein the projection system is configured to display information on at least one syringe held in the fluid injector system corresponding to the object identified by the at least one image capture device.

8 . The fluid injector system of claim 1 ,

wherein the at least one image capture device is configured to capture an image or a video of at least one hand gesture performed by an individual positioned near the fluid injector system,

wherein the control device is configured to receive hand gesture identification information from the at least one image capture device based on the at least one hand gesture performed by the individual, and

wherein the control device is configured to conduct a predetermined operation based on the hand gesture identification information received from the at least one image capture device.

9 . The fluid injector system of claim 1 , further comprising a near-infrared projection system that is configured to perform at least one of: a) vein mapping on a patient positioned near the fluid injector system, wherein the at least one image capture device is configured to capture at least one image or video of the vein mapping of the patient, and b) a pattern illumination on a limb of the patient, wherein the at least one image capture device is configured to capture at least one image or video of the pattern illuminated on the patient's limb.

10 . The fluid injector system of claim 1 , wherein the at least one image capture device is positioned and configured to capture at least one image or video of at least one of: a) an insertion site of an intravenous needle on a patient positioned near the fluid injector system, and b) a patient positioned near the fluid injector system to detect a change in blood flow of the patient.

11 . The fluid injector system of claim 10 , wherein the control device is configured to record the at least one image or video in a central database for future review upon an adverse event occurring in connection with use of the fluid injector system.

12 . A computer-implemented method for operating a fluid injector system configured for use in administering at least one fluid to a patient, the method comprising:

capturing, with at least one image capture device, facial identification information or biometric information regarding a user in an environment surrounding the fluid injector system and an image or a video of a fluid container positioned near the fluid injector system;

receiving, with a control device comprising at least one processor, the image data or the video data captured by the at least one image capture device regarding the user and the fluid container;

comparing the received facial identification or biometric identification information regarding the user to a stored facial identification information or biometric identification information to determine whether the user is an individual authorized to use the fluid injector system;

setting the fluid injector system to a preferred user interface upon receiving a confirmed match between the received facial identification information or the biometric identification information and the stored facial identification information or the biometric identification information, in which the preferred user interface is a user interface configuration that has been previously set on the fluid injector system corresponding to a specific user, and

displaying the received image or video of the fluid container on the preferred user interface.

13 . A computer program product for operating a fluid injector system configured for use in administering at least one fluid to a patient, the computer program product comprising at least one non-transitory computer-readable medium comprising one or more instructions that, when executed by at least one processor, cause the at least one processor to:

capture, with at least one image capture device, image data or video data in an environment surrounding the fluid injector system, wherein the at least one image capture device is at least one of: a) integrally formed with an injector housing of the fluid injector system, and b) operatively connected to an injector housing of the fluid injector system via an extendable member that permits the at least one image capture device to be moved relative to the injector housing;

receive the image data or the video data captured by the at least one image capture device;

determine whether the received image data or the received video data comprises at least one predetermined characteristic; and

perform at least one action in response to determining whether the received image data or the received video data comprises at least one predetermined characteristic;

wherein the one or more instructions further cause the at least one processor to:

receive, with a control device of the fluid injector system and from the at least one image capture device, facial identification information or biometric identification information regarding a user based on an image or a video of the user positioned near the fluid injector system and image or video data regarding a fluid container positioned near the fluid injector system,

compare, using the control device, the received facial identification information or biometric identification information regarding the user to a stored facial identification information or biometric identification information to determine whether the user is an individual authorized to use the fluid injector system,

upon receiving a confirmed match between the received facial identification information or biometric identification information and the stored facial identification information or biometric identification information, set the fluid injector system to a preferred user interface in which the preferred user interface is a user interface configuration that has been previously set on the fluid injector system corresponding to a specific user, and

display the received image or video data of the fluid container on the preferred user interface.

14 . The computer program product of claim 13 , wherein the one or more instructions further cause the at least one processor to:

receive, using the control device and from the at least one image capture device, facial identification information or biometric identification information regarding a patient based on an image or a video of the patient positioned near the fluid injector system, and

retrieve, using the control device, patient records for the patient based on the facial identification information or biometric identification information received by the control device regarding the patient.

15 . The computer program product of claim 13 , wherein the one or more instructions further cause the at least one processor to:

capture, with the at least one image capture device, at least one image of at least one of a label on an object, a barcode on the object, a color of the object, a color of a fluid contained in the object, a shape of the object, and a QR code of the object positioned near an injector housing of the fluid injector system;

automatically document, using the control device, details regarding the object based on the shape, the color, the label, the barcode, or the QR code captured by the at least one image capture device; and

forward, using the control device, information regarding the object identified by the at least one image capture device to a central database to assist in inventory tracking of the object.

16 . The computer program product of claim 13 ,

wherein the fluid injector system further comprises a projection system provided on the injector housing of the fluid injector system, and

wherein the one or more instructions further cause the at least one processor to display, using the projection system, information on at least one syringe held in the fluid injector system corresponding to the object identified by the at least one image capture device.

17 . The computer program product of claim 13 , wherein the one or more instructions further cause the at least one processor to:

capture, using the at least one image capture device, an image or a video of at least one hand gesture performed by an individual positioned near the fluid injector system,

receive, using the control device, hand gesture identification information from the at least one image capture device based on the at least one hand gesture performed by the individual, and

conduct, using the control device, a predetermined operation based on the hand gesture identification information received from the at least one image capture device.

18 . The computer program product of claim 13 ,

wherein the fluid injector system further comprises a near-infrared projection system that is configured to perform at least one of: a) vein mapping on a patient positioned near the fluid injector system, wherein the one or more instructions further cause the at least one processor to capture, using the at least one image capture device, at least one image or video of the vein mapping of the patient, and b) pattern illumination on a limb of the patient, wherein one or more instructions further cause the at least one processor to capture, using the at least one image capture device, at least one image or video of the pattern illuminated on the patient's limb.

19 . The computer program product of any of claim 13 , wherein the one or more instructions further cause the at least one processor to configure the at least one image capture device to capture at least one image or video of at least one of: a) an insertion site of an intravenous needle on a patient positioned near the fluid injector system, and b) a patient positioned near the fluid injector system to detect a change in blood flow of the patient.

20 . The computer program product of claim 13 , wherein the one or more instructions further cause the at least one processor to record, using the control device, the image data in a central database for future review upon an adverse event occurring in connection with use of the fluid injector system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2022
From: JUBIC, CHRISTOPHER; MANZO, DANIEL; HAEGG, MICHAEL; DOOLITTLE, NICHOLAS; HOENER, JOANNE; VAN ROOSMALEN, LINDA; ZINN, NOLAN; GRIFFITHS, DAVID; UBER, ARTHUR, III; HUNG, LING YU; PREM, EDWARD
To: BAYER HEALTHCARE LLC
Reel/Frame 059990/0413 →
Continuity (2)
Provisional Application 62939878 · Nov 25, 2019
Related Publication 20230173172A1 · Jun 8, 2023
References Cited (65)
US 7553294B2 · Lazzaro et al. · 2009 [cited by applicant]
US 7563249B2 · Schriver et al. · 2009 [cited by applicant]
US 8452380B2 · Williams et al. · 2013 [cited by applicant]
US 8945051B2 · Schriver et al. · 2015 [cited by applicant]
US 9173995B1 · Tucker et al. · 2015 [cited by applicant]
US 9918687B2 · Nemoto · 2018 [cited by applicant]
US 10124110B2 · Dedig et al. · 2018 [cited by applicant]
US 10201666B2 · Cowan et al. · 2019 [cited by applicant]
US 10507319B2 · Haury et al. · 2019 [cited by applicant]
US 10583256B2 · Berry et al. · 2020 [cited by applicant]
US 20010033372A1 · Dragotta · 2001 [cited by examiner]
US 20070299687A1 · Palmer · 2007 [cited by examiner]
US 20080191013A1 · Liberatore · 2008 [cited by applicant]
US 20120185267A1 · Kamen · 2012 [cited by examiner]
US 20130229344A1 · Ivanich · 2013 [cited by examiner]
US 20140115101A1 · Wittner et al. · 2014 [cited by applicant]
US 20150209510A1 · Burkholz · 2015 [cited by examiner]
US 20150274329A1 · Harp · 2015 [cited by examiner]
US 20160203360A1 · Alvarez · 2016 [cited by examiner]
US 20160213843A1 · Despa · 2016 [cited by examiner]
US 20160228633A1 · Welsch et al. · 2016 [cited by applicant]
US 20160331951A1 · Sokolov et al. · 2016 [cited by applicant]
US 20170056604A1 · Cowan · 2017 [cited by examiner]
US 20170106142A1 · Hochman · 2017 [cited by examiner]
US 20170168688A1 · Yuds · 2017 [cited by examiner]
US 20170245816A1 · Flohr et al. · 2017 [cited by applicant]
US 20180140784A1 · Haverman et al. · 2018 [cited by applicant]
US 20180161496A1 · Berry et al. · 2018 [cited by applicant]
US 20190130792A1 · Rios · 2019 [cited by examiner]
US 20190142274A1 · Addison et al. · 2019 [cited by applicant]
US 20200066389A1 · Prince · 2020 [cited by examiner]
US 20200237225A1 · Addison et al. · 2020 [cited by applicant]
US 20200237237A1 · Mozdzierz · 2020 [cited by applicant]
US 20200268281A1 · Jacquel et al. · 2020 [cited by applicant]
US 20200289024A1 · Addison et al. · 2020 [cited by applicant]
US 20200356249A1 · Hunter · 2020 [cited by examiner]
US 20210142030A1 · Gupta · 2021 [cited by examiner]
US 20210361863A1 · Burgess · 2021 [cited by examiner]
US 20230173172A1 · Jubic · 2023 [cited by examiner]
CN 105993038A · 2016 [cited by applicant]
CN 206833462U · 2018 [cited by applicant]
CN 207012242U · 2018 [cited by applicant]
CN 207745385U · 2018 [cited by applicant]
JP 2004289720A · 2004 [cited by applicant]
JP 2005062994A · 2005 [cited by applicant]
JP 4892564B2 · 2012 [cited by applicant]
WO 2005076810A2 · 2005 [cited by applicant]
WO 2014100687A2 · 2014 [cited by applicant]
WO 2015117852A1 · 2015 [cited by applicant]
WO 2016112163A1 · 2016 [cited by applicant]
WO 2017040152A1 · 2017 [cited by applicant]
WO 2017040154A1 · 2017 [cited by applicant]
WO 2018075386A1 · 2018 [cited by applicant]
WO 2019035986A1 · 2019 [cited by applicant]
WO 2019199644A1 · 2019 [cited by applicant]
“International Preliminary Report on Patentability from PCT Application No. PCT/US2020061733”, Jun. 9, 2022. [cited by applicant]
Balakrishnan; et al, “Detecting Pulse from Head Motions in Video”, IEEE Proceed CVPR, 2013, 3430-3437. [cited by applicant]
Booij; et al, “Accuracy of automated patient positioning in CT using a 3D camera for body contour detection”, European Radiology, Oct. 10, 2018, 29, 2079-2088. [cited by applicant]
Chandler; David L., “Your vital signs, on camera: MIT team develops system for continuous medical monitoring using widely available video technology”, MIT News, Massachusetts Institute of Technology, Oct. 4, 2010. [cited by applicant]
Dougherty; et al, “Using Google Glass in Nonsurgical Medical Settings: Systematic Review”, JMIR Mhealth and Uhealth, 2017, vol. 5 Issue 10 e159, 1-22. [cited by applicant]
“FAST Integrated Workflow”, Siemens Healthineers USA, 2019. [cited by applicant]
McCarthy; Colin., “Virtual reality enters the IR suite”, Interventional News, Feb. 21, 2018. [cited by applicant]
Ozdogan; Hakan, “The future of healthcare: Smart sensors and digital biomarkers”, Dec. 2019. [cited by applicant]
Ramamurthy; et al, “Integrating Patient Digital Photographs with Medical Imaging Examinations”, J Digit Imaging, Feb. 14, 2013, 26, 875-885. [cited by applicant]
Wu Hao-Yu; et al, “Eulerian Video Magnification for Revealing Subtle Changes in the World”, Jul. 4, 2012, vol. 31 No. 65, 18. [cited by applicant]