AUTOMATED MEDICATION AUTHENTICITY AND USAGE VERIFICATION
Systems and methods for remote verification of medication administration are disclosed herein. In some aspects, a system receives a request for verifying administration for a medication including an image. The system may identify regions of interest that include medication identifying features from the image. The system may compare a feature representation of each medication identifying feature to reference feature representations managed by authorized operator devices. The system may identify a matching medication and trigger an image acquisition session to obtain a time-series of images, at least one of the images comprising a patient in proximity to the medication. The system may extract patient features and a posture of the medication in relation to the patient and input the extracted data and entity-issued administration instructions into a model to obtain a set of patient-specific administration instructions.
1 . A system for remote verification of medication administration, the system comprising:
one or more processors; and
one or more memories configured to store instructions that when executed by the one or more processors cause the system to:
receive, from a remote device, a request for verifying administration for a medication, the request comprising at least one image;
identify one or more regions of interest from the at least one image, wherein the one or more regions of interest each comprise a medication identifying feature;
compare a feature representation of each medication identifying feature to a plurality of reference feature representations corresponding to one or more medications and/or medication packaging, wherein each reference feature representation is centrally managed by one or more authorized operator devices;
identify, based on the comparing, a matching medication associated with a medication providing entity and corresponding administration instructions;
trigger an image acquisition session at the remote device to obtain a time-series of images, at least one of the images comprising at least a portion of a patient in proximity to the medication;
extract, based on the time-series of images, (i) one or more patient features and (ii) a posture of the medication in relation to the patient;
input the one or more patient features, the posture of the medication in relation to the patient, and administration instructions into a machine learning model to obtain a set of patient-specific administration instructions to direct a user to administer the medication; and
transmit, to the remote device, one or more commands for displaying the set of patient-specific administration instructions.
2 . The system of claim 1 , wherein the medication identifying feature comprises at least one of: a medication, an injection device, a medication package, a machine-readable code, or a tamper-evident feature.
3 . The system of claim 1 , wherein the instructions further cause the one or more processors to perform operations comprising:
triggering a second image acquisition session at the remote device to obtain a second time-series of images;
determining, based on the second time-series of images, a trajectory of the medication towards the patient;
responsive to determining that the trajectory is inconsistent with a predefined administration path, generating and transmitting, to the remote device, a corrective instruction.
4 . The system of claim 1 , wherein the feature representation comprises at least one of: a hash value, a vector embedding, or a set of extracted visual features.
5 . The system of claim 1 , wherein the instructions for identifying the corresponding administration instructions further cause the system to:
generate a search query for retrieving administration instructions from a remote database, wherein the query comprises an identifier of the medication;
transmit the query to the remote database; and
receive, from the remote database, a set administration instructions.
6 . The system of claim 1 , wherein the instructions for identifying the corresponding administration instructions further cause the one system to:
identify a URL associated with the medication providing entity;
generate a request to scrape data at the URL, wherein the request comprises an identifier of the medication;
receive scraped data from the URL; and
generate a set of administration instructions based on the scraped data.
7 . A method for remote verification of medication administration, the method comprising:
receiving, from a remote device, a request for verifying administration for a medication, the request comprising at least one image;
identifying one or more regions of interest from the at least one image, wherein the one or more regions of interest each comprise a medication identifying feature;
comparing a feature representation of each medication identifying feature to a plurality of reference feature representations corresponding to one or more medications and/or medication packaging, wherein each reference feature representation is centrally managed by one or more authorized operator devices;
identifying, based on the comparing, a matching medication associated with a medication providing entity and corresponding administration instructions;
triggering an image acquisition session at the remote device to obtain a time-series of images, at least one of the images comprising at least a portion of a patient in proximity to the medication;
extracting, based on the time-series of images, (i) one or more patient features and (ii) a posture of the medication in relation to the patient;
inputting the one or more patient features, the posture of the medication in relation to the patient, and administration instructions into a machine learning model to obtain a set of patient-specific administration instructions to direct a user to administer the medication; and
transmitting, to the remote device, one or more commands for displaying the set of patient-specific administration instructions.
8 . The method of claim 7 , wherein the medication identifying feature comprises at least one of: a medication, an injection device, a medication package, a machine-readable code, or a tamper-evident feature.
9 . The method of claim 7 , further comprising:
triggering a second image acquisition session at the remote device to obtain a second time-series of images;
determining, based on the second time-series of images, a trajectory of the medication towards the patient;
responsive to determining that the trajectory is inconsistent with a predefined administration path, generating and transmitting, to the remote device, a corrective instruction.
10 . The method of claim 7 , wherein the feature representation comprises at least one of: a hash value, a vector embedding, or a set of extracted visual features.
11 . The method of claim 7 , wherein identifying the corresponding administration instructions comprises:
generating a search query for retrieving administration instructions from a remote database, wherein the search query comprises an identifier of the medication;
transmitting the search query to the remote database; and
receive, from the remote database, a set of administration instructions.
12 . The method of claim 7 , wherein identifying the corresponding administration instructions comprises:
identifying a URL associated with the medication providing entity;
generating a request to scrape data at the URL, wherein the request comprises an identifier of the medication;
receiving scraped data from the URL; and
generating a set of administration instructions based on the scraped data.
13 . One or more non-transitory, computer-readable media storing instructions thereon, where the instructions when executed by one or more processors cause operations comprising:
receiving, from a remote device, a request for verifying administration for a medication, the request comprising at least one image;
identifying one or more regions of interest from the at least one image, wherein the one or more regions of interest each comprise a medication identifying feature;
comparing a feature representation of each medication identifying feature to a plurality of reference feature representations corresponding to one or more medications and/or medication packaging;
identifying, based on the comparing, a matching medication associated with a medication providing entity and corresponding administration instructions; and
transmitting one or more commands for triggering an image acquisition session at the remote device to obtain a time-series of images, at least one of the images comprising at least a portion of a patient in proximity to the medication.
14 . The one or more non-transitory, computer-readable media of claim 13 , wherein the operations further comprise:
extracting, based on the time-series of images, (i) one or more patient features and (ii) a posture of the medication in relation to the patient;
inputting the one or more patient features, the posture of the medication in relation to the patient, and administration instructions into a machine learning model to obtain a set of patient-specific administration instructions to direct a user to administer the medication; and
transmitting, to the remote device, one or more commands for displaying the set of patient-specific administration instructions.
15 . The one or more non-transitory, computer-readable media of claim 14 , wherein the medication identifying feature comprises at least one of: a medication, a medication package, a machine-readable code, or a tamper-evident feature.
16 . The one or more non-transitory, computer-readable media of claim 14 , wherein the operations further comprise:
determining an authenticity of the image, wherein determining the authenticity comprises analyzing one or more of: a capture time, a shutter speed, a location, a user device model of a remote device used for capturing the at least one image, a make of the remote device, a focal length, a resolution, a lens, or an f-stop.
17 . The one or more non-transitory, computer-readable media of claim 14 , wherein the feature representation comprises at least one of: a hash value, a vector embedding, or a set of extracted visual features.
18 . The one or more non-transitory, computer-readable media of claim 14 , wherein the operations for identifying the corresponding administration instructions further comprise:
generating and transmitting a search query for retrieving administration instructions from a remote database, wherein the search query comprises an identifier of the medication; and
receive, from the remote database, a set of administration instructions.
19 . The one or more non-transitory, computer-readable media of claim 14 , wherein the operations for identifying the corresponding administration instructions further comprise:
identifying a URL associated with the medication providing entity;
generating a request to scrape data at the URL, wherein the request comprises an identifier of the medication;
receiving scraped data from the URL; and
generating a set of administration instructions based on the scraped data.
20 . The one or more non-transitory, computer-readable media of claim 13 , wherein each reference feature representation is centrally managed by one or more authorized operator devices.