IP Library › Granted Patent US 11,682,478
Granted Patent B2
US 11,682,478 · App. 16/718,519 · Granted Jun 20, 2023

Identification and verification of medication

Inventors: Andrew J. Truscott (Spring, TX); Ethan Bischoff (St. Paul, MN); Christopher Donnelly (Winnetka, IL); Jean M. Becker (Eden Prairie, MN)
Assignee: Accenture Global Solutions Limited
G16H20/13G06N20/00G06T7/0002G16H10/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,478
App. No.
16/718,519
Granted
Jun 20, 2023
Kind
B2
Abstract

A device obtains prescription information relating to a medication in a container. The device causes a camera device of the device to obtain image data relating to the medication and a weighing device of the device to obtain weight data relating the medication. The device sends the prescription information, the image data, and the weight data to a different device to cause the different device to verify the medication using a machine learning model. The device receives information concerning the medication and automatically generates, based on the information concerning the medication, a message concerning the medication, wherein the message includes instructions on how much of the medication a user of the device is to take. The device causes the device or an additional device to present the message.

Claims (151)

1. A method, comprising:

obtaining, by a device, prescription information relating to a medication in a container,

wherein the prescription information includes information regarding an identifier of the medication, a dose of the medication, and an amount of the medication;

causing, by the device and after obtaining the prescription information, a camera device of the device to obtain image data relating to the medication;

causing, by the device and after obtaining the prescription information, a weighing device of the device to obtain weight data relating to the medication;

sending, by the device and via a network, the prescription information, the image data, and the weight data to a different device to cause the different device to verify the medication using a machine learning model,

wherein the device and the different device are connected via the network;

receiving, by the device via the network and after sending the prescription information, the image data and the weight data to the different device, information concerning the medication from the different device;

automatically generating, by the device and based on the information concerning the medication, a message concerning the medication,

wherein the message includes instructions regarding a quantity of the medication a user of the device is to take; and

at least one of:

causing, by the device, a speaker of the device to present the message, or

providing, by the device and for display, the message.

2. The method of claim 1 , wherein the image data is first image data and the weight data is first weight data; and

wherein the method further comprises:

causing, after at least one of causing the speaker to present the message or providing, for display, the message, the camera device to obtain second image data relating to the medication;

causing, after at least one of causing the speaker to present the message or providing, for display, the message, the weighing device to obtain second weight data concerning the medication;

sending the second image data and the second weight data to the different device to cause the different device to determine an amount of medication removed from the container using the machine learning model;

receiving, after sending the second image data and the second weight data to the different device, additional information concerning the medication;

automatically generating, based on the additional information concerning the medication, an additional message concerning the medication,

wherein the additional message includes information on whether the amount of medication removed from the container is correct; and

at least one of:

causing the speaker of the device to present the additional message, or

providing, for display, the additional message.

3. The method of claim 1 , further comprising:

causing the camera device to determine when the container is in a field of view of the camera device; and

causing, based on the container being in the field of view, the camera device to focus on the medication in the container; and

wherein causing the camera device to obtain the image data relating to the medication comprises:

causing, based on causing the camera device to focus on the medication in the container, the camera device to capture the image data relating to the medication.

4. The method of claim 1 , further comprising:

generating, based on the message, voice data using a text-to-speech technique; and

wherein causing the speaker of the device to present the message comprises:

causing the speaker of the device to emit the voice data.

5. The method of claim 1 , further comprising:

receiving, via a user interface of the device, an identification string; and

performing, based on the identification string, a lookup in a data structure; and

wherein obtaining the prescription information comprises:

obtaining the prescription information based on performing the lookup in the data structure.

6. The method of claim 1 , further comprising:

causing the camera device to obtain an image of a label of the container;

processing the image of the label to determine one or more of a bar code or a quick response (QR) code; and

performing, based on one or more of the bar code or the QR code, a lookup in a data structure; and

wherein obtaining the prescription information comprises:

obtaining the prescription information based on performing the lookup in the data structure.

7. The method of claim 1 , further comprising:

causing the camera device to obtain additional image data relating to a seal of the container;

sending the additional image data to the different device to cause the different device to determine an integrity of the seal;

receiving, after sending the additional image data, information concerning the integrity of the seal from the different device;

generating, based on the information concerning the integrity of the seal, an additional message concerning the integrity of the seal; and

at least one of:

providing, for display, the additional message, or

causing the speaker to present the additional message.

8. A device, comprising:

one or more memories; and

one or more processors communicatively coupled to the one or more memories, configured to:

obtain prescription information relating to a medication in a container,

wherein the prescription information includes information regarding an identifier of the medication, a dose of the medication, and an amount of the medication;

cause, after obtaining the prescription information, a camera device of the device to obtain image data relating to the medication;

cause, after obtaining the prescription information, a weighing device of the device to obtain weight data relating to the medication;

send, via a network, the prescription information, the image data, and the weight data to a different device to cause the different device to verify the medication using a machine learning model,

wherein the device and the different device are connected via the network;

receive, after sending the prescription information, the image data and the weight data to the different device, information concerning the medication from the different device;

automatically generate, based on the information concerning the medication, a message concerning the medication,

wherein the message includes instructions regarding a quantity of the medication a user of the device is to take; and

at least one of:

cause a speaker of the device to present the message, or

provide, for display, the message.

9. The device of claim 8 , wherein the image data is first image data and the weight data is first weight data; and

wherein the one or more processors are further configured to:

cause, after at least one of causing the speaker to present the message or providing, for display, the message, the camera device to obtain second image data relating to the medication;

cause, after at least one of causing the speaker to present the message or providing, for display, the message, the weighing device to obtain second weight data concerning the medication;

send the second image data and the second weight data to the different device to cause the different device to determine an amount of medication removed from the container using the machine learning model;

receive, after sending the second image data and the second weight data to the different device, additional information concerning the medication;

automatically generate, based on the additional information concerning the medication, an additional message concerning the medication,

wherein the additional message includes information on whether the amount of medication removed from the container is correct; and

at least one of:

cause the speaker of the device to present the additional message, or

provide, for display, the additional message.

10. The device of claim 8 , wherein the one or more processors are further configured to:

cause the camera device to determine when the container is in a field of view of the camera device; and

cause, based on the container being in the field of view, the camera device to focus on the medication in the container; and

wherein the one or more processors, when causing the camera device to obtain the image data relating to the medication, are configured to:

cause, based on causing the camera device to focus on the medication in the container, the camera device to capture the image data relating to the medication.

11. The device of claim 8 , wherein the one or more processors are further configured to:

generate, based on the message, voice data using a text-to-speech technique; and

wherein the one or more processors, when causing the speaker of the device to present the message, are configured to:

cause the speaker of the device to emit the voice data.

12. The device of claim 8 , wherein the one or more processors are further configured to:

receive, via a user interface of the device, an identification string; and

perform, based on the identification string, a lookup in a data structure; and

wherein the one or more processors, when obtaining the prescription information, are configured to:

obtain the prescription information based on performing the lookup in the data structure.

13. The device of claim 8 , wherein the one or more processors are further configured to:

cause the camera device to obtain an image of a label of the container;

process the image of the label to determine one or more of a bar code or a quick response (QR) code; and

perform, based on one or more of the bar code or the QR code, a lookup in a data structure; and

wherein the one or more processors, when obtaining the prescription information, are configured to:

obtain the prescription information based on performing the lookup in the data structure.

14. The device of claim 8 , wherein the one or more processors are further configured to:

cause the camera device to obtain additional image data relating to a seal of the container;

send the additional image data to the different device to cause the different device to determine an integrity of the seal;

receive, after sending the additional image data, information concerning the integrity of the seal from the different device;

generate, based on the information concerning the integrity of the seal, an additional message concerning the integrity of the seal; and

at least one of:

cause the speaker to present the additional message, or

provide, for display, the additional message.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:

obtain prescription information relating to a medication in a container,

wherein the prescription information includes information regarding an identifier of the medication, a dose of the medication, and an amount of the medication;

cause, after obtaining the prescription information, a camera device of the device to obtain image data relating to the medication;

cause, after obtaining the prescription information, a weighing device of the device to obtain weight data relating to the medication;

send, via a network, the prescription information, the image data, and the weight data to a different device to cause the different device to verify the medication using a machine learning model,

wherein the device and the different device are connected via the network;

receive, via the network, after sending the prescription information, the image data and the weight data to the different device, information concerning the medication from the different device;

automatically generate, based on the information concerning the medication, a message concerning the medication,

wherein the message includes instructions on how much of the medication a user of the device is to take; and

at least one of:

cause a speaker of the device to present the message, or

provide, for display, the message.

16. The non-transitory computer-readable medium of claim 15 , wherein the image data is first image data and the weight data is first weight data; and

wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

cause, after at least one of causing the speaker to present the message or providing, for display, the message, the camera device to obtain second image data relating to the medication;

cause, after at least one of causing the speaker to present the message or providing, for display, the message, the weighing device to obtain second weight data concerning the medication;

send the second image data and the second weight data to the different device to cause the different device to determine an amount of medication removed from the container using the machine learning model;

receive, after sending the second image data and the second weight data to the different device, additional information concerning the medication;

automatically generate, based on the additional information concerning the medication, an additional message concerning the medication,

wherein the additional message includes information on whether the amount of medication removed from the container is correct; and

at least one of:

cause the speaker of the device to present the additional message, or

provide, for display, the additional message.

17. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

cause the camera device to determine when the container is in a field of view of the camera device; and

cause, based on the container being in the field of view, the camera device to focus on the medication in the container; and

wherein the one or more instructions, that cause the one or more processors to cause the camera device to obtain the image data relating to the medication, cause the one or more processors to:

cause, based on causing the camera device to focus on the medication in the container, the camera device to capture the image data relating to the medication.

18. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

generate, based on the message, voice data using a text-to-speech technique; and

wherein the one or more instructions, that cause the one or more processors to cause the speaker of the device to present the message, cause the one or more processors to:

cause the speaker of the device to emit the voice data.

19. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

receive, via a user interface of the device, an identification string; and

perform, based on the identification string, a lookup in a data structure; and

wherein the one or more instructions, that cause the one or more processors to obtain the prescription information, cause the one or more processors to:

obtain the prescription information based on performing the lookup in the data structure.

20. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

cause the camera device to obtain an image of a label of the container;

process the image of the label to determine one or more of a bar code or a quick response (QR) code; and

perform, based on one or more of the bar code or the QR code, a lookup in a data structure; and

wherein the one or more instructions, that cause the one or more processors to obtain the prescription information, cause the one or more processors to:

obtain the prescription information based on performing the lookup in the data structure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: TRUSCOTT, ANDREW J.; BISCHOFF, ETHAN; DONNELLY, CHRISTOPHER; BECKER, JEAN M.
To: ACCENTURE GLOBAL SOLUTIONS LIMITED
Reel/Frame 051318/0098 →
Continuity (3)
Division 16276059 · Feb 14, 2019
Provisional Application 62769132 · Nov 19, 2018
Related Publication 20200160960A1 · May 21, 2020