Methods and systems for image processing to present data in augmented reality

1 . A system comprising:

one or more processors communicatively coupled to a camera and a display, the one or more processors configured to:

identify a unique identifier on a label of a prescription pill bottle or a prescription drug container using a live stream of images generated by the camera; and

request additional data from a pharmacy benefit manager using the unique identifier; and

an augmented reality subsystem communicatively coupled to the one or more processors, the augmented reality subsystem configured to:

direct the display to present the additional data from the pharmacy benefit manager in an augmented reality foreground image that is displayed over the live stream of images generated by the camera such that the additional data is displayed adjacent to the prescription pill bottle or the prescription drug container;

direct the display to present interactive portions in the augmented reality foreground image over the live stream of images, the interactive portions including (i) a request to refill a prescription drug, (ii) identification of a doctor that prescribed the prescription drug, and (iii) drug interaction data about the prescription drug; and

responsive to detecting a user selection of one or more of the interactive portions in the augmented reality foreground image, implement an action that includes one or more of transmitting a request to refill the prescription drug, calling the doctor that previously prescribed the prescription drug, or directing the display to present the drug interaction data about the prescription drug,

wherein the prescription drug is a first prescription drug, and the drug interaction data includes at least one of a negative interaction, a positive interaction, or a benign interaction between one or more of (a) the first prescription drug and a second prescription drug, (b) the first prescription drug and an over-the-counter drug, (c) the first prescription drug and a vitamin, (d) the first prescription drug and a medical herb, or (e) the first prescription drug and alcohol.

2 . The system of claim 1 , wherein the one or more processors are configured to identify the prescription pill bottle or the prescription drug container in the live stream of images generated by the camera.

3 . The system of claim 1 , wherein the one or more processors are configured to examine the live stream of images generated by the camera to determine whether the prescription pill bottle or the prescription drug container appears in the live stream of images.

4 . The system of claim 1 , wherein the one or more processors are configured to identify the unique identifier by using optical character recognition to determine a prescription number printed on the label.

5 . The system of claim 1 , wherein the one or more processors are configured to identify the unique identifier by locating a glyph that is on the label adjacent to the unique identifier.

6 . The system of claim 1 , wherein the one or more processors are configured to identify the unique identifier by de-warping one or more of the images of the live stream and then applying optical character recognition to identify the unique identifier.

7 . The system of claim 1 , wherein the augmented reality subsystem is configured to direct the display to continue presenting the additional data on the live stream of images generated by the camera and displayed on the display as a field of view of the camera changes.

8 . A method comprising:

identifying a unique identifier on a label of a prescription pill bottle or a prescription drug container using a live stream of images generated by a camera;

requesting additional data from a pharmacy benefit manager using the unique identifier;

displaying interactive portions and the additional data from the pharmacy benefit manager in an augmented reality foreground image that is displayed over the live stream of images generated by the camera such that the additional data is displayed adjacent to the prescription pill bottle or prescription drug container, the interactive portions configured to be displayed including (i) a request to refill a prescription drug, (ii) identification of a doctor that prescribed the prescription drug, and (iii) drug interaction data about the prescription drug;

detecting a user selection of one or more of the interactive portions in the augmented reality foreground image; and

implementing an action responsive to detecting the user selection, the action that is implemented including one or more of transmitting a request to refill the prescription drug, calling the doctor that previously prescribed the prescription drug, or directing the display to present the drug interaction data about the prescription drug,

wherein the prescription drug is a first prescription drug, and the drug interaction data includes at least one of a negative interaction, a positive interaction, or a benign interaction between one or more of (a) the first prescription drug and a second prescription drug, (b) the first prescription drug and an over-the-counter drug, (c) the first prescription drug and a vitamin, (d) the first prescription drug and a medical herb, or (e) the first prescription drug and alcohol.

9 . The method of claim 8 , further comprising:

identifying the prescription pill bottle or the prescription drug container in the live stream of images generated by the camera.

10 . The method of claim 8 , further comprising:

examining the live stream of images generated by the camera to determine whether the prescription pill bottle or the prescription drug container appears in the live stream of images.

11 . The method of claim 8 , wherein the unique identifier is identified using optical character recognition to determine a prescription number printed on the label.

12 . The method of claim 8 , wherein the unique identifier is identified by locating a glyph that is on the label adjacent to the unique identifier.

13 . The method of claim 8 , wherein the unique identifier is identified by de-warping one or more of the images of the live stream and then applying optical character recognition to identify the unique identifier.

14 . The method of claim 8 , wherein the additional data is displayed over the live stream of images generated by the camera as a field of view of the camera changes.

15 . A system comprising:

one or more processors communicatively coupled to a camera and a display, the one or more processors configured to:

identify a prescription drug container in real-time images generated by the camera;

de-warp at least one of the real-time images to identify a unique identifier on a label of the prescription drug container; and

request additional data from a pharmacy benefit manager using the unique identifier; and

an augmented reality subsystem communicatively coupled to the one or more processors, the augmented reality subsystem configured to:

direct the display to present interactive portions and the additional data from the pharmacy benefit manager in an augmented reality foreground image that is displayed over the real-time images generated by the camera, the interactive portions and the additional data including (i) a request to refill a prescription drug, (ii) identification of a doctor that prescribed the prescription drug, and (iii) drug interaction data about the prescription drug; and

responsive to detecting a user selection of one or more of the interactive portions in the augmented reality foreground image, implement an action that includes one or more of transmitting a request to refill the prescription drug, calling the doctor that previously prescribed the prescription drug, or directing the display to present the drug interaction data about the prescription drug,

wherein the prescription drug is a first prescription drug, and the drug interaction data includes at least one of a negative interaction, a positive interaction, or a benign interaction between one or more of (a) the first prescription drug and a second prescription drug, (b) the first prescription drug and an over-the-counter drug, (c) the first prescription drug and a vitamin, (d) the first prescription drug and a medical herb, or (e) the first prescription drug and alcohol.

16 . The system of claim 15 , wherein the one or more processors are configured to identify the prescription drug container in the real-time images generated by the camera.

17 . The system of claim 15 , wherein the one or more processors are configured to identify the unique identifier by using optical character recognition to determine a prescription number printed on the label.

18 . The system of claim 15 , wherein the one or more processors are configured to identify the unique identifier by locating a glyph that is on the label adjacent to the unique identifier.

19 . The system of claim 15 , wherein the one or more processors are configured to identify the unique identifier by de-warping one or more of the real-time images and then applying optical character recognition to identify the unique identifier.

20 . The system of claim 15 , wherein the augmented reality subsystem is configured to direct the display to continue presenting the additional data on the real-time images generated by the camera and displayed on the display as a field of view of the camera changes.