IP Library Granted Patent US 12,437,854
Granted Patent B1
US 12,437,854 · App. 18/095,304 · Granted Oct 7, 2025

System and method for virtual review of a pharmaceutical product filling process

Inventors: Nimesh S. Jhaveri (Kildeer, IL); Laura Jean Tebbe (Antioch, IL); Dejan Kozic (Wadsworth, IL); Fuli E (Mundelein, IL)
Assignee: WALGREEN CO.
G16H20/13G05B15/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,437,854
App. No.
18/095,304
Granted
Oct 7, 2025
Kind
B1
Abstract

Image based and network controlled, security systems and methods are disclosed herein for securely dispensing pharmaceutical products onsite at a physical location. A server receives scanned prescription image corresponding to a prescription of a user and determines a pharmaceutical product and a pharmaceutical product amount of the pharmaceutical product. The server receives, from a pharmaceutical product imaging device positioned within a physically secured pharmacy area, images of the pharmaceutical product, and then transmits, to a visualization user interface application executing on a network computer positioned outside the physically secured pharmacy area, a visual confirmation of the pharmaceutical product and the pharmaceutical product amount. The server receives, from the visualization user interface application, a verification of the visual confirmation, and updates, based on the verification, the user account with a ready state corresponding to the prescription, wherein the ready state indicates that the user may receive the pharmaceutical product.

Claims (49)

1. An image based and network controlled, security system configured to securely dispense pharmaceutical products onsite at a physical location, the image based and network controlled, security system comprising:

a pharmaceutical product imaging device positioned within a physically secured pharmacy area, the pharmaceutical product imaging device configured to capture a plurality of images of pharmaceutical products from multiple viewpoints;

a server communicatively coupled, through a computer network, to the pharmaceutical product imaging device, the server configured to store an account of a user; and

a visualization user interface application configured to execute on a network computer positioned outside the physically secured pharmacy area, the network computer communicatively coupled, via a computer network, to the server,

wherein the server is configured to:

receive, via the computer network, a scanned digital prescription image corresponding to a prescription of the user,

determine, by a software program reading the scanned digital prescription image, a pharmaceutical product and a pharmaceutical product amount of the pharmaceutical product,

receive, from the pharmaceutical product imaging device, a plurality of digital images of the pharmaceutical product comprising at least one unacceptable image of the pharmaceutical product, the plurality of digital images captured at multiple viewpoints depicting features in the digital images of the pharmaceutical product;

transmit, to the visualization user interface application executing on the network computer positioned outside the physically secured pharmacy area, a visual confirmation of the pharmaceutical product and the pharmaceutical product amount, the visual confirmation based on the one or more digital images of the pharmaceutical product comprising at least one unacceptable image,

receive, from the visualization user interface application, a rejection of the visual confirmation based on the at least one unacceptable image, and

implement one of:

(a) rejecting, based on the at least one unacceptable image, the scanned digital prescription image, causing rescanning of the prescription and a return of the pharmaceutical product to a pharmaceutical product stock within the physically secured pharmacy area; or

(b) dispensing, upon receiving an acceptable image replacing the unacceptable image, by a dispensing instrument the product for outside of the physically secured pharmacy area.

2. The image based and network controlled, security system of claim 1 , wherein the physically secured pharmacy area is at a first physical location, and wherein the network computer is at a second physical location, the first physical location remote to the second physical location.

3. The image based and network controlled, security system of claim 1 further comprising an automated counting device, the automated counting device configured to generate an automated confirmation the amount of the pharmaceutical product, wherein the visual confirmation is based on upon the automated confirmation.

4. The image based and network controlled, security system of claim 1 , wherein the network computer is a mobile device.

5. The image based and network controlled, security system of claim 3 , wherein the automated counting device is a computer vision-based device.

6. The image based and network controlled, security system of claim 4 , wherein the computer vision-based device is configured to capture one or more images of a vial containing the pharmaceutical product and a prescription label affixed to the vial, the prescription label corresponding to the pharmaceutical product.

7. The image based and network controlled, security system of claim 6 , wherein the one or more images of the prescription label are stored in a memory communicatively coupled to the server.

8. The image based and network controlled, security system of claim 6 , wherein one or more images of each of the scanned prescription image, the prescription label, and the pharmaceutical product are transmitted to the network computer positioned outside the physically secured pharmacy area.

9. The image based and network controlled, security system of claim 7 , wherein the server performs a visual comparison the one or more images of each of the scanned prescription image, the prescription label, and the pharmaceutical product, wherein the visual confirmation includes the visual comparison.

10. The image based and network controlled, security system of claim 7 , wherein the network computer positioned outside the physically secured pharmacy area transmits to the server an indication of acceptance or denial of the pharmaceutical product, the ready state based on the indication.

11. An image based and network controlled, security method for securely dispensing pharmaceutical products onsite at a physical location, the image based and network controlled, security method comprising:

receiving, via a computer network at a server communicatively coupled to a pharmaceutical product imaging device and storing an account of a user, a scanned digital prescription image corresponding to a prescription of the user;

determining, by a software program reading the scanned digital prescription image, a pharmaceutical product and a pharmaceutical product amount of the pharmaceutical product;

receiving, from the pharmaceutical product imaging device configured to capture multiple digital images from multiple viewpoints, a plurality of digital images of the pharmaceutical product, comprising at least one unacceptable image of the pharmaceutical product, wherein the plurality of digital images are captured at multiple viewpoints depicting features in the digital images of the pharmaceutical product, and;

transmitting, to a visualization user interface application executing on a network computer positioned outside a physically secured pharmacy area, a visual confirmation of the pharmaceutical product and the pharmaceutical product amount, the visual confirmation based on the one or more digital images of the pharmaceutical product comprising at least one unacceptable image,

receiving, from the visualization user interface application, a rejection of the visual confirmation based on the at least one unacceptable image, and

implementing one of:

(a) rejecting, based on the at least one unacceptable image, the scanned digital prescription image, causing rescanning of the prescription and a return of the pharmaceutical product to a pharmaceutical product stock within the physically secured pharmacy area; or

(b) dispensing, upon receiving an acceptable image replacing the unacceptable image, by a dispensing instrument the product for outside of the physically secured pharmacy area.

12. The image based and network controlled, security method of claim 11 , wherein the physically secured pharmacy area is at a first physical location, and wherein the network computer is at a second physical location, the first physical location remote to the second physical location.

13. The image based and network controlled, security method of claim 11 further comprising generating, by an automated counting device, an automated confirmation the amount of the pharmaceutical product, wherein the visual confirmation is based on upon the automated confirmation.

14. The image based and network controlled, security method of claim 11 , wherein the network computer is a mobile device.

15. The image based and network controlled, security method of claim 13 , wherein the automated counting device is a computer vision-based device.

16. The image based and network controlled, security method of claim 15 , wherein the computer vision-based device is configured to capture one or more images of a vial containing the pharmaceutical product and a prescription label affixed to the vial, the prescription label corresponding to the pharmaceutical product.

17. The image based and network controlled, security method of claim 16 , wherein the one or more images of the prescription label are stored in a memory communicatively coupled to the server.

18. The image based and network controlled, security method of claim 16 , wherein one or more images of each of the scanned prescription image, the prescription label, and the pharmaceutical product are transmitted to the network computer positioned outside the physically secured pharmacy area.

19. The image based and network controlled, security method of claim 18 , wherein the server performs a visual comparison the one or more images of each of the scanned prescription image, the prescription label, and the pharmaceutical product, wherein the visual confirmation includes the visual comparison.

20. A tangible, non-transitory computer-readable medium storing instructions for securely dispensing pharmaceutical products onsite at a physical location, that when executed by one or more processors cause the one or more processors to:

receive, via a computer network at a server communicatively coupled to a pharmaceutical product imaging device and storing an account of a user, a scanned digital prescription image corresponding to a prescription of the user;

determine, by reading the scanned digital prescription image, a pharmaceutical product and a pharmaceutical product amount of the pharmaceutical product;

receive, from the pharmaceutical product imaging device configured to capture a plurality of digital images of the pharmaceutical product comprising at least one unacceptable image of the pharmaceutical product, the plurality of digital images depicting features in the digital images such as shape, dimension, and/or markings of the pharmaceutical product;

transmit, to a visualization user interface application executing on a network computer positioned outside a physically secured pharmacy area, a visual confirmation of the pharmaceutical product and the pharmaceutical product amount, the visual confirmation based on the one or more digital images of the pharmaceutical product comprising at least one unacceptable image; and

receive, from the visualization user interface application, a rejection of the visual confirmation based on the at least one unacceptable image, and

cause, based on the rejection, the server to update a ready state to indicate that the pharmaceutical product corresponding to the prescription is to remain on a waitlist queue and in the secured area and, upon receiving new images determined by the server as acceptable, update the ready state and the waitlist queue to indicate on a monitor visible within and without the secured area that the user may receive the pharmaceutical product;

implementing one of:

(a) rejecting, based on the at least one unacceptable image, the scanned digital prescription image, causing rescanning of the prescription and a return of the pharmaceutical product to a pharmaceutical product stock within the physically secured pharmacy area; or

(b) dispensing, upon receiving an acceptable image replacing the unacceptable image, by a dispensing instrument the product for outside of the physically secured pharmacy area.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR NIMESH S. JHAVERI'S EXECUTION DATE TO BE 04/05/2012. PREVIOUSLY RECORDED ON REEL 72250 FRAME 586. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 4, 2025
From: JHAVERI, NIMESH S.; TEBBE, LAURA J.; KOZIC, DEJAN; E, FULI
To: WALGREEN CO.
Reel/Frame 073446/0763 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2025
From: JHAVERI, NIMESH S.; TEBBE, LAURA J.; KOZIC, DEJAN; E, FULI
To: WALGREEN CO.
Reel/Frame 072250/0586 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 28, 2025
From: WALGREEN CO.
To: SIXTH STREET LENDING PARTNERS, AS COLLATERAL AGENT
Reel/Frame 072606/0878 →
SECURITY INTEREST Recorded Aug 28, 2025
From: WALGREEN CO.; DUANE READE; WALGREENS SPECIALTY PHARMACY LLC; WALGREENS BOOTS ALLIANCE, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 072679/0926 →
Continuity (2)
Continuation 16657464 · Oct 18, 2019
Continuation 13443302 · Apr 10, 2012
References Cited (73)
US 4869394A · Hurst · 1989 [cited by applicant]
US 5597995A · Williams · 1997 [cited by examiner]
US 5907493A · Boyer et al. · 1999 [cited by applicant]
US 6176392B1 · William · 2001 [cited by examiner]
US 6202923B1 · Boyer et al. · 2001 [cited by applicant]
US 6535637B1 · Wootton · 2003 [cited by examiner]
US 6738723B2 · Hamilton · 2004 [cited by examiner]
US 6771369B2 · Rzasa et al. · 2004 [cited by applicant]
US 7006214B2 · Rzasa · 2006 [cited by examiner]
US 7058584B2 · Kosinski · 2006 [cited by examiner]
US 7668618B2 · Szesko · 2010 [cited by examiner]
US 7702525B2 · Kosinski et al. · 2010 [cited by applicant]
US 7720694B2 · Potuluri et al. · 2010 [cited by applicant]
US 7801642B2 · Ansari et al. · 2010 [cited by applicant]
US 7801765B2 · Denny · 2010 [cited by applicant]
US 7837093B1 · Leu et al. · 2010 [cited by applicant]
US 7848934B2 · Kobylevsky · 2010 [cited by examiner]
US 7860724B2 · Chudy · 2010 [cited by examiner]
US 7912582B1 · Holtje et al. · 2011 [cited by applicant]
US 7941325B2 · Heald et al. · 2011 [cited by applicant]
US 7995831B2 · Eller et al. · 2011 [cited by applicant]
US 8032397B2 · Lawless · 2011 [cited by examiner]
US 8046242B1 · daCosta et al. · 2011 [cited by applicant]
US 8060248B1 · Boyer et al. · 2011 [cited by applicant]
US 8060380B2 · Sullivan et al. · 2011 [cited by applicant]
US 8072635B2 · Roberts et al. · 2011 [cited by applicant]
US 8136332B2 · Rice et al. · 2012 [cited by applicant]
US 8145501B1 · Heald et al. · 2012 [cited by applicant]
US 8150706B2 · Kobylevsky · 2012 [cited by examiner]
US 8224483B1 · Ansari · 2012 [cited by examiner]
US 8239217B2 · Helmus et al. · 2012 [cited by applicant]
US 8244587B2 · Denny · 2012 [cited by examiner]
US 8295582B2 · Eller et al. · 2012 [cited by applicant]
US 8321236B2 · Goodall et al. · 2012 [cited by applicant]
US 8417539B2 · Chapman · 2013 [cited by examiner]
US 8612256B1 · Moncrief · 2013 [cited by examiner]
US 8775198B2 · Wiener et al. · 2014 [cited by applicant]
US 10860689B1 · Whitaker · 2020 [cited by examiner]
US 11581079B1 · Jhaveri · 2023 [cited by examiner]
US 20040138921A1 · Broussard · 2004 [cited by examiner]
US 20040172289A1 · Kozic · 2004 [cited by examiner]
US 20050182656A1 · Morey · 2005 [cited by examiner]
US 20060031097A1 · Lipscher et al. · 2006 [cited by applicant]
US 20060124656A1 · Popovich · 2006 [cited by examiner]
US 20070043469A1 · Draper · 2007 [cited by applicant]
US 20070088566A1 · Berkelhamer · 2007 [cited by examiner]
US 20070088567A1 · Berkelhamer · 2007 [cited by examiner]
US 20070088569A1 · Berkelhamer · 2007 [cited by examiner]
US 20070088596A1 · Berkelhamer · 2007 [cited by examiner]
US 20080056556A1 · Eller · 2008 [cited by examiner]
US 20080059240A1 · Potuluri · 2008 [cited by examiner]
US 20080091467A1 · Moncrief · 2008 [cited by examiner]
US 20080306761A1 · George · 2008 [cited by examiner]
US 20090030722A1 · Wiener · 2009 [cited by examiner]
US 20090048863A1 · Kozlowski · 2009 [cited by examiner]
US 20090048871A1 · Skomra · 2009 [cited by examiner]
US 20090132083A1 · Rice et al. · 2009 [cited by applicant]
US 20090157424A1 · Hans · 2009 [cited by examiner]
US 20100094653A1 · Tribble · 2010 [cited by examiner]
US 20100232640A1 · Friend · 2010 [cited by examiner]
US 20100274581A1 · Chin · 2010 [cited by examiner]
US 20110202366A1 · Akers · 2011 [cited by examiner]
US 20110307265A1 · Bannis · 2011 [cited by examiner]
US 20120158425A1 · Rhoads, Jr. · 2012 [cited by examiner]
US 20120209627A1 · Moncrief · 2012 [cited by examiner]
US 20120253832A1 · John · 2012 [cited by examiner]
US 20130104499A1 · Moncrief · 2013 [cited by examiner]
US 20140156298A1 · Crawford · 2014 [cited by examiner]
US 20140157731A1 · Perazzo · 2014 [cited by examiner]
US 20140297329A1 · Rock · 2014 [cited by examiner]
US 20150039340A1 · Moore · 2015 [cited by examiner]
US 20150039345A1 · Moore · 2015 [cited by examiner]
US 20160132660A1 · Barajas · 2016 [cited by examiner]