Systems and methods for laboratory deck setup verification
A laboratory workstation for preparing a sample according to a programmed protocol. The laboratory workstation may include a display device configured to display an instruction for loading a first item of labware onto a deck of the laboratory workstation at a position on the deck specified by the programmed protocol; an imaging device configured to monitor the deck of the laboratory workstation by creating one or more images of the deck; and a processor configured to recognize, in the one or more images created by the imaging device, an item of labware loaded onto the deck by an operator. In some embodiments, the processor may be configured to indicate on the display device whether the recognized item of labware loaded by the operator is arranged on the deck in accordance with the programmed protocol.
1 . A laboratory workstation for preparing a sample according to a programmed protocol, the laboratory workstation comprising:
a display device configured to display an instruction for loading a first item of labware onto a deck of the laboratory workstation at a position on the deck specified by the programmed protocol;
an imaging device configured to monitor the deck of the laboratory workstation by creating one or more images of the deck; and
a processor configured to recognize, in the one or more images created by the imaging device, an item of labware loaded onto the deck by an operator;
wherein the processor is further configured to indicate on the display device whether the recognized item of labware loaded by the operator is arranged on the deck in accordance with the programmed protocol.
2 . The laboratory workstation of claim 1 , wherein the processor is configured to indicate on the display device whether the recognized item of labware is the first item of labware loaded onto the deck at the position specified by the programmed protocol.
3 . The laboratory workstation of claim 1 , wherein recognizing an item of labware loaded onto the deck by an operator comprises identifying the item using at least one of an artificial neural network, image comparison, and template matching.
4 . The laboratory workstation of claim 1 , wherein the programmed protocol calls for a plurality of items of labware to be arranged on the deck, and wherein the processor is configured to recognize each of the plurality of items of labware as it is placed on the deck, regardless of order of placement.
5 . The laboratory workstation of claim 1 , wherein the recognized item of labware comprises a plurality of components, and wherein recognizing the item of labware comprises counting the plurality of components.
6 . The laboratory workstation of claim 5 , wherein the plurality of components are arranged in a stacked configuration.
7 . The laboratory workstation of claim 1 , wherein the imaging device is configured to create one or more images or videos of the deck each time the operator places an item of labware on the deck.
8 . The laboratory workstation of claim 1 , wherein the imaging device is configured to collect one or more images or videos of the deck continuously, at intervals, intermittently, or on demand.
9 . The laboratory workstation of claim 1 , further comprising a reflective surface configured to reflect a view toward the imaging device.
10 . The laboratory workstation of claim 9 , wherein the reflective surface is arranged to reflect a view of a thermal cycler toward the imaging device.
11 . The laboratory workstation of claim 1 , wherein the display device is further configured to display an instruction for unloading the first item of labware from the deck in accordance with the programmed protocol, and wherein the processor is further configured to:
recognize, in the one or more images created by the imaging device, removal of the first item of labware from the deck by an operator; and
indicate on the display device whether the first item was removed from the deck in accordance with the programmed protocol.
12 . The laboratory workstation of claim 1 , wherein the processor is configured to perform the recognizing and indicating steps within between approximately 0.1 to approximately 0.8 seconds.
13 . The laboratory workstation of claim 1 , wherein the processor is configured to recognize, in the one or more images of the deck, when an operator has loaded an item of labware onto the deck.
14 . The laboratory workstation of claim 1 , wherein the processor is further configured to analyze the one or more images of the deck using template matching, wherein template matching comprises counting a number of templates identifiable in the one or more images of the deck, wherein the template comprises at least one of a pipette tip and an opening for receiving a pipette tip.
15 . A method of verifying arrangement of labware on a deck of a laboratory workstation in accordance with a programmed protocol, the method comprising:
displaying on a display device an instruction for loading labware onto the deck;
monitoring the deck by creating one or more images of the deck using an imaging device;
from the one or more images of the deck, identifying an item of labware loaded onto the deck by an operator;
from the one or more images of the deck, determining whether the item of labware is arranged on the deck in accordance with the programmed protocol; and
providing feedback to the operator regarding arrangement of the item of labware.
16 . The method of claim 15 , wherein the deck is monitored and feedback is provided continuously, substantially in real time, at intervals, intermittently, or on demand.
17 . The method of claim 16 , further comprising:
the operator following instructions from the provided feedback.
18 . The method of claim 16 , further comprising:
the operator ignoring the provided feedback.
19 . The method of claim 16 , further comprising:
the operator overruling the provided feedback.
20 . The method of claim 16 , further comprising:
the operator correcting deck set up errors based on the provided feedback.