Mapping transfer function for automated biological sample processing system
A gripping element may be commanded to move to pre-determined robot-frame locations, and markings may be punched into a calibration sample capture substrate at each location. A calibration image may be obtained, and fiducial markings on the gripping element may be detected. A set of calibration regions of interest may be predicted, and the previously punched markings may be detected. A sampling system may then create a mapping transfer function between detected image locations and real-world locations resulting from the commanded locations of the gripping element when the markings were punched. An indication may subsequently be received that a biological sample capture substrate is ready to be processed. An image of the sample capture substrate may be obtained, and the fiducial markings may be detected. Based on those image locations and the mapping transfer function, biological sample portions may be automatically taken from the sample capture substrate.
1. A method associated with an automated biological sample processing system having a gripping element to hold biological sample capture substrates, the method comprising:
receiving an indication that a biological sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate by the sample processing system, further comprising, prior to said receiving
commanding the gripping element to move to a set of re-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region of interest; and
automatically creating, by the sampling system, the mapping transfer function between detected image locations and real-world locations resulting front the commanded locations of the gripping element when the markings were punched.
2. The method of claim 1 , wherein the sample capture substrate comprises a porous card.
3. The method of claim 1 , wherein an applied biological fluid to the biological sample capture substrate comprises at least one of (i) blood, (ii) saliva, (iii) plant material, (iv) insect material, (v) viral material, (vi) bacterial material, (vii) genetic material, (viii) food, and (ix) animal biological fluid.
4. The method of claim 1 , wherein said arranging comprises transmitting location information from a visualization subsystem to a robot controller associated with the gripping element.
5. The method of claim 4 , wherein the robot controller is to punch a plurality of sample portions from the capture substrate leaving holes in the sample capture substrate.
6. The method of claim 5 , wherein said arranging comprises:
based on the image locations of the detected fiducial markings in the image, predicting a plurality of sampling regions of interest within the image; and
detecting, within each sampling region of interest, a biological sampling area, wherein said plurality of sample portions are punched from within the biological sample areas.
7. The method of claim 1 , wherein at least one of said detections are performed outside of the visible spectrum.
8. The method of claim 1 , wherein the markings previously created on the calibration sample capture substrate comprise a matrix of punched holes.
9. A non-transitory, computer-readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform a method associated with an automated biological sample processing system having a gripping element to hold biological sample capture substrates, the method comprising:
receiving an indication that a biological fluid sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate by the sample processing system, further comprising, prior to said receiving;
commanding the gripping element to move to a set of pre-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region of interest; and
automatically creating, by the sampling system, the mapping transfer function between detected image locations and real-world locations resulting from the commanded locations of the gripping element when the markings were punched.
10. The medium of claim 9 , wherein the sample capture substrate comprises a porous card and an applied biological fluid to the porous card comprises at least one of: (i) blood, (ii) saliva, (iii) plant material, (iv) insect material, (v) viral material, (vi) bacterial material, (vii) genetic material, (viii) food, and (ix) animal biological fluid.
11. The medium of claim 9 , wherein said arranging comprises transmitting location information from a visualization subsystem to a robot controller associated with the gripping element, and the robot contoller is to punch a plurality of sample portions in the sample capture substrate.
12. The medium of claim 11 , wherein said arranging comprises:
based on the image locations of the detected fiducial markings in the image, predicting a plurality of sampling regions of interest within the image; and
detecting, within each sampling region of interest, a biological sample area, wherein said plurality of sample portion are punched within the biological sample areas.
13. The medium of claim 9 , wherein the markings previously created on the calibration sample capture substrate comprise a matrix of punched holes.
14. An automated biological sample processing system, comprising:
a visualization subsystem having a camera to capture images;
a robot having a gripping element to hold biological sample capture substrates; and
a robot controller, coupled to the visualization subsystem and the robot; and
a computer system associated with at least one of the visualization subsystem and the robot controller to perform a method, the method comprising:
receiving an indication that a biological sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate, wherein the method further comprises, prior to said receiving;
commanding the gripping element to move to a set of pre-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region of interest; and
automatically creating, by the sampling system, the mapping transfer function between detected image locations and real-world locations resulting from the commanded locations of the gripping element when the markings were punched.
15. The system of claim 14 , wherein the sample collection substrate comprises porous card and a biological fluid applied to the porous card comprises at least one of (i) blood, (ii) saliva, (iii) plant material, (iv) insect material, (v) viral material, (vi) bacterial material, (vii) genetic material, (viii) food, and (ix) animal biological fluid.
16. The system of claim 14 , wherein said arranging comprises transmitting location information from a visualization subsystem to the robot controller associated with the gripping, element, and the robot controller is to punch a plurality of sample portions in the sample capture substrate.
17. The system of claim 16 , wherein said arranging comprises:
based on the image locations of the detected fiducial markings in the image, predicting a plurality of sampling regions of interest within the image; and
detecting, within each sampling region of interest, a biological sample area, wherein said plurality of sample portions are punched within the biological sample areas.
18. The system of claim 14 , wherein the markings previously created on the calibration sample capture substrate comprise a matrix of punched holes.