IP Library Granted Patent US 12,280,368
Granted Patent B2
US 12,280,368 · App. 17/780,352 · Granted Apr 22, 2025

Connected ecosystem for laboratory environment

Inventors: John Wilfred Coddaire (Kennebunk, ME); Maryanne De Chambeau (North Attleboro, MA); James Thomas Eickmann (Kennebunk, ME); Paula Mary Flaherty (Tyngsborough, MA); Anthony Glenn Frutos (Painted Post, NY); Vasiliy Nikolaevich Goral (Painted Post, NY); Angela Langer Julien (Painted Post, NY); Marshall Jay Kosovsky (Northborough, MA); Brent Ravaughn Lanterman (Tewksbury, MA); Gregory Roger Martin (Acton, ME); Christie Leigh McCarthy (Painted Post, NY); John Forrest Roush (Pepperell, MA); John Shyu (Londonderry, NH); Tora Ann-Beatrice Eline Sirkka (Sunnyvale, CA); Allison Jean Tanner (Portsmouth, NH); Kimberly Ann Titus (Arundel, ME); Todd Michael Upton (Eliot, ME); Timothy James Wood (Rochester, NY)
Assignee: CORNING INCORPORATED
B01L1/50G06F3/013G06F3/017G06F3/165G06F21/32G06T7/0008G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,280,368
App. No.
17/780,352
Granted
Apr 22, 2025
Kind
B2
Abstract

A connected ecosystem for a laboratory environment comprises an electronic lab notebook, and instrumented biosafety cabinet, and one or more sensing vessels containing cell cultures. The electronic lab notebook interfaces with the instrumented biosafety cabinet to provide instructions, guidance, and monitoring of a user during the set up of the experimental protocol and to receive commands from the user via one of several input modalities. After the experimental protocol has been set up in the instrumented biosafety cabinet, cell cultures may be moved to an incubator where the connected ecosystem may provide automatic monitoring of the cultures. The automatic monitoring is provided by sensors integrated into cell culture vessels and supplemented by images of the cell cultures captured by a camera. The user may be informed of deviations from expected results detected based on the automatic monitoring.

Claims (52)

1. A biosafety cabinet comprising:

one or more output devices for providing information to a user of the biosafety cabinet regarding setup of experimental protocols within the biosafety cabinet, the experimental protocols being stored in an electronic lab notebook associated with the experimental protocol;

one or more input devices for providing input data from the user regarding setup of the experimental protocol, the input data to be stored in the electronic lab notebook associated with the experimental protocol;

a video output device for outputting videos and still images to be displayed on a surface of the biosafety cabinet;

an audio output device for outputting audio;

a camera for capturing videos or still images;

one or more scanners; and

an audio input device for capturing audio;

wherein at least one scanner tracks objects inserted into and extracted from the biosafety cabinet.

2. The biosafety cabinet of claim 1 , the videos and still images comprising step-by-step instructions guiding the user through the setup of the experimental protocol.

3. The biosafety cabinet of claim 1 , the videos and still images comprising warnings to the user that the user has deviated from parameters of the setup of the experimental protocol.

4. The biosafety cabinet of claim 1 , the scanner further tracking videos and still images comprising an inventory of objects required for the setup of the experimental protocol and an acknowledgment that the required objects for setup of the experimental protocol are present in the biosafety cabinet.

5. The biosafety cabinet of claim 1 , the videos and still images comprising one or more virtual buttons displayed on the surface of the biosafety cabinet, the biosafety cabinet being able to determine that the user has touched the area on the surface of the biosafety cabinet on which one of the virtual buttons is displayed.

6. The biosafety cabinet of claim 1 , the camera capturing images of objects in the biosafety cabinet and actions taken by the user during setup of the experimental protocol, the images being stored in the electronic lab notebook associated with the experimental protocol.

7. The biosafety cabinet of claim 1 , the audio input device capturing commands spoken by the user.

8. The biosafety cabinet of claim 1 , further comprising one or more user input devices, the one or more user input devices being selected from a group comprising a touchscreen display, a mouse and a foot actuated switch.

9. A biosafety cabinet comprising:

one or more output devices for providing information to a user of the biosafety cabinet regarding setup of experimental protocols within the biosafety cabinet, the experimental protocols being stored in an electronic lab notebook associated with the experimental protocol;

one or more input devices for providing input data from the user regarding setup of the experimental protocol, the input data to be stored in the electronic lab notebook associated with the experimental protocol;

a video output device for outputting videos and still images to be displayed on a surface of the biosafety cabinet;

an audio output device for outputting audio;

a camera for capturing videos or still images;

one or more scanners;

an audio input device for capturing audio;

a processor;

a network connection to a server comprising electronic lab book logic and an experimental protocol data storage containing one or more electronic lab books, each electronic lab book defining an experimental protocol including a list of materials and steps required to set-up the experimental protocol; and

software, for execution on the processor, the software configured to interface, via the network connection, with the electronic lab book logic to provide the functions of:

receiving video, including still images, from the electronic lab book logic and displaying the video on the surface of the biosafety cabinet;

receiving audio from the electronic lab book logic and playing the audio via the audio output device; and

receiving commands from the user and sending the commands to the electronic lab book logic.

10. The biosafety cabinet of claim 9 , the received video comprising step-by-step instructions for the user to set-up the experimental protocol.

11. The biosafety cabinet of claim 9 , the received video comprising an inventory of objects required for the setup of the experimental protocol indicating which of the required objects have been inserted into the biosafety cabinet.

12. The biosafety cabinet of claim 9 , the received video comprising ancillary information to assist the user in the setup of the experimental protocol.

13. The biosafety cabinet of claim 9 , the received video comprising warnings indicating the user has deviated from the step-by-step instructions for setting up the experimental protocol.

14. The biosafety cabinet of claim 9 , the software comprising one or more machine learning models trained to recognize one or more of voice commands, hand or eye gestures of the user and specific users based on facial recognition.

15. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:

receiving voice input from the user via the audio input device;

interpreting the received voice input as a command; and

sending the command to the electronic lab notebook logic on the electronic lab notebook server via the network connection.

16. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:

receiving video input from the user via the video input device, the video comprising hand or eye gestures of the user;

interpreting hand or eye gestures of the user in the received video as a command; and

sending the command to the electronic lab notebook logic on the electronic lab notebook server via the network connection.

17. The biosafety cabinet of claim 14 , the software further configured to provide the functions of:

receiving, via the video input device and image containing a facial image of the user; and

identifying and authenticating the user based facial image recognition of the user.

18. The biosafety cabinet of claim 9 , the software further configured to provide the functions of:

receiving video from the video input device; and

sending the video to the electronic lab notebook logic for storing in the electronic lab notebook associated with the experimental protocol.

19. The biosafety cabinet of claim 9 , the software further configured to provide the functions of:

receiving audio from the audio input device, the audio comprising a note spoken by the user; and

sending the note to the electronic lab book logic for storing in the electronic lab notebook associated with the experimental protocol.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2022
From: CODDAIRE, JOHN WILFRED; DE CHAMBEAU, MARYANNE; EICKMANN, JAMES THOMAS; FLAHERTY, PAULA MARY; FRUTOS, ANTHONY GLENN; GORAL, VASILIY NIKOLAEVICH; JULIEN, ANGELA LANGER; KOSOVSKY, MARSHALL JAY; LANTERMAN, BRENT RAVAUGHN; MARTIN, GREGORY ROGER; MCCARTHY, CHRISTIE LEIGH; ROUSH, JOHN FORREST; SHYU, JOHN; SIRKKA, TORA ANN-BEATRICE ELINE; TANNER, ALLISON JEAN; TITUS, KIMBERLY ANN; UPTON, TODD MICHAEL; WOOD, TIMOTHY JAMES
To: CORNING INCORPORATED
Reel/Frame 060199/0768 →
Continuity (3)
Provisional Application 62940991 · Nov 27, 2019
Provisional Application 62941001 · Nov 27, 2019
Related Publication 20230007854A1 · Jan 12, 2023
References Cited (44)
US 7666355B2 · Alavie et al. · 2010 [cited by applicant]
US 8250636B2 · Hirsch · 2012 [cited by applicant]
US 8380541B1 · Holmes · 2013 [cited by applicant]
US 8464171B2 · Wild et al. · 2013 [cited by applicant]
US 8511549B2 · Steimle et al. · 2013 [cited by applicant]
US 8651377B2 · Steimle et al. · 2014 [cited by applicant]
US 8865474B2 · Paschetto et al. · 2014 [cited by applicant]
US 8985441B2 · Steimle et al. · 2015 [cited by applicant]
US 9927941B2 · Steimle et al. · 2018 [cited by applicant]
US 10078730B2 · Delgrande et al. · 2018 [cited by applicant]
US 10091279B2 · Stadnisky · 2018 [cited by applicant]
US 10105698B2 · Lind et al. · 2018 [cited by applicant]
US 10112192B2 · Miettinen et al. · 2018 [cited by applicant]
US 10436615B2 · Agarwal et al. · 2019 [cited by applicant]
US 20110036145A1 · Dobbyn · 2011 [cited by examiner]
US 20130038727A1 · Clark · 2013 [cited by applicant]
US 20130052927A1 · Broemsen · 2013 [cited by examiner]
US 20130159135A1 · Jones · 2013 [cited by examiner]
US 20140036070A1 · Eckard · 2014 [cited by examiner]
US 20150177362A1 · Gutierrez et al. · 2015 [cited by applicant]
US 20160145562A1 · Pedersen · 2016 [cited by applicant]
US 20160152941A1 · Kim · 2016 [cited by applicant]
US 20180074084A1 · Neveu · 2018 [cited by applicant]
US 20180141093A1 · Hall · 2018 [cited by examiner]
US 20180217172A1 · Webster et al. · 2018 [cited by applicant]
US 20180231946A1 · Savo et al. · 2018 [cited by applicant]
US 20180320127A1 · Cannon · 2018 [cited by applicant]
US 20180346868A1 · Blanchard · 2018 [cited by applicant]
US 20190352589A1 · Collins et al. · 2019 [cited by applicant]
CN 109794304A · 2019 [cited by applicant]
DE 102013008016A1 · 2014 [cited by applicant]
DE 202018006083U1 · 2019 [cited by examiner]
EP 1772112A2 · 2007 [cited by applicant]
EP 2918671A1 · 2015 [cited by applicant]
EP 3409759A1 · 2018 [cited by applicant]
WO 2007121324A1 · 2007 [cited by applicant]
WO 2017001676A1 · 2017 [cited by applicant]
WO 2018213357A1 · 2018 [cited by applicant]
WO 2019207866A1 · 2019 [cited by applicant]
C. Lavania, S. Thulasidasan, A. LaMarca, J. Scofield, and J. Bilmes, “A weakly supervised activity recognition framework for real-time Synthetic Biology Laboratory Assistance,” Proceedings of the 2016 ACM Int. Jnt. Conf… [cited by examiner]
E. M. Riley, H. Z. Hattaway, and P. A. Felse, “Implementation and use of cloud-based Electronic Lab Notebook in a Bioprocess Engineering Teaching Laboratory,” Journal of Biological Engineering, vol. 11, No. 1, Nov. 2017… [cited by examiner]
P. M. Scholl, M. Wille, and K. Van Laerhoven, “Wearables in the wet lab,” Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sep. 2015. doi: 10.1145/2750858.2807547 (Year: … [cited by examiner]
C. Lavania, S. Thulasidasan, A. LaMarca, J. Scofield, and J. Bilmes, “A weakly supervised activity recognition framework for real-time Synthetic Biology Laboratory Assistance,” Proceedings of the 2016 ACM Intl Joint Con… [cited by examiner]
International Search Report and Written Opinion of the International Searching Authority; PCT/US2020/059623; Mailed Feb. 15, 2021; 11 Pages; European Patent Office. [cited by applicant]