Granted Patent B2

US 12,223,716 · App. 18/525,144 · Granted Feb 11, 2025

Inventors: Petra Bangtsson (Uppsala, SE); Johan Arthursson (Uppsala, SE); Key Hyckenberg (Uppsala, SE); Lotta Hedkvist (Uppsala, SE)

Assignee: Cytiva Sweden AB

G06V20/20G06T7/001G06T11/00G06T2207/30164

Abstract

Claims (42)

1. A method of automated configuration detection in a bioprocess system, the method comprises the steps of:

forming a network of tubing in the bioprocess system, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system,

capturing at least one of: one or more images and videos of the bioprocess system comprising the network of tubing;

analyzing, in an analyzing routine, the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system;

producing a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified;

verifying a process defined by a flow path representation in the bioprocess system, comprising comparing the processed representation with the flow path representation to verify their functional concordance.

2. The method according to claim 1 , the processed representation is compared to the flow path representation to identify faulty connected and/or missing parts of the tubing.

3. The method according to claim 1 , further comprising:

producing an augmented live view image of the bioprocess system illustrating at least one step in the process represented by the flow path representation utilizing the processed representation to visually mark the part of the tubing and units engaged in the particular process step in the augmented live view image.

4. The method according to claim 1 , wherein the analyzing step further comprises:

determining if additional images and/or videos could be useful to extract information required to produce the processed representation and, if additional images and/or videos are determined as useful, issuing a notification to capture additional images and/or videos.

5. The method according to claim 4 , wherein the analyzing step further comprises:

determining if the tubing and optionally other features is sufficiently identified from the at least one captured image and/or video, and if determined as sufficient, continue to produce a processed representation, and if determined as not sufficient, continue to an evaluation of whether more images and/or videos should be captured;

determining if more images and/or videos should be captured, and

if more images and/or videos should be captured, proceeding to identification of problem areas, and if determined that more images and/or videos would not improve the processed representation, proceed to indication;

indicating that certain part of the tubing and/or features are not identified, and proceed to produce a processed representation;

identifying a problem area in the at least one captured image and/or video and proceed to selecting active action;

selecting a suitable active action, from a predefined list of active actions based on an analysis of the problem area;

informing the operator on the selected active action and how it should be performed and returning to the capturing step.

6. The method according to claim 1 , wherein the verifying step further comprises:

establishing a link between the flow path representation and the processed representation;

producing an enhanced image in which the tubing and units belonging to a particular flow path have a common identification.

7. The method according to claim 6 , further comprising providing setup assistance

for a new process or modification of an existing system.

8. The method according to claim 7 , further comprising:

identifying or constructing a flow path graph representing a new process or a modified process;

using the established link between the flow path representation and the processed representation to produce at least one of the following:

an enhanced image of the bioprocess system illustrating how the tubing should be connected to the units;

a series of enhanced images stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units; and

an augmented live view of the bioprocess system stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units.

9. A system for automated configuration detection in a bioprocess system, the system comprising:

a bioprocess system arranged to run a process defined by a flow path representation,

a memory configured to store instructions for the automated configuration detection,

a processor configured to execute the instructions, a GUI and a camera, wherein

the camera is adapted to capture at least one image and/or video of the bioprocess system comprising a network of tubing, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system, and to transfer the least one image and/or video to the processor;

when the instructions are executed by the processor, the processor is configured to:

receive the at least one captured image and/or video from the camera,

host an analyzing routine adapted to analyze the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system;

produce a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified;

present the processed representation on the GUI; and

verify the process in the bioprocess system by comparing the processed representation with the flow path representation to verify their functional concordance.

10. The system according to claim 9 , when the instructions are executed by the processor.

Assignments (2)

Priority Claims (1)

Continuity (3)

References Cited (24)