Granted Patent B2

US 12,482,282 · App. 17/615,502 · Granted Nov 25, 2025

Inventors: Johannes Linzbach (Cologne, DE); Barthel Bach-Zelewski (Remscheid, DE); Klaus Ochmann (Leverkusen, DE); Franco Fois (Monheim, DE); Kerstin Ilg (Cologne, DE); Angelika Köllen (Cologne, DE)

Assignee: Bayer Aktiengesellschaft

G06V20/698G06F18/24143G06V10/82

Abstract

Claims (35)

1 . A system for determining the effect of active ingredients on living organisms accommodated on a support comprising a leaf in at least one well, comprising:

an assay plate with the at least one well, wherein the at least one well contains the living organisms accommodated on the support comprising the leaf and an active ingredient applied to the living organisms;

an apparatus for acquiring images of the at least one well comprising the living organisms and the active ingredient accommodated on the support, the apparatus comprising:

a camera having an optical system, wherein the camera is arranged over the at least one well and is configured to acquire multiple images of a scene in which the at least one well is present, said multiple images being acquired at different focal planes, wherein the camera comprises a sensor which allows a 1:1 imaging scale or greater of the at least one well;

a device for changing the focal plane;

a device for illuminating the at least one well with at least one light source, wherein the device for illumination illuminates the at least one well homogeneously from above; and

a control device configured to:

control the apparatus for acquiring images such that a series of images for each well having a differing focal plane is acquired according to a predefined sequence;

adjust and operate the device for changing the focal plane;

operate the camera; and

store one or more of the images or the series of images,

wherein the control device is connected to the camera via interfaces; and

wherein the system is configured for:

object recognition with respect to the living organisms on the image and automatic classification of the living organisms based on the object recognized with the aid of a neural network trained with annotated images comprising classified living organisms, wherein the classified living organisms of the annotated images are assigned a stage comprising adult, larvae, or egg;

processing the images at different focal planes using a focus stacking method into an image of the at least one well of increased depth of field; and

conducting the object recognition and classification with respect to the living organisms on the image of the at least one well of increased depth of field to determine the effect of the active ingredient applied to the living organisms, wherein the classification is configured to selectively determine the stage of the living organisms as adults, to selectively determine the stage of the living organisms as larvae, and to selectively determine the stage of the living organisms as eggs.

2 . The system of claim 1 , wherein classification in at least one of the following class lists is effected:

living or dead.

3 . The system of claim 2 , wherein the device for illuminating the well is a device for coaxial illumination.

4 . The system of claim 2 , wherein the optical system consists of a fixed-focus lens and one or more intermediate rings.

5 . The system of claim 4 , wherein the device for changing the focal plane is a device for moving the camera along the vertical axis (z).

6 . The system of claim 2 , wherein the system is further configured for processing of the series of images using the focus stacking method into an image that is in focus everywhere.

7 . The system of claim 2 , wherein the apparatus for acquiring macroscopic images comprises a device for positioning the wells that is movable horizontally in two directions (x, y).

8 . The system of claim 7 , wherein the system is further configured to carry out the following steps:

place a well in a predefined position in relation to the optical system by horizontally moving the cell culture plate with the aid of the device for positioning the wells; and

repeat placement for each well until all wells have been recorded.

9 . A method for determining an effect of active ingredients on living organisms accommodated on a support comprising a leaf in at least one well in an assay plate, comprising:

a) placing the assay plate comprising the living organisms and an active ingredient applied to the living organisms accommodated on the support comprising the leaf, and positioning the at least one well in a predefined position in relation to a camera by horizontal movement of the assay plate with the aid of the device for positioning the at least one well, so that multiple images of a scene in which the at least one well comprising the living organisms and the active ingredient accommodated on the support are acquired;

b) setting a focal plane by operation of the device for changing the focal plane;

c) acquiring an image of the at least one well by the camera;

d) storing the image;

e) changing the focal plane by operation of the device for changing the focal plane,

f) repeating steps c) to e) for acquisition of a predefined number of images at different focal planes; and

g) repeating steps a) to f) for another well until images at different focal planes are acquired for all wells, wherein the images at different focal planes are processed using a focus stacking method into an image of the at least one well of increased depth of field; and

h) conducting object recognition with respect to the living organisms on the image and automatic classification of the living organisms based on the object recognized with the aid of a neural network trained with annotated images comprising classified living organisms, wherein the classified living organisms of the annotated images are assigned a stage comprising adult, larvae, or egg, conducting the object recognition and classification with respect to the living organisms on the image of the at least one well of increased depth of field determines the effect of the active ingredient applied to the living organisms, and the classification is configured to selectively determine the stage of the living organisms as adults, to selectively determine the stage of the living organisms as larvae, and to selectively determine the stage of the living organisms as eggs.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (20)