Method for detecting and re-identifying objects using a neural network

1. A method using a neural network, the method comprising the following steps:

extracting features from each of a plurality of images, the features including information about objects in the images;

detecting the objects in the images using an anchor-based object detection based on the extracted features, the detecting including:

determining classification data by a classification of the objects using at least one anchor;

determining regression data by a regression; and

determining, respectively for each of the images, a respective embedding data vector that describes one of the objects based on the extracted features; and

for each respective one of at least one of the objects, tracking the respective object between different ones of the images based on a degree of similarity between the embedding data vectors respectively determined for the different ones of the images, the tracking including identifying that the object identified as being in the different ones of the images is the same.

2. The method as recited in claim 1 , wherein the images between which the respective object is tracked are temporally successive images, and the tracking is further based on the determined classification data and the determined regression data.

3. The method as recited in claim 1 , wherein the detecting of the at least one object and the tracking occur using the same neural network.

4. The method as recited in claim 1 , wherein the embedding data vector is determined by an embedding layer learned with a loss function.

5. The method as recited in claim 4 , wherein the loss function includes a metrics, the metrics including an L2norm or a cosine distance.

6. The method as recited in claim 4 , wherein the embedding layer is learned with object re-identification, distances being used between the embedding data vectors of detected objects.

7. The method as recited in claim 4 , wherein the embedding layer is learned with temporal detection, the embedding data of detected objects being used as input for a tracking algorithm.

8. A neural network, comprising:

a feature extractor configured to extract features from each of a plurality of images, the features including information about objects in the images;

a classification layer configured to determine classification data for detecting the objects in the images using an anchor-based object detection;

a regression layer configured to determine regression data for detecting the objects in the images using the anchor-based object detection; and

an embedding layer configured to determine, respectively for each of the images, a respective embedding data vector that describes one of the objects based on the extracted features;

wherein the neural network is configured to, for each respective one of at least one of the objects, track the respective object between different ones of the images based on a degree of similarity between the embedding data vectors respectively determined for the different ones of the images, the tracking including identifying that the object identified as being in the different ones of the images is the same.

9. A control method for an at least partially autonomous robot, the method comprising the following steps:

receiving image data of the at least partially autonomous robot, the image data including a plurality of images representing a surroundings of the robot;

applying a neural network method using a neural network, the neural network method including:

extracting features from each of the plurality of images, the features including information about objects in the images;

detecting the objects in the images using an anchor-based object detection based on the extracted features, the detecting including:

determining classification data by a classification of the objects using at least one anchor;

determining regression data by a regression; and

determining, respectively for each of the images, a respective embedding data vector that describes one of the objects based on the extracted features; and

for each respective one of at least one of the objects, tracking the respective object between different ones of the images based on a degree of similarity between the embedding data vectors respectively determined for the different ones of the images, the tracking including identifying that the object identified as being in the different ones of the images is the same; and

controlling the at least partially autonomous robot based on the tracking.

10. A non-transitory machine-readable storage medium on which is stored a computer program that is executable by a computer, and that, when executed, causes the computer to perform a method using a neural network, the method comprising the following steps:

extracting features from each of a plurality of images, the features including information about objects in the images;

detecting the objects in the images using an anchor-based object detection based on the extracted features, the detecting including:

determining classification data by a classification of the objects using at least one anchor; and

determining regression data by a regression; and

determining, respectively for each of the images, a respective embedding data vector that describes one of the objects based on the extracted features; and

for each respective one of at least one of the objects, tracking the respective object between different ones of the images based on a degree of similarity between the embedding data vectors respectively determined for the different ones of the images, the tracking including identifying that the object identified as being in the different ones of the images is the same.