IP Library › Granted Patent US 12,547,897
Granted Patent B2
US 12,547,897 · App. 17/786,802 · Granted Feb 10, 2026

Position determination by means of neural networks

Inventor: Michael Holicki (Berlin, DE)
Assignee: Cariad SE
G06N3/084G01C21/3848G05D1/0246G06V10/454G06V10/774G06V10/82G06V20/56G06V2201/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,547,897
App. No.
17/786,802
Granted
Feb 10, 2026
Kind
B2
Abstract

A method for training an artificial neural generator network for the generating of synthetic landmark images is provided, in which landmark images are extracted from at least one training map as training data, which form a first training data set, and the generator network as a generator of a generative adversarial network learns with the aid of the first training data set and with the aid of real, non-annotated image data, recorded by a sensor device, to generate synthetic landmark images which are suited to reproducing the probability distribution underlying the first training data set. The invention also relates to a method for training an artificial neural localization network by the trained generator network and a method for determining a position of a mobile unit with at least one sensor device and at least one environment map by the trained localization network.

Claims (19)

1 . A method for training an artificial neural generator network that generates synthetic landmark images, comprising:

extracting landmark images from at least one training map as training data, which form a first training data set, and

training the artificial neural generator network as a generator of a generative adversarial network using the first training data set and real, non-annotated image data, recorded by a sensor device, to generate synthetic landmark images which are suited to reproducing a probability distribution underlying the first training data set,

wherein an input of the artificial neural generator network comprises at least one image of the sensor device as real non-annotated image data.

2 . The method according to claim 1 , wherein the at least one training map comprises a first known landmark and/or an object class indication of a first known landmark.

3 . The method according to claim 1 , wherein the at least one training map is three-dimensional or two-dimensional.

4 . A method for training an artificial neural localization network, comprising:

performing a method for training an artificial neural generator network that generates synthetic landmark images, by extracting landmark images from at least one training map as training data, which form a first training data set, and wherein the artificial neural generator network as a generator of a generative adversarial network learns using the first training data set and using real, non-annotated image data, recorded by a sensor device, to generate synthetic landmark images which are suited to reproducing a probability distribution underlying the first training data set;

after performing the method for training of the artificial neural generator network, generating synthetic landmark images as training data, forming a second training data set; and

wherein the artificial neural localization network learns using the second training data set and using the at least one training map to determine a relative posture of an image of the second training data set relative to an image generated from the training map.

5 . The method according to claim 4 , wherein the artificial neural localization network is a convolutional neural network and/or is trained by a supervised machine learning method.

6 . A method for determining a position of a mobile unit with at least one sensor device and at least one environment map, including an initial position estimation, the method comprising:

performing a method for training an artificial neural generator network that generates synthetic landmark images, by extracting landmark images from at least one training map as training data, which form a first training data set, and wherein the artificial neural generator network as a generator of a generative adversarial network learns using the first training data set and using real, non-annotated image data, recorded by a sensor device, to generate synthetic landmark images which are suited to reproducing a probability distribution underlying the first training data set;

performing a method for training an artificial neural localization network, by, after performing the method for training of the artificial neural generator network, generating synthetic landmark images as training data, forming a second training data set; and wherein the artificial neural localization network learns using the second training data set and using the at least one training map to determine a relative posture of an image of the second training data set relative to an image generated from the training map; and

after the images recorded by the sensor device are processed by the artificial neural generator network and results are generated for the determination of a relative posture by the artificial neural localization network, performing an updating of an initial position of the mobile unit by a comparison between the initial position estimation and the relative posture from the artificial neural localization network.

7 . The method according to claim 6 , wherein when determining the position of the mobile unit an initial estimation of the position of the mobile unit is made by an odometric method.

8 . The method according to claim 6 , wherein when determining the position of the mobile unit an initial estimation of the position of the mobile unit is taken into account by at least one other sensor device.

9 . The method according to claim 6 , wherein the at least one environment map is three-dimensional or two-dimensional.

10 . The method according to claim 6 , wherein a position of the mobile unit comprises values for coordinates and/or angle of orientation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: HOLICKI, MICHAEL
To: CARIAD SE
Reel/Frame 067300/0544 →
Priority Claims (1)
DE 102019135294.0 · Dec 19, 2019 · national
Continuity (1)
Related Publication 20230350418A1 · Nov 2, 2023
References Cited (11)
US 7606416B2 · Han · 2009 [cited by examiner]
US 20180293466A1 · Viswanathan · 2018 [cited by applicant]
US 20190147582A1 · Lee et al. · 2019 [cited by applicant]
DE 102018124211A1 · 2019 [cited by applicant]
Goodfellow et al., “Generative Adversarial Nets,” Advances in Neural Information Processing Systems 27 (NIPS), 2014, URL=https://arxiv.org/pdf/1406.2661.pdf, downloaded on Nov. 19, 2019. (9 pages). [cited by applicant]
Li et al., “Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry,” arxiv.org, Cornell University Library, 201 Olin Library, Cornell University, Ithaca, New York 14853, Aug. 23, 2019, pp. 2851-2860. (… [cited by applicant]
Shotton et al., “Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images,” 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, US, Jun. 23, 2013, pp. 2930… [cited by applicant]
Sturm et al., “A Benchmark for the Evaluation of RGB-D SLAM Systems,” Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference, Ontario, Canada, Oct. 7, 2012, pp. 573-580. (8 pages). [cited by applicant]
Valigi, “GANLoc: Camera relocalization based on Conditional Adversarial Networks,” Dec. 1, 2017, URL=https://nicolovaligi.com/pages/research/2017_nicolo_valigi_ganloc_camera_relocalization_conditional_adversarial_networ… [cited by applicant]
International Search Report, mailed Mar. 10, 2021, for International Patent Application No. PCT/EP2020/084688. (2 pages). [cited by applicant]
Written Opinion of the International Searching Authority, mailed Mar. 10, 2021, for International Patent Application No. PCT/EP2020/084688. (6 pages). [cited by applicant]