IP Library Granted Patent US 12,530,572
Granted Patent B2
US 12,530,572 · App. 17/204,188 · Granted Jan 20, 2026

Method for configuring a neural network model

Inventors: Bence Tilk (Oslo, NO); Csaba Nemes (Dunakeszi, HU)
Assignee: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
G06N3/08G06F18/2155G06F18/2163G06F18/241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,530,572
App. No.
17/204,188
Granted
Jan 20, 2026
Kind
B2
Abstract

The invention relates to a computer-implemented method ( 100 ) for configuring a neural network model, wherein the method comprises the following steps: providing ( 102 ) a neural network model; splitting ( 104 ) the neural network model into a first portion and a second portion, the second portion comprising a first head for classifying a first type of classification data and a second head for classifying the second type of classification data; pre-processing ( 106 ), in a training phase, the second type of classification data in the first portion, processing ( 108 ) the pre-processed second type of classification data in the first and second heads and determining a first result of the processing of first type of classification data in the first head and a second result of the processing of first type of classification data in the second head; calculating ( 110 ) the consistency between the first result and the second result; and configuring ( 112 ) the neural network model by updating a value of at least one parameter of the second head based on the calculated consistency.

Claims (26)

1 . A computer-implemented method for configuring neural network model, wherein the method comprises:

providing the neural network model;

splitting the neural network model into a first portion and a second portion, the second portion comprising a first head, configured to classify a first type of classification data and a second head, configured to classify the second type of classification data, wherein the second type of classification data is a target data;

pre-processing, in a training phase, the second type of classification data in the first portion,

processing the pre-processed second type of classification data in the first and second heads and determining a first result of the processing of second type of classification data in the first head and a second result of the processing of second type of classification data in the second head;

calculating a consistency between the first result and the second result, both the first result and the second result relating to the target data;

calculating a first head accuracy for the first head;

only configuring the neural network model by updating a value of at least one parameter of the second head and at least one parameter of the first head based on the calculated consistency when the first head accuracy is greater than a pre-defined threshold, such that the first head has a substantiated basis in order to provide knowledge transfer to the second head; and

training the neural network model for detecting or classifying objects or features in images of an environment of a vehicle in an advanced driver assistance system (ADAS) or an automated driving (AD) camera system,

wherein at least portions of the first type of classification data and the second type of classification data are labeled, and wherein labels of the second type of classification data denominated as target labels are prioritized over labels of the first type of classification data denominated as source labels by mixing the updated values of the at least one parameter of the second head and the at least one parameter of the first head with a relation corresponding to the calculated consistency, to indicate that patterns of the target labels are more important than patterns of the source labels.

2 . The computer-implemented method according to claim 1 , wherein the artificial intelligence module is embodied as a neural network.

3 . The computer-implemented method according to claim 1 , wherein the first portion comprises encoder layers, and the second portion comprises classification layers.

4 . The computer-implemented method according to claim 1 , wherein the first type of classification data is correlated with the second type of classification data.

5 . The computer-implemented method according to claim 4 , wherein the images show the same scene, but a first image dataset is recorded at a day time and a second image dataset is recorded at a night time.

6 . The computer-implemented method according to claim 1 , wherein the neural network model provides domain adaptation, and the first type of classification data is source data.

7 . The computer-implemented method according to claim 1 , wherein, previous to the step of pre-processing the second type of classification data in the first portion, a training of the first portion and training of the first head is performed.

8 . The computer-implemented method according to claim 1 , wherein a first head standard loss is calculated for the first head, and the step configuring the neural network model by updating a value of at least one parameter of the second head and at least one parameter of the first head based on the calculated consistency is only performed if the first head standard loss is lower than a pre-defined threshold.

9 . The computer-implemented method according to claim 1 , wherein the parameter values to be updated in the first and/or second head are weights of the neural network.

10 . The computer-implemented method according to claim 1 , wherein the second type of classification data is partly labelled and partly unlabelled.

11 . The computer-implemented method according to claim 1 , wherein the output of the first and the second head is categorical, and the calculation of the consistency takes place on the basis of the Jensen-Shannon divergence.

12 . The computer-implemented method according to claim 2 , wherein the output of the first and the second head is continuous, and the calculation of the consistency is carried out on the basis of a mean square error.

13 . A neural network stored on a non-transitory computer readable medium, the neural network having a configuration achieved with the computer-implemented method according to claim 1 .

14 . Use of the neural network according to claim 13 for detecting a lane, an object, or a key point, for semantic segmentation, for classifying text, an acoustic pattern, or an object, or to estimate a pose.

15 . A computer program element stored on a non-transitory computer readable medium, the program element comprising instructions which, when the program element is executed by a computer, cause the computer to carry out the steps of the method according to claim 1 .

16 . A non-transitory computer-readable medium comprising instructions which, when executed by a computer, cause the computer to carry out the steps of the method according to claim 1 .

17 . The computer-implemented method according to claim 1 , wherein the artificial intelligence module is embodied as a convolutional neural network.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2025
From: CONTINENTAL AUTOMOTIVE GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 070438/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2021
From: TILK, BENCE; NEMES, CSABA
To: CONTINENTAL AUTOMOTIVE GMBH
Reel/Frame 055623/0851 →
Priority Claims (1)
EP 20165187 · Mar 24, 2020 · regional
Continuity (1)
Related Publication 20210303999A1 · Sep 30, 2021
References Cited (25)
CN 108197670A · 2018 [cited by applicant]
CN 108399431A · 2018 [cited by applicant]
Li, J., et al, Transfer Independently Together: A Generalized Framework for Domain Adaptation, [received Oct. 31, 2024]. Retrieved from Internet :<https://ieeexplore.ieee.org/abstract/document/8337102?casa_token=_Ri4ys-… [cited by examiner]
Han, Y., et al, Deep learning with domain adaptation for accelerated projection-reconstruction MR, [received Jun. 14, 2024]. Retrieved from internet :<https://onlinelibrary.wiley.com/doi/full/10.1002/mrm.27106> (Year: 2… [cited by examiner]
Liu, M., et al, Unsupervised Image-to-Image Translation Networks. Retrieved from Internet :<https://proceedings.neurips.cc/paper_files/paper/2017/hash/dc6a6489640ca02b0d42dabeb8e46bb7-Abstract.html> (Year: 2017). [cited by examiner]
Long, M., et al, Learning Transferable Features with Deep Adaptation Networks. Retrieved from Internet :<https://proceedings.mlr.press/v37/long15> (Year: 2015). [cited by examiner]
Pereira, L., et al, Semi-supervised transfer subspace for domain adaptation. Retrieved from Internet :<https://www.sciencedirect.com/science/article/pii/S0031320317301632> (Year: 2018). [cited by examiner]
Shu, R., et al, A DIRT-T Approach to Unsupervised Domain Adaptation. Retrieved from Internet: <https://arxiv.org/abs/1802.08735> (Year: 2018). [cited by examiner]
Song, Y., et al, Improving Unsupervised Domain Adaptation with Variational Information Bottleneck. Retrieved from Internet :<https://arxiv.org/abs/1911.09310> (Year: 2019). [cited by examiner]
Zhang, Y., et al, Unsupervised Multi-Class Domain Adaptation: Theory, Algorithms, and Practice. Retrieved from Internet :<https://ieeexplore.ieee.org/abstract/document/9253700> (Year: 2020). [cited by examiner]
Zhu, K., et al, A survey of generative adversarial networks. Retrieved from Internet :<https://ieeexplore.ieee.org/abstract/document/8623645> (Year: 2018). [cited by examiner]
Li, J., et al, Transfer Independently Together: A Generalized Framework for Domain Adaptation. Retrieved from Internet :<https://ieeexplore.ieee.org/abstract/document/8337102?casa_token=_Ri4ys-elukAAAAA:mCYcLMKKNBjmOqA6… [cited by examiner]
Roy, S., et al, Unsupervised Domain Adaptation using Feature-Whitening and Consensus Loss, [received Feb. 7, 2025]. Retrieved from Internet: <https://openaccess.thecvf.com/content_CVPR_2019/html/Roy_Unsupervised_Domain_… [cited by examiner]
Ren, L., et al, Environment Influences on Uncertainty of Object Detection for Automated Driving Systems. Retrieved from Internet :< ieeexplore.ieee.org/abstract/document/8965948?casa_token=Z7k9fhVSVAYAAAAA:LTwsKs3Gjoa5Q… [cited by examiner]
Ben-David, S., et al, A theory of learning from different domains. Retrieved from Internet: <https://link.springer.com/article/10.1007/s10994-009-5152-4> (Year: 2010). [cited by examiner]
Extended European Search Report and Examination Report for European Patent Application No. 20165187.4, dated Oct. 23, 2020, 9 pages, European Patent Office, Munich, Germany. [cited by applicant]
Yabin Zhang et al., “Unsupervised Multi-Class Domain Adaptation: Theory, Algorithms, and Practice”, Journal of Latex Class Files, vol. 14, No. 8, arXiv:2002.08681v1, Feb. 20, 2020, XP081604178, pp. 1 to 27. [cited by applicant]
Safa Cicek et al., “Unsupervised Domain Adaptation via Regularized Conditional Alignment”, 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Oct. 27, 2019, XP033723361, pp. 1416 to 1425. [cited by applicant]
Toshihiko Matsuura et al., “TWINs: Two Weighted Inconsistency-reduced Networks for Partial Domain Adaptation”, arXiv:1812.07405v1, Dec. 18, 2018, XP080994261, pp. 1 to 11. [cited by applicant]
Antti Tarvainen et al., “Mean Teachers are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-Supervised Deep Learning Results”, arXiv:1703.01780v6, Apr. 16, 2018, pp. 1 to 16. [cited by applicant]
Kuniaki Saito et al., “Semi-Supervised Domain Adaptation via Minimax Entropy”, arXiv:1904.06487v2, Apr. 16, 2019, pp. 1 to 12. [cited by applicant]
Saito et al., “Maximum Classifier Discrepancy for Unsupervised Domain Adaptation”, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, (Jun. 18, 2018), pp. 3723-3732. [cited by applicant]
Office Action (Communication pursuant to Article 94(3) EPC) issued May 13, 2024, by the European Patent Office in corresponding European Patent Application No. 20 165 187.4-1203. (9 pages). [cited by applicant]
Office Action (The First Office Action) issued Apr. 22, 2024, by the State Intellectual Property Office of People's Republic of China in corresponding Chinese Patent Application No. 202110308883.2 and an English transla… [cited by applicant]
Office Action (Communication pursuant to Article 94(3) EPC) issued Jul. 4, 2025, by the European Patent Office in corresponding European Patent Application No. 20 165 187.4-1207. (3 pages). [cited by applicant]