IP Library Granted Patent US 12,614,043
Granted Patent B2
US 12,614,043 · App. 18/255,790 · Granted Apr 28, 2026

Model training method and apparatus, machine translation method and apparatus, and device and storage medium

Inventors: Chengqi Zhao (Beijing, CN); Jianze Liang (Beijing, CN); Mingxuan Wang (Beijing, CN); Lei Li (Beijing, CN)
Assignee: BEIJING YOUZHUJU NETWORK TECHNOLOGY CO., LTD.
G06F40/58G06F40/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,614,043
App. No.
18/255,790
Granted
Apr 28, 2026
Kind
B2
Abstract

Provided are a model training method and apparatus, a machine translation method and apparatus, a device, and a storage medium. The model training method includes the steps described below. Through a neural network pruning technique, a respective influence degree of each parameter in multiple parameters in a first translation model on a translation result in a first field is determined to obtain at least one first parameter and at least one second parameter. By using the first corpus of the first field, the at least one first parameter is trained obtain the second translation model, and the at least one second parameter remains unchanged. Similarity between a translation result of the second translation model in the first field and a translation result of the first translation model in the first field meets a preset condition.

Claims (60)

1 . A model training method, comprising:

determining, through a neural network pruning technique, a respective influence degree of each parameter in a plurality of parameters in a first translation model on a translation result in a first field to obtain at least one first parameter and at least one second parameter, wherein an influence degree of a first parameter on the translation result in the first field is greater than an influence degree of a second parameter on the translation result in the first field, the first translation model is a generic translation model, and the first field is a generic field;

training, by using a first corpus of the first field, the at least one first parameter of the first translation model to obtain a second translation model, wherein the at least one first parameter is updated and the at least one second parameter is unchanged during training, and similarity between a translation result of the second translation model in the first field and a translation result of the first translation model in the first field meets a preset condition; and

training, by using a target corpus in a target field, a target parameter of the second translation model to obtain a target translation model, wherein the target parameter is updated and other parameters except the target parameter in the second translation model are unchanged during training, the target parameter is part or all of the at least one second parameter, and the target field is a specific field.

2 . The method of claim 1 , wherein determining, through the neural network pruning technique, the respective influence degree of the each parameter in the plurality of parameters in the first translation model on the translation result in the first field to obtain the at least one first parameter and the at least one second parameter, comprises:

inputting a second corpus of the first field into the first translation model to obtain a respective influence factor of the each parameter in the first translation model on a translation result;

determining, according to the respective influence factor corresponding to the each parameter, a respective influence degree of the each parameter on the translation result; and

recording a parameter whose influence degree is greater than or equal to a set threshold as a first parameter and recording a parameter whose influence degree is less than the set threshold as a second parameter.

3 . The method of claim 1 , wherein training, by using the first corpus of the first field, the at least one first parameter of the first translation model to obtain the second translation model, comprises:

acquiring a first source language text in the first field and a first reference translated text corresponding to the first source language text;

inputting the first source language text into the first translation model to obtain an output result of the first translation model; and

determining a matching degree between the output result and the first reference translated text;

in a case where the matching degree is less than a first set threshold, adjusting the at least one first parameter of the first translation model until the matching degree of the output result and the first reference translated text is greater than or equal to the first set threshold, and recording the first translation model corresponding to the matching degree greater than or equal to the first set threshold as the second translation model.

4 . The method of claim 1 , wherein training, by using the target corpus in the target field, the target parameter of the second translation model to obtain the target translation model, comprises:

acquiring a second source language text in the target field and a second reference translated text corresponding to the second source language text;

inputting the second source language text into the second translation model to obtain an output result of the second translation model; and

determining a matching degree between the output result and the second reference translated text; in a case where the matching degree is less than a second set threshold, adjusting the target parameter of the second translation model until the matching degree of the output result and the second reference translated text is greater than or equal to the second set threshold, and recording the second translation model corresponding to the matching degree greater than or equal to the second set threshold as the target translation model.

5 . A non-transitory computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to implement the model training method of claim 1 .

6 . A machine translation method, comprising:

acquiring a source language text to be translated; and

inputting the source language text into a preset machine translation model, and acquiring an output result of the preset machine translation model as a translation result of the source language text, wherein the preset machine translation model is trained by a model training method, and the model training method comprises:

determining, through a neural network pruning technique, a respective influence degree of each parameter in a plurality of parameters in a first translation model on a translation result in a first field to obtain at least one first parameter and at least one second parameter, wherein an influence degree of a first parameter on the translation result in the first field is greater than an influence degree of a second parameter on the translation result in the first field, the first translation model is a generic translation model, and the first field is a generic field;

training, by using a first corpus of the first field, the at least one first parameter of the first translation model to obtain a second translation model, wherein the at least one first parameter is updated and the at least one second parameter is unchanged during training, and similarity between a translation result of the second translation model in the first field and a translation result of the first translation model in the first field meets a preset condition; and

training, by using a target corpus in a target field, a target parameter of the second translation model to obtain a target translation model, wherein the target parameter is updated and other parameters except the target parameter in the second translation model are unchanged during training, the target parameter is part or all of the at least one second parameter, and the target field is a specific field.

7 . The method of claim 6 , wherein determining, through the neural network pruning technique, the respective influence degree of the each parameter in the plurality of parameters in the first translation model on the translation result in the first field to obtain the at least one first parameter and the at least one second parameter, comprises:

inputting a second corpus of the first field into the first translation model to obtain a respective influence factor of the each parameter in the first translation model on a translation result;

determining, according to the respective influence factor corresponding to the each parameter, a respective influence degree of the each parameter on the translation result; and

recording a parameter whose influence degree is greater than or equal to a set threshold as a first parameter and recording a parameter whose influence degree is less than the set threshold as a second parameter.

8 . The method of claim 6 , wherein training, by using the first corpus of the first field, the at least one first parameter of the first translation model to obtain the second translation model, comprises:

acquiring a first source language text in the first field and a first reference translated text corresponding to the first source language text;

inputting the first source language text into the first translation model to obtain an output result of the first translation model; and

determining a matching degree between the output result and the first reference translated text;

in a case where the matching degree is less than a first set threshold, adjusting the at least one first parameter of the first translation model until the matching degree of the output result and the first reference translated text is greater than or equal to the first set threshold, and recording the first translation model corresponding to the matching degree greater than or equal to the first set threshold as the second translation model.

9 . The method of claim 6 , wherein training, by using the target corpus in the target field, the target parameter of the second translation model to obtain the target translation model, comprises:

acquiring a second source language text in the target field and a second reference translated text corresponding to the second source language text;

inputting the second source language text into the second translation model to obtain an output result of the second translation model; and

determining a matching degree between the output result and the second reference translated text;

in a case where the matching degree is less than a second set threshold, adjusting the target parameter of the second translation model until the matching degree of the output result and the second reference translated text is greater than or equal to the second set threshold, and recording the second translation model corresponding to the matching degree greater than or equal to the second set threshold as the target translation model.

10 . A non-transitory computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to implement the machine translation method of claim 6 .

11 . An electronic device, comprising:

one or more processors; and

a memory, which is configured to store one or more programs;

wherein the one or more programs, when executed by the one or more processors, perform steps, wherein the steps comprise:

determining, through a neural network pruning technique, a respective influence degree of each parameter in a plurality of parameters in a first translation model on a translation result in a first field to obtain at least one first parameter and at least one second parameter, wherein an influence degree of a first parameter on the translation result in the first field is greater than an influence degree of a second parameter on the translation result in the first field, the first translation model is a generic translation model, and the first field is a generic field;

training, by using a first corpus of the first field, the at least one first parameter of the first translation model to obtain a second translation model, wherein the at least one first parameter is updated and the at least one second parameter is unchanged during training, and similarity between a translation result of the second translation model in the first field and a translation result of the first translation model in the first field meets a preset condition; and

training, by using a target corpus in a target field, a target parameter of the second translation model to obtain a target translation model, wherein the target parameter is updated and other parameters except the target parameter in the second translation model are unchanged during training, the target parameter is part or all of the at least one second parameter, and the target field is a specific field.

12 . The electronic device of claim 11 , wherein determining, through the neural network pruning technique, the respective influence degree of the each parameter in the plurality of parameters in the first translation model on the translation result in the first field to obtain the at least one first parameter and the at least one second parameter, comprises:

inputting a second corpus of the first field into the first translation model to obtain a respective influence factor of the each parameter in the first translation model on a translation result;

determining, according to the respective influence factor corresponding to the each parameter, a respective influence degree of the each parameter on the translation result; and

recording a parameter whose influence degree is greater than or equal to a set threshold as a first parameter and recording a parameter whose influence degree is less than the set threshold as a second parameter.

13 . The electronic device of claim 11 , wherein training, by using the first corpus of the first field, the at least one first parameter of the first translation model to obtain the second translation model, comprises:

acquiring a first source language text in the first field and a first reference translated text corresponding to the first source language text;

inputting the first source language text into the first translation model to obtain an output result of the first translation model; and

determining a matching degree between the output result and the first reference translated text;

in a case where the matching degree is less than a first set threshold, adjusting the at least one first parameter of the first translation model until the matching degree of the output result and the first reference translated text is greater than or equal to the first set threshold, and recording the first translation model corresponding to the matching degree greater than or equal to the first set threshold as the second translation model.

14 . The electronic device of claim 11 , wherein training, by using the target corpus in the target field, the target parameter of the second translation model to obtain the target translation model, comprises:

acquiring a second source language text in the target field and a second reference translated text corresponding to the second source language text;

inputting the second source language text into the second translation model to obtain an output result of the second translation model; and

determining a matching degree between the output result and the second reference translated text;

in a case where the matching degree is less than a second set threshold, adjusting the target parameter of the second translation model until the matching degree of the output result and the second reference translated text is greater than or equal to the second set threshold, and recording the second translation model corresponding to the matching degree greater than or equal to the second set threshold as the target translation model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2026
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.; BEIJING JIYUN INTERACTION TECHNOLOGY CO., LTD.,
To: BEIJING YOUZHUJU NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 074237/0677 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2026
From: ZHAO, CHENGQI; LIANG, JIANZE; WANG, MINGXUAN; LI, LEI
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.; BEIJING JIYUN INTERACTION TECHNOLOGY CO., LTD.,
Reel/Frame 074237/0431 →
Priority Claims (1)
CN 202011412735.7 · Dec 4, 2020 · national
Continuity (1)
Related Publication 20240037349A1 · Feb 1, 2024
References Cited (27)
US 10878201B1 · Wuebker · 2020 [cited by examiner]
US 10963652B2 · Hashimoto · 2021 [cited by examiner]
US 20160124942A1 · Amin et al. · 2016 [cited by applicant]
US 20200242492A1 · Goel et al. · 2020 [cited by applicant]
US 20200364412A1 · Cheng et al. · 2020 [cited by applicant]
US 20210097144A1 · Bapna · 2021 [cited by examiner]
CN 106355248A · 2017 [cited by applicant]
CN 108829684A · 2018 [cited by applicant]
CN 109117483A · 2019 [cited by applicant]
CN 110555213A · 2019 [cited by applicant]
CN 110598848A · 2019 [cited by applicant]
CN 111008533A · 2020 [cited by applicant]
CN 111104807A · 2020 [cited by applicant]
CN 111353545A · 2020 [cited by applicant]
CN 111859991A · 2020 [cited by applicant]
CN 111859995A · 2020 [cited by applicant]
CN 112380883A · 2021 [cited by applicant]
WO 2019024050A1 · 2019 [cited by applicant]
Wuebker et al. “Compact Personalized Models for Neural Machine Translation”. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 881-886 Brussels, Belgium, Oct. 31-Nov. 4, 2018 (Y… [cited by examiner]
Gu et al. “Investigating Catastrophic Forgetting During Continual Training for Neural Machine Translation”. arXiv:2011.00678v1 [cs.CL] Nov. 2, 2020. (Year: 2020). [cited by examiner]
Simianer et al. (“Measuring Immediate Adaptation Performance for Neural Machine Translation”. Proceedings of NAACL-HLT 2019, pp. 2038-2046 Minneapolis, Minnesota, Jun. 2-Jun. 7, 2019 (Year: 2019). [cited by examiner]
Thompson et al. (“Freezing Subnetworks to Analyze Domain Adaptation in Neural Machine Translation”. Proceedings of the Third Conference on Machine Translation (WMT), vol. 1: Research Papers, pp. 124-132 Belgium, Brussel… [cited by examiner]
International Search Report issued Feb. 7, 2022 in International Application No. PCT/CN2021/131073, with English translation (6 pages). [cited by applicant]
Search Report issued Jun. 25, 2023 in Chinese Application No. 2020114127357, with English translation (8 pages). [cited by applicant]
Chaochao Wang, et al., “Translation Similarity Model Based on Bilingual Compositional Semantics,” Acta Scientiarum Naturalium Universitatis Pekinensis, vol. 51, No. 2, Mar. 2015, pp. 335-341. [cited by applicant]
International Search Report for International Application No. PCT/CN2021/117199, mailed Dec. 17, 2021, 5 pages. [cited by applicant]
Written Opinion for International Application No. PCT/CN2021/131073, mailed Feb. 7, 2022, 09 Pages. [cited by applicant]