IP Library › Granted Patent US 12,737,562
Granted Patent B2
US 12,737,562 · App. 17/663,045 · Granted Sep 15, 2026

Systems and methods for translation evaluation

Inventors: Pin Zhang (Kanagawa, JP); Shivali Goel (Milpitas, CA); Masatoshi Kawachi (Tokyo, JP); Yoshiki Takeoka (Chiba, JP); Reiko Obinata (Chiba, JP)
Assignee: ADOBE INC.
G06F40/51G06F40/284G06F40/47G06F40/58G06N3/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,737,562
App. No.
17/663,045
Granted
Sep 15, 2026
Kind
B2
Abstract

Systems and methods for translation evaluation are provided. One or more aspects of the systems and methods includes receiving a source text, a context identifier for the source text, and a translation text, wherein the source text comprises text from a software application and the context identifier specifies a context of the source text within the software application; generating a source text representation and a translation text representation based on the source text, the context identifier, and the translation text using an encoder of a machine learning model; and generating translation quality information based on the source text representation and the translation text representation using a decoder of the machine learning model.

Claims (60)

1 . A method comprising:

receiving a source text, a context identifier for the source text, and a translation text, wherein the source text comprises text displayed in a user interface of a software application and the context identifier comprises text that describes the user interface;

generating a sequence of contextual embeddings by tokenizing the context identifier to obtain a token sequence and performing contextual embedding on the token sequence to obtain the sequence of contextual embeddings;

generating a context vector based on the sequence of contextual embeddings, wherein the context vector represents the context identifier in a vector space;

generating a source text representation based on the source text and the context vector using an encoder of a machine learning model, wherein the source text representation comprises a representation of the source text and a visual context of the source text based on the context identifier;

generating a translation text representation based on the translation text using the encoder; and

generating a translation quality prediction score for the translation text based on the source text representation and the translation text representation using a decoder of the machine learning model, wherein the translation quality prediction score accounts for the visual context of the source text within the user interface.

2 . The method of claim 1 , further comprising:

generating a source text embedding and a translation text embedding based on the source text and the translation text, respectively, wherein the source text representation and the translation text representation are based on the source text embedding and the translation text embedding, respectively.

3 . The method of claim 2 , further comprising:

identifying a source language of the source text and a translation language of the translation text; and

selecting a source language model based on the source language and a translation language model based on the translation language, wherein the source text embedding and the translation text embedding are based on the source language model and the translation language model, respectively.

4 . The method of claim 2 , further comprising:

removing markup tags from the source text and the translation text to obtain a pre-processed source text and a pre-processed translation text, respectively, wherein the source text embedding is based on the pre-processed source text and the translation text embedding is based on the pre-processed translation text.

5 . The method of claim 2 , further comprising:

replacing localization terms in the source text and the translation text with localization placeholders to obtain a pre-processed source text and a pre-processed translation text, respectively, wherein the source text embedding is based on the pre-processed source text and the translation text embedding is based on the pre-processed translation text.

6 . The method of claim 2 , further comprising:

generating a source text attention mask and a translation text attention mask based on the source text and the translation text, respectively, wherein the source text representation and the translation text representation are based on the source text attention mask and the translation text attention mask, respectively.

7 . The method of claim 2 , further comprising:

generating a hidden source text representation based on the source text embedding and the context vector using a recurrent neural network of the encoder; and

generating a hidden translation text representation based on the translation text embedding using the recurrent neural network.

8 . The method of claim 7 , further comprising:

generating the source text representation and the translation text representation based on the hidden source text representation and the hidden translation text representation, respectively, using a cross-attention component of the encoder.

9 . The method of claim 1 , further comprising:

combining the sequence of contextual embeddings to obtain the context vector.

10 . The method of claim 1 , further comprising:

generating a cross-lingual textual entailment (CLTE) feature vector representing a plurality of structural features of the source text and the translation text, wherein the translation quality prediction information is based on the CLTE feature vector.

11 . The method of claim 10 , further comprising:

identifying a phrase dictionary between a source language of the source text and a target language of the translation text; and

computing dictionary features based on the phrase dictionary, wherein the CLTE feature vector includes the dictionary features.

12 . The method of claim 1 , further comprising:

generating a binary class label for the translation text based on the source text representation and the translation text representation, wherein the translation quality prediction score includes the binary class label.

13 . The method of claim 1 , further comprising:

generating a real-valued score for the translation text based on the source text representation and the translation text representation, wherein the translation quality prediction score includes the real-valued score.

14 . The method of claim 1 , further comprising:

generating a revised translation text for the source text based on the translation quality prediction score.

15 . A method comprising:

receiving training data including a source text, a context identifier for the source text, a translation text, and ground-truth translation quality information, wherein the source text comprises text displayed in a user interface of a software application and the context identifier comprises text that describes the user interface;

generating a sequence of contextual embeddings by tokenizing the context identifier to obtain a token sequence and performing contextual embedding on the token sequence to obtain the sequence of contextual embeddings;

generating a context vector based on the sequence of contextual embeddings, wherein the context vector represents the context identifier in a vector space;

generating a source text representation based on the source text and the context vector using an encoder of a machine learning model, wherein the source text representation comprises a representation of the source text and a visual context of the source text based on the context identifier;

generating a translation text representation based on the translation text using the encoder;

generating a translation quality prediction score for the translation text based on the source text representation and the translation text representation using a decoder of the machine learning model, wherein the translation quality prediction score accounts for the visual context of the source text within the user interface;

computing a loss function based on the predicted translation quality information and the ground-truth translation quality information; and

updating parameters of the machine learning model based on the loss function.

16 . A system comprising:

a memory component; and

a processing device coupled to the memory component, the processing device configured to perform operations comprising:

receiving a source text, a context identifier for the source text, and a translation text, wherein the source text comprises text displayed in a user interface of a software application and the context identifier comprises text that describes the user interface;

generating a sequence of contextual embeddings by tokenizing the context identifier to obtain a token sequence and performing contextual embedding on the token sequence to obtain the sequence of contextual embeddings;

generating a context vector based on the sequence of contextual embeddings, wherein the context vector represents the context identifier in a vector space;

generating a source text representation based on the source text and the context vector using an encoder of a machine learning model, wherein the source text representation comprises a representation of the source text and a visual context of the source text based on the context identifier;

generating a translation text representation based on the translation text using the encoder; and

generating a translation quality prediction score for the translation text based on the source text representation and the translation text representation using a decoder of the machine learning model, wherein the translation quality prediction score accounts for the visual context of the source text within the user interface.

17 . The system of claim 16 , further comprising:

a cross-lingual textual entailment (CLTE) component configured to generate a CLTE feature vector representing a plurality of structural features of the source text and the translation text, wherein the translation quality prediction score is based on the CLTE feature vector.

18 . The system of claim 16 , wherein:

the encoder includes a recurrent neural network and a cross-attention module.

19 . The system of claim 16 , wherein:

the decoder includes a regressor network and a classifier network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2022
From: ZHANG, PIN; GOEL, SHIVALI; KAWACHI, MASATOSHI; TAKEOKA, YOSHIKI; OBINATA, REIKO
To: ADOBE INC.
Reel/Frame 059985/0285 →
Continuity (1)
Related Publication 20230367975A1 · Nov 16, 2023
References Cited (16)
US 7346487B2 · Li · 2008 [cited by examiner]
US 10185713B1 · Denkowski · 2019 [cited by examiner]
US 10235362B1 · Boynes · 2019 [cited by examiner]
US 10572607B1 · Lesner · 2020 [cited by examiner]
US 11551013B1 · Gupta · 2023 [cited by examiner]
US 20160124944A1 · Andreoli · 2016 [cited by examiner]
US 20170323203A1 · Matusov · 2017 [cited by examiner]
US 20190266249A1 · Xu · 2019 [cited by examiner]
US 20200233927A1 · Berger · 2020 [cited by examiner]
US 20210182504A1 · Tu · 2021 [cited by examiner]
US 20220067307A1 · Rei · 2022 [cited by examiner]
CN 112347795A · 2021 [cited by examiner]
CN 113609875A · 2021 [cited by examiner]
1Yuan, et al., “Sentence Level Human Translation Quality Estimation with Attention-based Neural Networks”, arXiv preprint arXiv:2003.06381v1 [cs.CL] Mar. 13, 2020, 9 pages. [cited by applicant]
2Papineni, et al., “BLEU: a Method for Automatic Evaluation of Machine Translation”, In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), Jul. 2002, p. 311-318, 8 pages. [cited by applicant]
3Banerjee, et al., “METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments”, In Proceedings of Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization at… [cited by applicant]