IP Library › Granted Patent US 12,248,864
Granted Patent B2
US 12,248,864 · App. 17/500,645 · Granted Mar 11, 2025

Method of training artificial neural network and method of evaluating pronunciation using the method

Inventors: Seung Won Park (Gyeonggi-do, KR); Jong Mi Lee (Gyeonggi-do, KR); Kang Wook Kim (Seoul, KR)
Assignee: MINDS LAB INC.
G06N3/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,248,864
App. No.
17/500,645
Filed
Oct 13, 2021
Granted
Mar 11, 2025
Kind
B2
Examiner
NABI, REZA U
Art Unit
2142
USPC
706/26
Abstract

The disclosure relates to a method of training an artificial neural network so that a first artificial neural network is trained based on a plurality of training data including a first feature and a second feature that has a correlation with the first feature and depends on the first feature.

Claims (7)

1. A method of training an artificial neural network, the method comprising: generating first output data corresponding to first training input data, by using a first artificial neural network, wherein the first artificial neural network is trained based on a plurality of training data comprising a first feature and a second feature that has a correlation with the first feature and depends on the first feature; and the first artificial neural network is a neural network trained to generate output data corresponding to the first feature from input data; generating third output data corresponding to the first output data and second training output data, by using a second artificial neural network, wherein the second artificial neural network is a neural network trained to output a result of comparison between the first output data and the second training output data, and the second training output data includes data comprising the second feature of the first training input data; generating at least one weight correction value for training the first artificial neural network based on the third output data; and applying the at least one weight correction value to the first artificial neural network, wherein the least one weight correction value is determined by a method in which a scale factor applied to at least one gradient value.

2. The method of claim 1 , further comprising after generating the first output data, generating fourth output data corresponding to the first output data and third training output data, by using a third artificial neural network, wherein the third artificial neural network is a neural network trained to output a result of comparison between the first output data and the third training output data, and the third training output data includes data comprising the first feature of the first training input data.

3. The method of claim 1 , further comprising: generating each of the plurality of training data including: the first training input data, third training output data comprising the first feature of the first training input data, and the second training output data comprising the second feature of the first training input data.

4. The method of claim 3 , further comprising: generating first training data from among the plurality of training data including: uttered voice data of a first language of a first speaker as the first training input data, data comprising a feature of the first language as the third training output data, and data comprising a feature of the first speaker as the second training output data, and generating second training data from among the plurality of training data including: uttered voice data of a second language of a second speaker as the first training input data, data comprising a feature of the second language as the third training output data, and data comprising a feature of the second speaker as the second training output data.

5. The method of claim 4 , wherein: generating the first output data further comprises outputting the first output data from the uttered voice data of the first language of the first speaker, generating the third output data further comprises generating the third output data that is a result of comparison between the first output data and the second training output data comprising the feature of the first speaker, and generating the at least one weight correction value further comprises, by referring to the third output data, generating the at least one weight correction value for reducing the feature of the first speaker, from the first output data.

6. The method of claim 4 , wherein: generating the first output data further comprises generating the first output data from the uttered voice data of the second language of the second speaker, generating the third output data further comprises generating the third output data that is a result of comparison between the first output data and the second training output data comprising the feature of the second speaker, and generating the at least one weight correction value further comprises, by referring to the third output data, generating the at least one weight correction value for reducing the feature of the second speaker, from the first output data.

7. The method of claim 1 , further comprising, after the generating of the first output data, generating the first output data depending on a feature of a first language, from input data comprising uttered voice data of the first language of a third speaker, by using the first artificial neural network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2021
From: PARK, SEUNG WON; LEE, JONG MI; KIM, KANG WOOK
To: MINDS LAB INC.
Reel/Frame 057794/0643 →
Priority Claims (1)
KR 10-2020-0165065 · Nov 30, 2020 · national
Continuity (2)
Continuation PCTKR2021010130 · Aug 3, 2021
Related Publication 20220172025A1 · Jun 2, 2022
References Cited (23)
US 10204307B1 · Dasgupta · 2019 [cited by examiner]
US 10311872B2 · Howard et al. · 2019 [cited by applicant]
US 11948074B2 · Jung · 2024 [cited by examiner]
US 20150186359A1 · Fructuoso · 2015 [cited by examiner]
US 20190266141A1 · Coroiu · 2019 [cited by examiner]
US 20200020327A1 · Chae et al. · 2020 [cited by applicant]
US 20200082807A1 · Kim · 2020 [cited by examiner]
US 20200160869A1 · Heigold · 2020 [cited by examiner]
US 20200302246A1 · Shen · 2020 [cited by examiner]
US 20200342852A1 · Kim · 2020 [cited by examiner]
US 20200380293A1 · Finnie · 2020 [cited by examiner]
US 20200380359A1 · Finnie · 2020 [cited by examiner]
US 20210406601A1 · Narlikar · 2021 [cited by examiner]
US 20220107858A1 · Jain · 2022 [cited by examiner]
US 20220131900A1 · Karin · 2022 [cited by examiner]
US 20220172025A1 · Park · 2022 [cited by examiner]
US 20220342022A1 · O'Brien · 2022 [cited by examiner]
US 20230169778A1 · Hasberg · 2023 [cited by examiner]
US 20240142573A1 · Hakobyan · 2024 [cited by examiner]
KR 1020190085879A · 2019 [cited by applicant]
KR 1020190085882A · 2019 [cited by applicant]
KR 1020200023456A · 2020 [cited by applicant]
International Search Report for corresponding International Application No. PCT/KR2021/010130, mailed Nov. 5, 2021, 6 pages. [cited by applicant]