IP Library › Granted Patent US 11,367,451
Granted Patent B2
US 11,367,451 · App. 16/519,757 · Granted Jun 21, 2022

Method and apparatus with speaker authentication and/or training

Inventors: Kyuhong Kim (Seoul, KR); Insoo Kim (Seongnam-si, KR); Dohwan Lee (Suwon-si, KR); Hana Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L17/04G06N3/0454G10L15/16G10L17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,367,451
App. No.
16/519,757
Granted
Jun 21, 2022
Kind
B2
Abstract

A speaker authentication method and apparatus may extract input speaker features corresponding to a plurality of frames of an input speech of an object, estimate discriminable speaker sections corresponding to the plurality of frames, and dynamically match the input speaker features to pre-enrolled enrolled speaker features based on the discriminable speaker section.

Claims (57)

1. A speaker authentication method, comprising:

receiving a plurality of frames corresponding to an input speech;

extracting input speaker features corresponding to the plurality of frames;

estimating discriminable speaker sections corresponding to the plurality of frames;

dynamically matching the input speaker features to pre-enrolled enrolled speaker features based on the discriminable speaker sections; and

performing a speaker authentication based on a result of the dynamic matching,

wherein the dynamic matching comprises:

assigning a first weight to an input speaker feature corresponding to a pre-determined short pause among the input speaker features;

assigning a second weight to an input speaker feature corresponding to a speech among the input speaker features; and

dynamically matching each of the first weight-assigned input speaker feature and the second weight-assigned input speaker feature to the pre-enrolled enrolled speaker features.

2. The method of claim 1 , wherein the dynamic matching comprises:

selecting input speaker features having discriminable speaker sections greater than or equal to a threshold value; and

dynamically matching the selected input speaker features to the pre-enrolled enrolled speaker features.

3. The method of claim 1 , wherein the dynamic matching comprises:

dropping an input speaker feature having a discriminable speaker section less than a threshold value;

dropping a pre-enrolled enrolled speaker feature corresponding to the dropped input speaker feature; and

dynamically matching remaining input speaker features, excluding the dropped input speaker feature, to remaining enrollment speaker features, excluding the dropped pre-enrolled enrollment speaker feature.

4. The method of claim 1 , wherein the dynamic matching comprises:

assigning a weight to input speaker features having discriminable speaker sections being greater than or equal to a threshold value; and

dynamically matching the weight-assigned input speaker features to the pre-enrolled enrolled speaker features.

5. The method of claim 1 , wherein the dynamic matching comprises:

dropping an input speaker feature corresponding to a short pause among the input speaker features; and

dynamically matching remaining input features, excluding the dropped input speaker feature, to the pre-enrolled enrolled speaker features.

6. The method of claim 1 , wherein the dynamic matching comprises:

aligning the pre-enrolled enrolled speaker features representing phonemes identical to phonemes represented by the input speaker features; and

dynamically matching the input speaker features to the aligned pre-enrolled enrolled speaker features.

7. The method of claim 1 , wherein the performing comprises:

outputting a distance corresponding to the input speech by accumulating results of the dynamic matching; and

performing the speaker authentication based on a result of comparing the distance to a threshold value.

8. The method of claim 1 , wherein the extracting comprises extracting the input speaker features based on per-frequency energies of the plurality of frames.

9. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the speaker authentication method of claim 1 .

10. A speaker authentication apparatus, comprising:

a communication interface configured to receive a plurality of frames corresponding to an input speech; and

a processor configured to:

extract input speaker features corresponding to the plurality of frames;

estimate discriminable speaker sections corresponding to the plurality of frames;

dynamically match the input speaker features to pre-enrolled enrolled speaker features based on the discriminable speaker sections; and

perform a speaker authentication based on a result of the dynamic matching,

wherein, for the dynamic matching, the processor is configured to:

assign a first weight to an input speaker feature corresponding to a pre-determined short pause among the input speaker features;

assign a second weight to an input speaker feature corresponding to a speech among the input speaker features; and

dynamically match each of the first weight-assigned input speaker feature and the second weight-assigned input speaker feature to the pre-enrolled enrolled speaker features.

11. The apparatus of claim 10 , wherein the processor is configured to select input speaker features having discriminable speaker sections greater than or equal to a threshold value, and dynamically match the selected input speaker features to the pre-enrolled enrolled speaker features.

12. The apparatus of claim 10 , wherein the processor is configured to drop an input speaker feature having a discriminable speaker section less than a threshold value, and dynamically match remaining input speaker features, excluding the dropped input speaker feature, to the pre-enrolled enrolled speaker features.

13. The apparatus of claim 10 , wherein the processor is configured to assign a weight to input speaker features having discriminable speaker sections greater than or equal to a threshold value, and dynamically match the weight-assigned input speaker features to the pre-enrolled enrolled speaker features.

14. A speaker authentication method, comprising:

extracting input speaker features corresponding to speech frames;

determining discriminable speaker sections in each of the speech frames;

dynamically matching select input speaker features, of the extracted input speaker features, to pre-enrolled enrolled speaker features based on the discriminable speaker sections satisfying a criteria; and

authenticating a speaker based on the dynamically matched input speaker features,

wherein the dynamic matching comprises:

assigning a first weight to an input speaker feature corresponding to a pre-determined short pause among the input speaker features;

assigning a second weight to an input speaker feature corresponding to a speech among the input speaker features; and

dynamically matching each of the first weight-assigned input speaker feature and the second weight-assigned input speaker feature to the pre-enrolled enrolled speaker features.

15. The method of claim 14 , wherein the input speaker features correspond to phonemes and the discriminable speaker sections comprise of voiced sounds.

16. The method of claim 15 , wherein the criteria is satisfied when a discriminable speaker section of the discriminable speaker sections is greater than or equal to a threshold value.

17. The method of claim 15 , wherein the criteria is determined based on comparisons of relative weights applied to the discriminable speaker sections.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2019
From: KIM, KYUHONG; KIM, INSOO; LEE, DOHWAN; LEE, HANA
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 049835/0640 →
Priority Claims (1)
KR 10-2018-0100378 · Aug 27, 2018 · national
Continuity (1)
Related Publication 20200066280A1 · Feb 27, 2020