IP Library Granted Patent US 11,798,564
Granted Patent B2
US 11,798,564 · App. 17/621,766 · Granted Oct 24, 2023

Spoofing detection apparatus, spoofing detection method, and computer-readable storage medium

Inventors: Qiongqiong Wang (Tokyo, JP); Kong Aik Lee (Tokyo, JP); Takafumi Koshinaka (Tokyo, JP)
Assignee: NEC CORPORATION
G10L17/06G10L17/04G10L17/18G10L25/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,798,564
App. No.
17/621,766
Granted
Oct 24, 2023
Kind
B2
Abstract

A spoofing detection apparatus 100 includes a multi-channel spectrogram creation unit 10 and an evaluation unit 40 . The multi-channel spectrogram creation unit 10 extracts different type of spectrograms from speech data and integrates the different type of spectrograms to create a multi-channel spectrogram. The evaluation unit 40 evaluates the created multi-channel spectrogram by applying the created multi-channel spectrogram to a classifier constructed using labeled multi-channel spectrograms as training data and classifies it to either genuine or spoof.

Claims (44)

1. A spoofing detection apparatus comprising:

one or more processors; and

a memory storing instructions executable by the one or more processors to:

extract different types of spectrograms, including FFT spectrograms and CQT spectrograms, from speech data, and integrate the different types of spectrograms to create a multi-channel 3D spectrogram by fusing different types of spectrograms into the created multi-channel 3D spectrogram; and

evaluate the created multi-channel 3D spectrogram by applying the created multi-channel 3D spectrogram to a classifier constructed using labeled multi-channel spectrograms as training data and classify the created multi-channel 3D spectrogram as either genuine or spoof, wherein

the CQT spectrograms have additional zero elements placed therein, and the FFT spectrograms are zero-padded, so as to have a dimension in frequency equal to a same designated number that is equal to the dimension in frequency of either the CQT spectrograms as extracted or the FFT spectrograms as extracted.

2. The spoofing detection apparatus according to claim 1 , wherein

the created multi-channel 3D spectrogram and a label corresponding to the speech data are used as the training data to construct the classifier.

3. The spoofing detection apparatus according to claim 1 ,

wherein the different type of spectrograms are integrated by stacking.

4. The spoofing detection apparatus according to claim 1 ,

wherein the different type of spectrograms are integrated by concatenation.

5. The spoofing detection apparatus according to claim 1 ,

wherein the different types of spectrograms are resampled into a same size before the multi-channel 3D spectrogram is created.

6. The spoofing detection apparatus according to claim 1 ,

wherein the different types of spectrograms are zero-padded into a same size before the multi-channel 3D spectrogram is created.

7. A spoofing detection method comprising:

extracting, by a processor, different types of spectrograms, including FFT spectrograms and CQT spectrograms, from speech data, and integrating the different types of spectrograms to create a multi-channel 3D spectrogram by fusing different types of spectrograms into the created multi-channel 3D spectrogram; and

evaluating, by the processor, the created multi-channel 3D spectrogram by applying the created multi-channel 3D spectrogram to a classifier constructed using labeled multi-channel spectrograms as training data and classifying the created multi-channel 3D spectrogram as either genuine or spoof, wherein

the CQT spectrograms have additional zero elements placed therein, and the FFT spectrograms are zero-padded, so as to have a dimension in frequency equal to a same designated number that is equal to the dimension in frequency of either the CQT spectrograms as extracted or the FFT spectrograms as extracted.

8. A non-transitory computer-readable storage medium storing a program that includes commands for causing a computer to execute:

extracting different types of spectrograms, including FFT spectrograms and CQT spectrograms, from speech data, and integrating the different types of spectrograms to create a multi-channel 3D spectrogram by fusing different types of spectrograms into the created multi-channel 3D spectrogram; and

evaluating the created multi-channel 3D spectrogram by applying the created multi-channel 3D spectrogram to a classifier constructed using labeled multi-channel spectrograms as training data and classifying the created multi-channel 3D spectrogram as either genuine or spoof, wherein

the CQT spectrograms have additional zero elements placed therein, and the FFT spectrograms are zero-padded, so as to have a dimension in frequency equal to a same designated number that is equal to the dimension in frequency of either the CQT spectrograms as extracted or the FFT spectrograms as extracted.

9. The spoofing detection method according to claim 7 , wherein

the created multi-channel 3D spectrogram and a label corresponding to the speech data are used as the training data to construct the classifier.

10. The spoofing detection method according to claim 7 ,

wherein the different type of spectrograms are integrated by stacking.

11. The spoofing detection method according to claim 7 ,

wherein the different type of spectrograms are integrated by concatenation.

12. The spoofing detection method according to claim 7 ,

wherein the different types of spectrograms are resampled into a same size before the multi-channel 3D spectrogram is created.

13. The spoofing detection method according to claim 7 ,

wherein the different types of spectrograms are zero-padded into a same size before the multi-channel 3D spectrogram is created.

14. The non-transitory computer-readable storage medium according to claim 8 ,

wherein the created multi-channel 3D spectrogram and a label corresponding to the speech data are used as the training data to construct the classifier.

15. The non-transitory computer-readable storage medium according to claim 8 ,

wherein, the different type of spectrograms are integrated by stacking-.

16. The non-transitory computer-readable storage medium according to claim 8 ,

wherein, the different type of spectrograms are integrated by concatenation.

17. The non-transitory computer-readable storage medium according to claim 8 ,

wherein, the different types of spectrograms are resampled into a same size before the multi-channel 3D spectrogram is created.

18. The non-transitory computer-readable storage medium according to claim 8 ,

wherein the different types of spectrograms are zero-padded into a same size before creating the multi-channel 3D spectrogram is created.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2021
From: WANG, QIONGQIONG; LEE, KONG AIK; KOSHINAKA, TAKAFUMI
To: NEC CORPORATION
Reel/Frame 058456/0837 →
Continuity (1)
Related Publication 20220358934A1 · Nov 10, 2022
Cited By (2)
US 12,482,472 US 12,556,404