IP Library › Granted Patent US 12,205,599
Granted Patent B2
US 12,205,599 · App. 18/212,364 · Granted Jan 21, 2025

Apparatus for encoding and decoding of integrated speech and audio

Inventors: Tae Jin Lee (Daejeon, KR); Seung-Kwon Baek (Chungcheongbuk-do, KR); Min Je Kim (Daejeon, KR); Dae Young Jang (Daejeon, KR); Jeongil Seo (Daejeon, KR); Kyeongok Kang (Daejeon, KR); Jin-Woo Hong (Daejeon, KR); Hochong Park (Seoul, KR); Young-Cheol Park (Seoul, KR)
Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
G10L19/008G10L19/02G10L19/04G10L19/12G10L19/20G10L19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,599
App. No.
18/212,364
Granted
Jan 21, 2025
Kind
B2
Abstract

Provided is an encoding apparatus for integrally encoding and decoding a speech signal and a audio signal, and may include: an input signal analyzer to analyze a characteristic of an input signal; a stereo encoder to down mix the input signal to a mono signal when the input signal is a stereo signal, and to extract stereo sound image information; a frequency band expander to expand a frequency band of the input signal; a sampling rate converter to convert a sampling rate; a speech signal encoder to encode the input signal using a speech encoding module when the input signal is a speech characteristics signal; a audio signal encoder to encode the input signal using a audio encoding module when the input signal is a audio characteristic signal; and a bitstream generator to generate a bitstream.

Claims (47)

1. An encoding method of an input signal performed by at least one processor, the encoding method comprising:

determining a frame of the input signal whether the frame is a speech frame or an audio frame;

encoding the input signal in a speech encoder based a first coding scheme when the frame is the speech frame,

encoding the input signal in an audio encoder based a second coding scheme when the frame is the audio frame; and

generating a bitstream including based on a encoded input signal, and

wherein the input signal is processed by using information for compensating a change of a frame unit between the speech frame and the audio frame, and

wherein the information is included the bitstream, and

wherein the input signal is encoded with respect to a core band,

wherein the core band is a low frequency band which is not expanded in a frequency band of the input signal.

2. The encoding method of claim 1 ,

wherein the first coding scheme is a CELP coding scheme and the second coding scheme is a MDCT coding scheme.

3. The encoding method of claim 1 ,

wherein a high frequency band is generated from the core band based on a frequency band expander in a decoding process.

4. The encoding method of claim 1 , further comprising:

generating information for generating a high frequency band;

wherein the bitstream includes the generated information.

5. The encoding method of claim 4 , further comprising:

converting a sampling rate of the input signal to a sampling rate with respect to a core band of the input signal.

6. The encoding method of claim 4 , further comprising:

down-sampling a sampling rate of the input signal by one half (½).

7. The encoding method of claim 4 , further comprising:

down-sampling a sampling rate of the input signal by one quarter (¼).

8. The encoding method of claim 1 , further comprising:

converting a sampling rate of the input signal to a sampling rate for encoding a core band of the input signal.

9. The encoding method of claim 1 , wherein the information for compensating at least one change between the speech frame and the audio frame includes an encoded portion of the speech frame of the input signal for decoding the audio frame of the input signal.

10. A decoding method for an encoded input signal performed by at least one processor, the decoding method comprising:

receiving a bitstream included the input signal;

determining whether a frame of the input signal is a speech frame or an audio frame;

decoding a core band of the input signal by:

decoding the core band of the input signal in a speech decoder based on a first coding scheme when the frame is the speech frame,

decoding the core band of the input signal in an audio decoder based on a second coding scheme when the frame is the audio frame, and

processing the input signal using information for compensating a change of a frame unit between the speech frame and the audio frame, and

wherein the information is included the bitstream, and

wherein the input signal is decoded with respect to a core band,

wherein the core band is a low frequency band which is not expanded in a frequency band of the input signal.

11. The decoding method of claim 10 ,

wherein the first coding scheme is a CELP coding scheme and the second coding scheme is a MDCT coding scheme.

12. The decoding method of claim 11 , further comprising:

expanding a frequency band of the input signal by generating a high frequency band from the core band of the input signal.

13. The decoding method of claim 11 , wherein the input signal is compensated using information for compensating at least one change between the speech frame and the audio frame.

14. The decoding method of claim 13 , wherein the information includes an encoded portion of the speech frame of the input signal for decoding the audio frame of the input signal.

15. The decoding method of claim 10 , further comprising:

generating a stereo signal from the input signal having an expanded frequency band.

16. The decoding method of claim 15 , wherein a sampling rate for a SBR is twice the sampling rate for the decoding a core band of the input signal.

17. The decoding method of claim 15 , wherein a sampling rate for a SBR is fourfold the sampling rate for the decoding a core band of the input signal.

18. The decoding method of claim 10 , further comprising:

converting a sampling rate of the decoded input signal based on a sampling rate for the decoding the core band.

Priority Claims (3)
KR 10-2008-0068369 · Jul 14, 2008 · national
KR 10-2008-0134297 · Dec 26, 2008 · national
KR 10-2009-0061608 · Jul 7, 2009 · national
Continuity (6)
Continuation 16925946 · Jul 10, 2020
Continuation 16557238 · Aug 30, 2019
Continuation 15810732 · Nov 13, 2017
Continuation 14534781 · Nov 6, 2014
Continuation 13003979
Related Publication 20240119948A1 · Apr 11, 2024
References Cited (83)
US 5649055A · Gupta · 1997 [cited by applicant]
US 6134518A · Cohen et al. · 2000 [cited by applicant]
US 6484137B1 · Taniguchi et al. · 2002 [cited by applicant]
US 7222070B1 · Stachurski et al. · 2007 [cited by applicant]
US 7392176B2 · Nishio et al. · 2008 [cited by applicant]
US 8108220B2 · Saunders et al. · 2012 [cited by applicant]
US 8781843B2 · Oh · 2014 [cited by examiner]
US 20020040295A1 · Saunders et al. · 2002 [cited by applicant]
US 20030101050A1 · Khalil · 2003 [cited by examiner]
US 20030125933A1 · Saunders et al. · 2003 [cited by applicant]
US 20050055204A1 · Florencio et al. · 2005 [cited by applicant]
US 20070106502A1 · Kim et al. · 2007 [cited by applicant]
US 20070174063A1 · Mehrotra et al. · 2007 [cited by applicant]
US 20070208565A1 · Lakaniemi et al. · 2007 [cited by applicant]
US 20070238415A1 · Sinha et al. · 2007 [cited by applicant]
US 20080004883A1 · Vilermo et al. · 2008 [cited by applicant]
US 20080010062A1 · Son et al. · 2008 [cited by applicant]
US 20080031463A1 · Davis · 2008 [cited by applicant]
US 20080059160A1 · Saunders et al. · 2008 [cited by applicant]
US 20080077412A1 · Oh et al. · 2008 [cited by applicant]
US 20080114605A1 · Wu et al. · 2008 [cited by applicant]
US 20080114608A1 · Bastien · 2008 [cited by applicant]
US 20080147414A1 · Son · 2008 [cited by applicant]
US 20080162121A1 · Son · 2008 [cited by applicant]
US 20080312914A1 · Rajendran · 2008 [cited by examiner]
US 20080319739A1 · Mehrotra et al. · 2008 [cited by applicant]
US 20090164223A1 · Fejzo · 2009 [cited by applicant]
US 20100114565A1 · Kinns · 2010 [cited by examiner]
EP 0932141A2 · 1999 [cited by applicant]
JP 738437 · 1995 [cited by applicant]
JP 897726 · 1996 [cited by applicant]
JP 11175098 · 1999 [cited by applicant]
JP 2000232368 · 2000 [cited by applicant]
JP 200599243 · 2005 [cited by applicant]
JP 2005107255 · 2005 [cited by applicant]
JP 2006325162 · 2006 [cited by applicant]
JP 2007525707 · 2007 [cited by applicant]
JP 2007531027 · 2007 [cited by applicant]
JP 2009524846 · 2009 [cited by applicant]
JP 2013232007 · 2013 [cited by applicant]
JP 2014139674 · 2014 [cited by applicant]
KR 100614496 · 2006 [cited by applicant]
WO 2005099243A1 · 2005 [cited by applicant]
WO 2007083934 · 2007 [cited by applicant]
WO 2007086646 · 2007 [cited by applicant]
WO 2008060114A1 · 2008 [cited by applicant]
WO 2008072913A1 · 2008 [cited by applicant]
Schuijers et al., “Low complexity parametric stereo coding”, Audio Engineering Society, Convention Paper 6073, Berlin, Germany, May 2004, pp. 1-11. [cited by applicant]
Kim et al., “Improved Frame Mode Selection for AMR-WB+ Based on Decision Tree”, IEICE Transactions on Information and Systems, vol. E91-D, No. 6, Jun. 2008, pp. 1830-1833. [cited by applicant]
Sang-Wook Shin et al., “Designing a Unified Speech/Audio Codec by Adopting a Single Channel Harmonic Source Separating Module”, School of Electrical and Electronic Engineering, Yonsei University, Korea, 2008, pp. 185-18… [cited by applicant]
Jonas Engdegård et al., “Audio Engineering Society Convention Paper: Synthetic Ambience in Parametric Stereo Coding”, May 8-11, 2004, Berlin, Germany, pp. 1-12. [cited by applicant]
Redwan Salami et al., “Extended AMR-WB for High-Quality Audio on Mobile Devices”, pp. 90-97. [cited by applicant]
International Search Report for PCT/KR2009/003855 mailed on Oct. 30, 2009. [cited by applicant]
USPTO Office Communication issued Sep. 9, 2014 in U.S. Appl. No. 13/003,979 acknowledging the IDS filed Aug. 6, 2014. [cited by applicant]
Notice of Allowance and Fee(s) mailed Jul. 31, 2014 in U.S. Appl. No. 13/003,979. [cited by applicant]
Office Action issued Mar. 21, 2014 in U.S. Appl. No. 13/003,979. [cited by applicant]
Office Action issued Dec. 11, 2013 in U.S. Appl. No. 13/003,979. [cited by applicant]
Office Action issued Jul. 15, 2013 in U.S. Appl. No. 13/003,979. [cited by applicant]
“ [cited by applicant]
Extended European Search Report dated Apr. 2, 2019 in related European Patent Application No. 18215268.6 (8 pages). [cited by applicant]
Dietz et al: “ [cited by applicant]
Non-Final Office Action dated Feb. 18, 2015 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Final Office Action dated Jul. 21, 2015 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Non-Final Office Action dated Dec. 16, 2015 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Advisory Action dated Sep. 29, 2015 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Final Office Action dated Jun. 2, 2016 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Non-Final Office Action dated Sep. 29, 2016 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Advisory Action dated Aug. 15, 2016 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Final Office Action dated Apr. 24, 2017 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
Notice of Allowance mailed Jul. 14, 2017 in parent U.S. Appl. No. 14/534,781. [cited by applicant]
US Office Action dated Jun. 15, 2018 in U.S. Appl. No. 15/810,732. [cited by applicant]
US Office Action dated Dec. 28, 2018 in U.S. Appl. No. 15/810,732. [cited by applicant]
US Advisory Action dated Mar. 15, 2019 in U.S. Appl. No. 15/810,732. [cited by applicant]
US Notice of Allowance dated Apr. 25, 2019 in U.S. Appl. No. 15/810,732. [cited by applicant]
US Notice of Allowance dated Mar. 17, 2020 in U.S. Appl. No. 16/557,238. [cited by applicant]
European Communication dated Apr. 20, 2021 in European Patent Application No. 18215268.6. [cited by applicant]
Office Action dated Sep. 12, 2022 in parent U.S. Appl. No. 16/925,946. [cited by applicant]
Notice of Allowance dated Mar. 2, 2023 in parent U.S. Appl. No. 16/925,946. [cited by applicant]
U.S. Appl. No. 16/925,946, filed Jul. 10, 2020, Tae Jin Lee, et al., Electronics and Telecommunications Research Institute and Kwangwoon University Industry-Academic Collaboration Foundation. [cited by applicant]
U.S. Appl. No. 16/557,238 (now U.S. Pat. No. 10,714,103) , filed Aug. 30, 2019, Tae Jin Lee, et al., Electronics and Telecommunications Research Institute and Kwangwoon University Industry-Academic Collaboration Foundat… [cited by applicant]
U.S. Appl. No. 15/810,732 (now U.S. Pat. No. 10,403,293), filed Nov. 13, 2017, Tae Jin Lee, et al., Electronics and Telecommunications Research Institute and Kwangwoon University Industry-Academic Collaboration Foundati… [cited by applicant]
U.S. Appl. No. 14/534,781 (now U.S. Pat. No. 9,818,411), filed Nov. 6, 2014, Tae Jin Lee, et al., Electronics and Telecommunications Research Institute and Kwangwoon University Industry-Academic Collaboration Foundation. [cited by applicant]
U.S. Appl. No. 13/003,979 (now U.S. Pat. No. 8,903,720), filed Jan. 13, 2011, Tae Jin Lee, et al., Electronics and Telecommunications Research Institute and Kwangwoon University Industry-Academic Collaboration Foundatio… [cited by applicant]