IP Library › Granted Patent US 12,725,610
Granted Patent B2
US 12,725,610 · App. 17/956,255 · Granted Sep 1, 2026

Voice recognition system, server, display apparatus and control methods thereof

Inventor: Ji-eun Chae (Seongnam-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G06F3/167G06F9/453G10L15/00G10L2015/223G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,725,610
App. No.
17/956,255
Granted
Sep 1, 2026
Kind
B2
Abstract

A voice recognition system includes a server storing a plurality of manuals and a display apparatus transmitting, when a spoken voice of a user is recognized, characteristic information and a spoken voice signal corresponding to the spoken voice to the server, the characteristic information is characteristic information of the display apparatus, the server transmits a response signal to the spoken voice signal to the display apparatus based on a manual corresponding to the characteristic information among the plurality of manuals, and the display apparatus processes an operation corresponding to the received response signal; as a result, user convenience increases.

Claims (41)

1 . A display apparatus comprising:

a display;

a voice input receiver; and

a processor configured to:

receive a user voice input through the voice input receiver,

based on the user voice input being a voice input corresponding to a function control of the display apparatus, perform a function of the display apparatus based on the user voice input,

based on the user voice input being a voice input corresponding to a function inquiry rather than the function control, control the display to output a user interface (UI) according to the function inquiry based on a manual of the display apparatus and the user voice input, and

based on the user voice input being a voice input corresponding to a state of the display apparatus rather than the function control, control the display to output a UI corresponding to confirmation of a state of the display apparatus based on state information of the display apparatus and the user voice input,

wherein, based on the state of the display apparatus being operational to perform a function related to the user voice input without a problem, control the display to output the UI, which is generated based on the state information of the display apparatus, corresponding to a result of a diagnosis that there is no problem in the function related to the user voice input, and

wherein the processor is configured to control the display to output the UI, which is generated based on the state information of the display apparatus, including information corresponding to the result of the diagnosis performed on the display apparatus that varies according to the state information of the display apparatus being operational to perform the function related to the user voice input.

2 . The display apparatus as claimed in claim 1 , wherein the processor is configured to, based on the user voice input corresponding to the function control and corresponding to an external device connectable to the display apparatus through a communicator of the display apparatus, control the display to output a UI based on a connection state of the external device and the user voice input.

3 . The display apparatus as claimed in claim 2 , wherein the Ul based on the connection state of the external device and the user voice input includes information guiding a connection corresponding to a disconnection of the external device.

4 . The display apparatus as claimed in claim 1 , wherein the processor is configured to, based on the user voice input corresponding to the function inquiry, control the display to output information corresponding to the function inquiry according to the user voice input, obtained from a manual stored in at least one of the display apparatus or a server.

5 . The display apparatus as claimed in claim 4 , wherein the Ul according to the function inquiry includes information related to resolution of the function inquiry.

6 . The display apparatus as claimed in claim 1 , wherein the state information of the display apparatus includes at least one of volume information or channel information.

7 . The display apparatus as claimed in claim 6 , wherein the processor is configured to receive, from a server, response information based on state information of the display apparatus, transmitted to a server through a communicator of the display apparatus, and the user voice input, and control the display to output a UI corresponding to the received response information.

8 . The display apparatus as claimed in claim 1 , wherein the user voice input corresponding to the state of the display apparatus is a voice input corresponding to a malfunction of a function performed in the display apparatus.

9 . The display apparatus as claimed in claim 1 , wherein the processor is configured to, based on the user voice input corresponding to the state of the display apparatus, control the display to output different UIs according to state information of the display apparatus at a time when the user voice input is received.

10 . The display apparatus as claimed in claim 1 , wherein the processor is configured to, based on a user voice input being received from an external device wirelessly connected to the display apparatus, perform the same function as a function corresponding to the user voice input received through the voice input receiver.

11 . A controlling method of a display apparatus comprising:

receiving a user voice input;

based on the user voice input being a voice input corresponding to a function control of the display apparatus, performing a function of the display apparatus based on the user voice input;

based on the user voice input being a voice input corresponding to a function inquiry rather than the function control, outputting a user interface (UI) according to the function inquiry based on a manual of the display apparatus and the user voice input; and

based on the user voice input being a voice input corresponding to a state of the display apparatus rather than the function control, outputting a UI corresponding to confirmation of a state of the display apparatus based on state information of the display apparatus and the user voice input,

wherein, based on the state of the display apparatus being operational to perform a function related to the user voice input without a problem, control the display to output the UI, which is generated based on the state information of the display apparatus, corresponding to a result of a diagnosis that there is no problem in the function related to the user voice input the state of the display apparatus is generated based on the state information of the display apparatus, and

wherein the processor is configured to control the display to output the Ul, which is generated based on the state information of the display apparatus, including information corresponding to the result of the diagnosis performed on the display apparatus that varies according to the state information of the display apparatus being operational to perform the function related to the user voice input.

12 . The controlling method as claimed in claim 11 , further comprising:

based on the user voice input corresponding to the function control and corresponding to an external device connectable to the display apparatus, outputting a Ul based on a connection state of the external device and the user voice input.

13 . The controlling method as claimed in claim 12 , wherein the Ul based on the connection state of the external device and the user voice input includes information guiding a connection corresponding to a disconnection of the external device.

14 . The controlling method as claimed in claim 11 , further comprising:

based on the user voice input corresponding to the function inquiry, outputting information corresponding to the function inquiry according to the user voice input, obtained from a manual stored in at least one of the display apparatus or a server.

15 . The controlling method as claimed in claim 14 , wherein the UI according to the function inquiry includes information related to resolution of the function inquiry.

16 . The controlling method as claimed in claim 11 , wherein the state information of the display apparatus includes at least one of volume information or channel information.

17 . The controlling method as claimed in claim 16 , wherein the outputting a UI corresponding to confirmation of the state of the display apparatus comprises:

receiving, from a server, response information based on state information of the display apparatus, transmitted to the server, and the user voice input; and outputting a UI corresponding to the received response information.

18 . The controlling method as claimed in claim 11 , wherein the user voice input corresponding to the state of the display apparatus corresponding to a malfunction of a function performed in the display apparatus.

19 . The controlling method as claimed in claim 11 , wherein the outputting a UI corresponding to confirmation of the state of the display apparatus comprises outputting different Uls according to state information of the display apparatus at a time when the user voice input is received.

20 . The controlling method as claimed in claim 11 ,

wherein the user voice input is received through a voice input receiver of the display apparatus, and

wherein the controlling method further comprising:

based on a user voice input being received from an external device wirelessly connected to the display apparatus, performing the same function as a function corresponding to the user voice input received through the voice input receiver.

Priority Claims (1)
KR 10-2014-0160130 · Nov 17, 2014 · national
Continuity (3)
Continuation 16742350 · Jan 14, 2020
Continuation 14931153 · Nov 3, 2015
Related Publication 20230028729A1 · Jan 26, 2023
References Cited (98)
US 6678591B2 · Ohmura et al. · 2004 [cited by applicant]
US 6850252B1 · Hoffberg · 2005 [cited by examiner]
US 7496500B2 · Reed et al. · 2009 [cited by applicant]
US 7941492B2 · Pearson et al. · 2011 [cited by applicant]
US 8161125B2 · Pearson et al. · 2012 [cited by applicant]
US 8230032B2 · Pearson et al. · 2012 [cited by applicant]
US 10250935B2 · Park et al. · 2019 [cited by applicant]
US 20020052737A1 · Kim · 2002 [cited by examiner]
US 20020103582A1 · Ohmura · 2002 [cited by examiner]
US 20020166084A1 · Raynham · 2002 [cited by examiner]
US 20030165218A1 · Kadota · 2003 [cited by examiner]
US 20040015346A1 · Yasunaga · 2004 [cited by examiner]
US 20040042622A1 · Saito · 2004 [cited by examiner]
US 20040092846A1 · Watrous · 2004 [cited by applicant]
US 20040111257A1 · Sung · 2004 [cited by examiner]
US 20050192992A1 · Reed et al. · 2005 [cited by applicant]
US 20060212286A1 · Pearson et al. · 2006 [cited by applicant]
US 20070061135A1 · Chu · 2007 [cited by examiner]
US 20070093947A1 · Gould · 2007 [cited by examiner]
US 20080059166A1 · Ehara · 2008 [cited by examiner]
US 20080126084A1 · Lee · 2008 [cited by examiner]
US 20080176555A1 · Okuyama · 2008 [cited by examiner]
US 20080195381A1 · Soong · 2008 [cited by examiner]
US 20080300055A1 · Lutnick · 2008 [cited by examiner]
US 20090012780A1 · Murashima · 2009 [cited by examiner]
US 20090141790A1 · Kawashima · 2009 [cited by examiner]
US 20090204730A1 · Mochizuki · 2009 [cited by examiner]
US 20090299738A1 · Sato · 2009 [cited by examiner]
US 20100185788A1 · Kim · 2010 [cited by examiner]
US 20100223372A1 · Nichols · 2010 [cited by examiner]
US 20100299696A1 · Konishi · 2010 [cited by examiner]
US 20110054845A1 · Han · 2011 [cited by examiner]
US 20110107137A1 · Lam · 2011 [cited by examiner]
US 20110185027A1 · Pearson et al. · 2011 [cited by applicant]
US 20110185281A1 · Pearson et al. · 2011 [cited by applicant]
US 20120095756A1 · Sung · 2012 [cited by examiner]
US 20130041665A1 · Jang · 2013 [cited by examiner]
US 20130185072A1 · Huang · 2013 [cited by examiner]
US 20130339020A1 · Heo · 2013 [cited by examiner]
US 20140006022A1 · Yoon et al. · 2014 [cited by applicant]
US 20140188486A1 · You et al. · 2014 [cited by applicant]
US 20140191949A1 · Park et al. · 2014 [cited by applicant]
US 20140196087A1 · Park et al. · 2014 [cited by applicant]
US 20140200896A1 · Lee et al. · 2014 [cited by applicant]
US 20140282007A1 · Fleizach · 2014 [cited by examiner]
US 20150019227A1 · Anandarajah · 2015 [cited by examiner]
US 20150309859A1 · Elzein · 2015 [cited by examiner]
US 20150382047A1 · Van Os · 2015 [cited by examiner]
US 20160359325A1 · Kawata · 2016 [cited by examiner]
US 20180061403A1 · Devaraj · 2018 [cited by examiner]
US 20220057519A1 · Goldstein · 2022 [cited by examiner]
CN 103325020 · 2013 [cited by applicant]
EP 2750027A2 · 2014 [cited by applicant]
EP 2945157A2 · 2015 [cited by applicant]
KR 20020064175 · 2002 [cited by applicant]
KR 1020050111633A · 2005 [cited by applicant]
KR 102006004333 · 2006 [cited by applicant]
KR 1020110013582 · 2011 [cited by applicant]
KR 10201300709471020140111 · 2013 [cited by applicant]
KR 1020130140423 · 2013 [cited by applicant]
KR 1020140001105A · 2014 [cited by applicant]
KR 1020140087717A · 2014 [cited by applicant]
KR 1020140089836 · 2014 [cited by applicant]
KR 1020140089847 · 2014 [cited by applicant]
KR 102014011538 · 2014 [cited by applicant]
Notice of Allowance dated Nov. 17, 2022 for U.S. Appl. No. 16/742,350. [cited by applicant]
Korean Office Action dated May 24, 2023 for Korean Application No. 10-2023-0034389. [cited by applicant]
European Office Action dated Apr. 3, 2023 for European Application No. 20197252.8 [cited by applicant]
First Office Action dated Mar. 22, 2024 for corresponding Chinese application No. 202110369901.8 [cited by applicant]
Korean Notice of Allowance dated Jun. 18, 2024 for Korean Application No. 10-2023-0111925. [cited by applicant]
Chinese Office Action dated Oct. 8, 2019 in corresponding Chinese Patent Application No. 201510790693.3. [cited by applicant]
Extended European Search Report dated Oct. 11, 2018 from European Patent Application No. 18180231.5, 7 pages. [cited by applicant]
European Office Action dated Nov. 29, 2016 in European Patent Application No. 15194791.8. [cited by applicant]
Extended European Search Report dated Mar. 24, 2016 in corresponding European Patent Application No. 15194791.8. [cited by applicant]
U.S. Office Action dated Sep. 12, 2016 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Feb. 17, 2017 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Advisory Action dated May 9, 2017 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Jun. 21, 2017 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Dec. 12, 2017 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Mar. 29, 2018 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Nov. 19, 2018 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Advisory Action dated Feb. 1, 2019 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Mar. 19, 2019 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Office Action dated Jul. 22, 2019 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
U.S. Notice of Allowance dated Oct. 1, 2019 from corresponding U.S. Appl. No. 14/931,153. [cited by applicant]
Chinese Office Action dated Jul. 9, 2020 from Chinese Application No. 201510790693.3, 26 pages. [cited by applicant]
Korean Office Action dated Dec. 23, 2020 from Korean Application No. 10-2014-0160130, 9 pages. [cited by applicant]
Extended European Search Report dated Jul. 16, 2021 from European Application No. 201972528, 14 pages. [cited by applicant]
Korean Office Action mailed Oct. 8, 2021 in Korean Patent Application No. 10-2021-0115950. [cited by applicant]
U.S. Office Action dated Mar. 16, 2022 for U.S. Appl. No. 16/742,350. [cited by applicant]
U.S. Office Action dated Aug. 2, 2022 for U.S. Appl. No. 16/742,350. [cited by applicant]
U.S. Appl. No. 16/742,350, filed Jan. 14, 2020, Ji-eun Chae, Samsung Electronics Co., Ltd. [cited by applicant]
Notice of Allowance dated Dec. 15, 2022 for Korean Patent Application No. 10-2022-0094268. [cited by applicant]
Examination Report issued on Nov. 4, 2024 for European Patent Application No. 20 197 252.8. [cited by applicant]
Office Action issued on Sep. 14, 2024 for the Chinese Patent Application No. 202110369901.8. [cited by applicant]
Chinese Office Action issued Feb. 8, 2025 for Chinese Application No. 202110369901.8. [cited by applicant]
Notice of Allowance issued Jun. 25, 2025 for Application No. 10-2024-0126133. [cited by applicant]
European Office Action issued Dec. 18, 2025 for Application No. 20 197 252.8. [cited by applicant]