IP Library › Granted Patent US 12,738,276
Granted Patent B2
US 12,738,276 · App. 18/491,491 · Granted Sep 15, 2026

Display apparatus capable of releasing a voice input mode by sensing a speech finish and voice control method thereof

Inventors: Sung-wook Choi (Seoul, KR); Hee-seob Ryu (Hwaseong-si, KR); Hee-ran Lee (Suwon-si, KR); Sung-pil Hwang (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/28G10L15/22G10L25/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,738,276
App. No.
18/491,491
Granted
Sep 15, 2026
Kind
B2
Abstract

A voice control method and display apparatus are provided. The voice control method includes converting a voice of a user into text in response to the voice being input during a voice input mode; performing a control operation corresponding to the text; determining whether speech of the user has finished based on a result of the performing the control operation; awaiting input of a subsequent voice of the user during a predetermined standby time in response to determining that the speech of the user has not finished; and releasing the voice input mode in response to determining that the speech of the user has finished.

Claims (52)

1 . A display apparatus comprising:

a voice receiver;

a communicator configured to communicate with a server;

a display; and

a processor configured to:

receive a first voice input through the voice receiver,

based on a predetermined trigger speech being included in the first voice input, control the display apparatus to enter a voice input mode,

based on a predetermined command related to the display apparatus being included in a second voice input received through the voice receiver while the display apparatus is in the voice input mode, perform an operation corresponding to the predetermined command and release the voice input mode after performing the operation without receiving a user input, and

based on the predetermined command not being included in the second voice input and a text being included in the second voice input, receive a search result corresponding to the text included in the second voice input from the server and control the display to display a screen corresponding to the search result,

wherein the processor is further configured to:

based on the search result including a plurality of search results, control the display to display the plurality of search results and maintain the voice input mode for receiving a subsequent user input while the plurality of search results are displayed on the display, and

based on a search result from among the plurality of search results being selected by the subsequent user input, control the display to display information corresponding to the selected search result and automatically release the voice input mode without receiving the user input after displaying the information corresponding to the selected search result on the display,

wherein the processor is further configured to:

based on receiving a voice input including an index among a plurality of indexes corresponding to the plurality of search results, control the display to display a screen corresponding to a content related to the index and automatically release the voice input mode without receiving the user input, and

wherein the plurality of indexes is related to a display order of the plurality of search results displayed on the display.

2 . The display apparatus of claim 1 , wherein the predetermined command comprises at least one of turn on, turn off, turn up a volume, turn down the volume, turn up a channel, or turn down the channel.

3 . The display apparatus of claim 1 , wherein the processor is further configured to, based on an execution screen of at least one of an application or multimedia contents being displayed through the display, release the voice input mode.

4 . The display apparatus of claim 3 , wherein the processor is further configured to:

based on a keyword and a command being included in the second voice input, execute the application corresponding to the command, and

play back contents corresponding to the keyword in the application, and release the voice input mode.

5 . The display apparatus of claim 1 , wherein the processor is further configured to control the display to display the plurality of search results in a form of a list.

6 . The display apparatus of claim 5 , wherein the processor is further configured to control the display to display the plurality of search results in a form, horizontally arranged or vertically arranged, and each of the plurality of search results includes a thumbnail image.

7 . The display apparatus of claim 5 , wherein the processor is further configured to, based on the search result including the plurality of search results, maintain the voice input mode during a predetermined period of time, the predetermined period of time being a predetermined standby time for a subsequent voice input.

8 . The display apparatus of claim 7 , wherein the processor is further configured to, based on receiving a third voice input during the predetermined standby time, control the display to display information corresponding to a search result selected by the third voice input and release the voice input mode.

9 . The display apparatus of claim 8 , wherein the processor is further configured to, based on a plurality of search results corresponding to the third voice input being displayed in a form of a list, maintain the voice input mode during the predetermined standby time for the subsequent voice input.

10 . The display apparatus of claim 1 , wherein the processor is further configured to, based on the display apparatus entering the voice input mode, control the display to display a graphic object corresponding to the voice input mode, and

based on the voice input mode being released, delete the graphic object.

11 . The display apparatus of claim 1 , wherein the index includes an ordinary number.

12 . A control method of a display apparatus communicating with a server, the control method comprising:

receiving a first voice input through a voice receiver of the display apparatus;

based on a predetermined trigger speech being included in the first voice input, controlling the display apparatus to enter a voice input mode;

based on a predetermined command related to the display apparatus being included in a second voice input received through the voice receiver while the display apparatus is in the voice input mode, performing an operation corresponding to the predetermined command and releasing the voice input mode after performing the operation without receiving a user input; and

based on the predetermined command not being included in the second voice input and a text being included in the second voice input, receiving a search result corresponding to the text included in the second voice input from the server and displaying a screen corresponding to the search result,

wherein the displaying the screen comprises:

based on the search result including a plurality of search results, displaying the plurality of search results and maintaining the voice input mode for receiving a subsequent user input while the plurality of search results are displayed on a display, and

based on a search result from among the plurality of search results being selected by the subsequent user input, displaying information corresponding to the selected search result and automatically releasing the voice input mode without receiving the user input after displaying the information corresponding to the selected search result on the display,

wherein the displaying of the information corresponding to the selected search result and the automatically releasing of the voice input mode comprise, based on receiving a voice input including an index among a plurality of indexes corresponding to the plurality of search results, displaying a screen corresponding to a content related to the index and automatically release the voice input mode without receiving the user input, and

wherein the plurality of indexes is related to a display order of the plurality of search results displayed on the display.

13 . The control method of claim 12 , wherein the predetermined command comprises at least one of turn on, turn off, turn up a volume, turn down the volume, turn up a channel, or turn down the channel.

14 . The control method of claim 12 , further comprising, based on an execution screen of at least one of an application or multimedia contents being displayed through a display, releasing the voice input mode.

15 . The control method of claim 14 , further comprising:

based on a keyword and a command being included in the second voice input, executing the application corresponding to the command; and

playing back contents corresponding to the keyword in the application, and releasing the voice input mode.

16 . The control method of claim 12 , wherein the displaying the plurality of search results comprises displaying the plurality of search results corresponding to the second voice input in a form of a list.

17 . The control method of claim 16 , wherein the displaying the plurality of search results comprises displaying the plurality of search results in a form, horizontally arranged or vertically arranged, and each of the plurality of search results includes a thumbnail image.

18 . The control method of claim 16 , wherein the maintaining the voice input mode comprises, based on the search result including the plurality of search results, maintaining the voice input mode during a predetermined period of time, the predetermined period of time being a predetermined standby time for a subsequent voice input.

19 . The control method of claim 18 , further comprising, based on receiving a third voice input during the predetermined standby time, displaying information corresponding to a search result selected by the third voice input and releasing the voice input mode.

20 . The control method of claim 19 , further comprising, based on a plurality of search results corresponding to the third voice input being displayed in a form of a list, maintaining the voice input mode during the predetermined standby time for the subsequent voice input.

21 . The control method of claim 12 , further comprising:

based on the display apparatus entering the voice input mode, displaying a graphic object corresponding to the voice input mode; and

based on the voice input mode being released, deleting the graphic object.

22 . The control method of claim 12 , wherein the index includes an ordinary number.

Priority Claims (1)
KR 10-2013-0122131 · Oct 14, 2013 · national
Continuity (5)
Continuation 16894271 · Jun 5, 2020
Continuation 16514028 · Jul 17, 2019
Continuation 16166898 · Oct 22, 2018
Continuation 14267510 · May 1, 2014
Related Publication 20240046934A1 · Feb 8, 2024
References Cited (56)
US 5878423A · Anderson · 1999 [cited by examiner]
US 6212408B1 · Son · 2001 [cited by examiner]
US 6397181B1 · Li · 2002 [cited by examiner]
US 6415258B1 · Reynar · 2002 [cited by examiner]
US 6456976B1 · Kuita · 2002 [cited by examiner]
US 6665640B1 · Bennett · 2003 [cited by examiner]
US 6947894B1 · Engstrom · 2005 [cited by examiner]
US 9123339B1 · Shaw · 2015 [cited by examiner]
US 9684697B1 · Panda · 2017 [cited by examiner]
US 10140990B2 · Choi · 2018 [cited by examiner]
US 10395657B2 · Choi · 2019 [cited by examiner]
US 10720162B2 · Choi · 2020 [cited by examiner]
US 20040143374A1 · Horst · 2004 [cited by examiner]
US 20070219805A1 · Nomura · 2007 [cited by examiner]
US 20080114603A1 · Desrochers · 2008 [cited by examiner]
US 20090112593A1 · Konig · 2009 [cited by examiner]
US 20100250243A1 · Schalk · 2010 [cited by applicant]
US 20100312547A1 · Van Os · 2010 [cited by examiner]
US 20110178804A1 · Inoue · 2011 [cited by examiner]
US 20110288868A1 · Lloyd · 2011 [cited by examiner]
US 20110295844A1 · Sun · 2011 [cited by examiner]
US 20120034904A1 · LeBeau · 2012 [cited by examiner]
US 20120064820A1 · Bemmel · 2012 [cited by examiner]
US 20120271636A1 · Fujisawa · 2012 [cited by examiner]
US 20130033422A1 · Choi et al. · 2013 [cited by applicant]
US 20130033428A1 · Choi et al. · 2013 [cited by applicant]
US 20130218573A1 · Cheng et al. · 2013 [cited by applicant]
US 20130219032A1 · Hsu · 2013 [cited by examiner]
US 20130219277A1 · Wang · 2013 [cited by examiner]
US 20130268956A1 · Recco · 2013 [cited by examiner]
US 20130346867A1 · Woods · 2013 [cited by examiner]
US 20140006022A1 · Yoon et al. · 2014 [cited by applicant]
US 20140136213A1 · Kim · 2014 [cited by examiner]
US 20140156256A1 · Kim · 2014 [cited by examiner]
US 20140181865A1 · Koganei · 2014 [cited by examiner]
US 20140183034A1 · Noh · 2014 [cited by examiner]
US 20140184514A1 · Rao · 2014 [cited by examiner]
US 20140267933A1 · Young · 2014 [cited by applicant]
US 20150199965A1 · Leak · 2015 [cited by examiner]
US 20200302935A1 · Choi · 2020 [cited by examiner]
US 20220189457A1 · Shen · 2022 [cited by examiner]
US 20240046934A1 · Choi · 2024 [cited by examiner]
US 20240314393A1 · Staubach · 2024 [cited by examiner]
US 20250378652A1 · Kaifosh · 2025 [cited by examiner]
JP 2011118822A · 2011 [cited by applicant]
KR 1020060007148A · 2006 [cited by applicant]
KR 1020130016024A · 2013 [cited by applicant]
KR 101309794B1 · 2013 [cited by applicant]
Communication issued on Nov. 22, 2023 by the Korean Intellectual Property Office in Korean Patent Application No. 10-2023-0131957. [cited by applicant]
Communication dated Apr. 27, 2021 issued by the Korean Intellectual Property Office in counterpart Korean Application No. 10-2021-0043182. [cited by applicant]
Communication dated Feb. 18, 2020 from the Korean Patent Office in application No. 10-2013-0122131. [cited by applicant]
Communication dated Jul. 21, 2022 issued by the Korean Patent Office for Korean Patent Application No. 10-2022-0084014. [cited by applicant]
Communication dated Oct. 30, 2020 issued by the Korean Intellectual Property Office in counterpart Korean Application No. 10-2020-0118473. [cited by applicant]
Communication issued Aug. 18, 2021 by the Korean Intellectual Property Office in counterpart Korean Patent Application No. 10-2021-0043182. [cited by applicant]
Communication dated Apr. 27, 2021 issued by the Korean Intellectual Property Office in Korean Application No. 10-2021-0043182. [cited by applicant]
Communication issued Jul. 6, 2026 by the Korean Ministry of Intellectual Property in Korean Patent Application No. 10-2025-0011115. [cited by applicant]