IP Library › Granted Patent US 12,361,962
Granted Patent B2
US 12,361,962 · App. 17/871,576 · Granted Jul 15, 2025

Display apparatus, voice acquiring apparatus and voice recognition method thereof

Inventors: Jong-hyuk Jang (Gunpo-si, KR); Chan-hee Choi (Seoul, KR); Hee-seob Ryu (Hwaseong-si, KR); Kyung-mi Park (Suwon-si, KR); Seung-kwon Park (Yongin-si, KR); Jae-hyun Bae (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L21/06G10L15/22G10L15/30H04L12/282H04N21/41265H04N21/4131H04N21/42203H04N21/43615H04N21/485G10L2015/221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,962
App. No.
17/871,576
Granted
Jul 15, 2025
Kind
B2
Abstract

Disclosed are a display apparatus, a voice acquiring apparatus and a voice recognition method thereof, the display apparatus including: a display unit which displays an image; a communication unit which communicates with a plurality of external apparatuses; and a controller which includes a voice recognition engine to recognize a user's voice, receives a voice signal from a voice acquiring unit, and controls the communication unit to receive candidate instruction words from at least one of the plurality of external apparatuses to recognize the received voice signal.

Claims (35)

1. A display apparatus comprising:

a display;

a signal receiver;

a voice receiver;

a first communication unit configured to communicate with a first external apparatus including a first external voice receiver;

a second communication unit configured to communicate with a second external apparatus including a second external voice receiver; and

a processor configured to:

based on a user voice input received through the voice receiver corresponding to a trigger word, activate a function corresponding to voice recognition using the voice receiver,

based on a trigger signal being received from one of the first external apparatus or the second external apparatus, activate a function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which transmits the trigger signal and prevent the function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which does not transmit the trigger signal, and

based on the function corresponding to voice recognition by the received trigger signal being activated, deactivate the function corresponding to voice recognition using the voice receiver.

2. The display apparatus according to claim 1 , wherein the activation of the function corresponding to voice recognition using the voice receiver comprises activation of a function for receiving the user voice input through the voice receiver and controlling an apparatus corresponding to the received user voice input.

3. The display apparatus according to claim 1 , wherein the deactivation of the function corresponding to voice recognition using the voice receiver corresponds to at least one of controlling the user voice input not to be received through the voice receiver or controlling the user voice input not to be processed.

4. The display apparatus according to claim 1 , wherein, based on a result corresponding to the user voice input obtained through the activated function corresponding to voice recognition corresponding to controlling a function of a third external apparatus, the processor is further configured to control to transmit a signal corresponding to the controlling the function of the third external apparatus to the third external apparatus through the second communication unit.

5. The display apparatus according to claim 1 , wherein based on the trigger signal being received from one of the first external apparatus and the second external apparatus, the processor is further configured to deactivate the function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus and the second external apparatus which does not transmit the trigger signal.

6. The display apparatus according to claim 1 , wherein based on the user voice input received through the voice receiver corresponding to the trigger word, the processor is further configured to deactivate the function corresponding to voice recognition using the first external voice receiver of the first external apparatus and the function corresponding to voice recognition using the second external voice receiver of the second external apparatus.

7. The display apparatus according to claim 1 , wherein the first external apparatus includes a remote controller, and the second external apparatus includes a second display apparatus in which an application associated with the function corresponding to voice recognition is able to be stored.

8. The display apparatus according to claim 1 , wherein based on the function corresponding to voice recognition being activated, the processor is further configured to control the display to display a user interface (UI) corresponding to the activated function.

9. The display apparatus according to claim 1 , wherein the processor is further configured to receive an image signal through the signal receiver, process the received image signal, and control the display to display an image corresponding to the image signal.

10. The display apparatus according to claim 1 , wherein the first communication unit includes a Bluetooth module, and the second communication unit includes a wireless LAN module.

11. A method for controlling a display apparatus, the method comprising:

based on a user voice input received through a voice receiver corresponding to a trigger word, activating a function corresponding to voice recognition using the voice receiver,

based on a trigger signal being received from one of a first external apparatus configured to communicate through a first communication unit and including a first external voice receiver or a second external apparatus configured to communicate through a second communication unit and including a second external voice receiver, activating a function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which transmits the trigger signal and prevent the function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which does not transmit the trigger signal, and

based on the function corresponding to voice recognition by the received trigger signal being activated, deactivating the function corresponding to voice recognition using the voice receiver.

12. The method according to claim 11 , wherein the activation of the function corresponding to voice recognition using the voice receiver comprises activation of a function for receiving the user voice input through the voice receiver and controlling an apparatus corresponding to the received user voice input.

13. The method according to claim 11 , wherein the deactivation of the function corresponding to voice recognition using the voice receiver corresponds to at least one of controlling the user voice input not to be received through the voice receiver or controlling the user voice input not to be processed.

14. The method according to claim 11 , based on a result corresponding to the user voice input obtained through the activated function corresponding to voice recognition corresponding to controlling a function of a third external apparatus, transmitting a signal corresponding to the controlling the function of the third external apparatus to the third external apparatus through the second communication unit.

15. The method according to claim 11 , based on the trigger signal being received from one of the first external apparatus and the second external apparatus, further comprising deactivating the function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus and the second external apparatus which does not transmit the trigger signal.

16. The method according to claim 11 , based on the user voice input received through the voice receiver corresponding to the trigger word, further comprising deactivating the function corresponding to voice recognition using the first external voice receiver of the first external apparatus and the function corresponding to voice recognition using the second external voice receiver of the second external apparatus.

17. The method according to claim 11 , wherein the first external apparatus includes a remote controller, and the second external apparatus includes a second display apparatus in which an application associated with the function corresponding to voice recognition is able to be stored.

18. The method according to claim 11 , based on the function corresponding to voice recognition being activated, further comprising displaying a user interface (UI) corresponding to the activated function on a display.

19. The method according to claim 11 , further comprising receiving an image signal through a signal receiver, processing the received image signal, and displaying an image corresponding to the image signal on a display.

20. A computer-readable non-transitory recording media recorded with a program executable by a processor of a display apparatus to perform:

based on a user voice input received through a voice receiver corresponding to a trigger word, activating a function corresponding to voice recognition using the voice receiver,

based on a trigger signal being received from one of a first external apparatus configured to communicate through a first communication unit and including a first external voice receiver or a second external apparatus configured to communicate through a second communication unit and including a second external voice receiver, activating a function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which transmits the trigger signal and prevent the function corresponding to voice recognition using the first external voice receiver or the second external voice receiver corresponding to one of the first external apparatus or the second external apparatus which does not transmit the trigger signal, and

based on the function corresponding to voice recognition by the received trigger signal being activated, deactivating the function corresponding to voice recognition using the voice receiver.

Priority Claims (1)
KR 10-2012-0126650 · Nov 9, 2012 · national
Continuity (4)
Continuation 16790237 · Feb 13, 2020
Continuation 15671178 · Aug 8, 2017
Continuation 14076361 · Nov 11, 2013
Related Publication 20220358949A1 · Nov 10, 2022
References Cited (160)
US 5752232A · Basore et al. · 1998 [cited by applicant]
US 6070139A · Miyazawa et al. · 2000 [cited by applicant]
US 6188985B1 · Thrift et al. · 2001 [cited by applicant]
US 6397186B1 · Bush et al. · 2002 [cited by applicant]
US 6477497B1 · Aizawa et al. · 2002 [cited by applicant]
US 6535854B2 · Buchner et al. · 2003 [cited by applicant]
US 6556970B1 · Sasaki et al. · 2003 [cited by applicant]
US 6615177B1 · Rapp et al. · 2003 [cited by applicant]
US 6993486B2 · Shimakawa · 2006 [cited by examiner]
US 7801730B1 · Miyazaki et al. · 2010 [cited by applicant]
US 8260618B2 · Mahlbacher · 2012 [cited by applicant]
US 8271287B1 · Kermani · 2012 [cited by applicant]
US 10043537B2 · Jang · 2018 [cited by examiner]
US 10555041B2 · Sim · 2020 [cited by examiner]
US 10586554B2 · Jang · 2020 [cited by examiner]
US 10802851B2 · Kim · 2020 [cited by examiner]
US 11727951B2 · Jang · 2023 [cited by examiner]
US 20020013710A1 · Shimakawa · 2002 [cited by applicant]
US 20020071577A1 · Lemay et al. · 2002 [cited by applicant]
US 20020072912A1 · Yen · 2002 [cited by examiner]
US 20020161572A1 · Kusumoto · 2002 [cited by examiner]
US 20020174213A1 · Ibaraki · 2002 [cited by applicant]
US 20030061033A1 · Dishert · 2003 [cited by applicant]
US 20030177012A1 · Drennan · 2003 [cited by applicant]
US 20030182132A1 · Niemoeller · 2003 [cited by applicant]
US 20030185358A1 · Sakamoto · 2003 [cited by applicant]
US 20030187659A1 · Cho et al. · 2003 [cited by applicant]
US 20040010409A1 · Ushida · 2004 [cited by examiner]
US 20040083103A1 · Mozer et al. · 2004 [cited by applicant]
US 20040117179A1 · Balasuriya · 2004 [cited by applicant]
US 20050256370A1 · Fujita · 2005 [cited by applicant]
US 20060004743A1 · Murao et al. · 2006 [cited by applicant]
US 20060047473A1 · Picciotto et al. · 2006 [cited by applicant]
US 20060074658A1 · Chadha · 2006 [cited by applicant]
US 20060106614A1 · Mowatt et al. · 2006 [cited by applicant]
US 20070299670A1 · Chang · 2007 [cited by applicant]
US 20080037727A1 · Sivertsen et al. · 2008 [cited by applicant]
US 20080059195A1 · Brown · 2008 [cited by applicant]
US 20080097759A1 · Shin · 2008 [cited by applicant]
US 20080167868A1 · Kanevsky et al. · 2008 [cited by applicant]
US 20090018830A1 · Emmanuel · 2009 [cited by applicant]
US 20090058708A1 · Park et al. · 2009 [cited by applicant]
US 20090099836A1 · Jacobsen et al. · 2009 [cited by applicant]
US 20090204410A1 · Mozer et al. · 2009 [cited by applicant]
US 20090248413A1 · Liu et al. · 2009 [cited by applicant]
US 20090319276A1 · Chang et al. · 2009 [cited by applicant]
US 20100010813A1 · Harada · 2010 [cited by applicant]
US 20100088100A1 · Lindahl · 2010 [cited by applicant]
US 20100332236A1 · Tan · 2010 [cited by examiner]
US 20110050478A1 · Choi et al. · 2011 [cited by applicant]
US 20110067059A1 · Johnston et al. · 2011 [cited by applicant]
US 20110093261A1 · Angott · 2011 [cited by applicant]
US 20110119715A1 · Chang et al. · 2011 [cited by applicant]
US 20110153323A1 · Kim et al. · 2011 [cited by applicant]
US 20110161075A1 · Hon-Anderson · 2011 [cited by applicant]
US 20110246902A1 · Tsai et al. · 2011 [cited by applicant]
US 20110286600A1 · Gosior et al. · 2011 [cited by applicant]
US 20120078635A1 · Rothkopf · 2012 [cited by examiner]
US 20120173238A1 · Mickelsen et al. · 2012 [cited by applicant]
US 20130027613A1 · Kim et al. · 2013 [cited by applicant]
US 20130073293A1 · Jang · 2013 [cited by examiner]
US 20130144618A1 · Sun et al. · 2013 [cited by applicant]
US 20130278719A1 · Rusert · 2013 [cited by examiner]
US 20130297319A1 · Kim · 2013 [cited by applicant]
US 20140074472A1 · Lin · 2014 [cited by examiner]
US 20140122087A1 · Macho · 2014 [cited by applicant]
US 20140136205A1 · Jang et al. · 2014 [cited by applicant]
US 20150088518A1 · Kim et al. · 2015 [cited by applicant]
US 20220358949A1 · Jang et al. · 2022 [cited by applicant]
US 20230121055A1 · Jang et al. · 2023 [cited by applicant]
CN 1223508A · 1999 [cited by applicant]
CN 1342308A · 2002 [cited by applicant]
CN 1386264A · 2002 [cited by applicant]
CN 1437377A · 2003 [cited by applicant]
CN 2620913Y · 2004 [cited by applicant]
CN 1713271A · 2005 [cited by applicant]
CN 1723487A · 2006 [cited by applicant]
CN 1725902A · 2006 [cited by applicant]
CN 1975799A · 2007 [cited by applicant]
CN 101625864A · 2010 [cited by applicant]
CN 101778198A · 2010 [cited by applicant]
CN 102196207A · 2011 [cited by applicant]
CN 102255780A · 2011 [cited by applicant]
CN 202033897U · 2011 [cited by applicant]
EP 1045374A1 · 2000 [cited by applicant]
EP 1207516A1 · 2002 [cited by applicant]
EP 2518722A2 · 2012 [cited by applicant]
JP 11311996A · 1999 [cited by applicant]
JP 2000200395A · 2000 [cited by applicant]
JP 200142884A · 2001 [cited by applicant]
JP 2001197379A · 2001 [cited by applicant]
JP 2001296881A · 2001 [cited by applicant]
JP 200572764A · 2005 [cited by applicant]
JP 200633795A · 2006 [cited by applicant]
JP 201496153A · 2014 [cited by applicant]
KR 1999015328A · 1999 [cited by applicant]
KR 1020020032621A · 2002 [cited by applicant]
KR 1020050054399A · 2005 [cited by applicant]
KR 1020060042296A · 2006 [cited by applicant]
KR 1020080096239A · 2008 [cited by applicant]
KR 1020090023943A · 2009 [cited by applicant]
KR 1020110028103A · 2011 [cited by applicant]
KR 1020110070338A · 2011 [cited by applicant]
RU 121608U1 · 2012 [cited by applicant]
Communication dated Oct. 24, 2019 issued by the Korean Intellectual Property Office in counterpart Korean Application No. 10-2012-0126650. [cited by applicant]
Communication dated Dec. 18, 2019 issued by the Korean Intellectual Property Office in counterpart Korean Application No. 10-2012-0126650. [cited by applicant]
Communication dated Mar. 15, 2019, issued by the USPTO in counterpart U.S. Appl. No. 15/489,101. [cited by applicant]
Communication dated Apr. 3, 2019, issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201510276510.6. [cited by applicant]
Communication dated May 13, 2019, issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201310553280.4. [cited by applicant]
Zhengming MA, “Guide to The Exam for Network Engineering, elaboration on key points, Example questions, Intensive exercises”, Metallurgical Industry Press Co., Ltd., Feb. 28, 2005, pp. 23-24 (3 pages total). [cited by applicant]
Communication dated Aug. 22, 2019, issued by the USPTO in counterpart U.S. Appl. No. 15/489,101. [cited by applicant]
Communication dated Jul. 2, 2019, from the State Intellectual Property Office of People's Republic of China in counterpart Application No. 201510276510.6. [cited by applicant]
Communication dated Jul. 19, 2019, from the European Patent Office in counterpart European Application No. 18159291.6. [cited by applicant]
Communication dated Jul. 16, 2019, from the Japanese Patent Office in counterpart application No. 2015-178839. [cited by applicant]
Communication dated Dec. 10, 2018, issued by the European Patent Office in counterpart European Application No. 18159291.6. [cited by applicant]
Communication dated Sep. 10, 2018 issued by the United States Patent Office in Counterpart U.S. Appl. No. 15/489,101. [cited by applicant]
Communication dated Nov. 23, 2018 issued by the State Intellectual Property Office of P.R. China in Counterpart Chinese Application No. 201310553280.4. [cited by applicant]
Communication dated Mar. 21, 2018 issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Patent Application No. 201310553280.4. [cited by applicant]
Communication dated Mar. 27, 2018 issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Patent Application No. 201510276510.6. [cited by applicant]
Communication dated Mar. 27, 2018 issued by the Japanese Patent Office in counterpart Japanese Patent Application No. 2015-178839. [cited by applicant]
Communication dated Apr. 9, 2018 issued by the European Patent Office in counterpart European Patent Application No. 18159291.6. [cited by applicant]
Communication dated Apr. 24, 2018 issued by the Korean Intellectual Property Office in counterpart Korean Patent Application No. 10-2012-0045617. [cited by applicant]
Communication dated May 8, 2018 issued by the United States Patent and Trademark Office in counterpart U.S. Appl. No. 15/489,101. [cited by applicant]
Communication issued Dec. 15, 2016 issued by the United states Patent and Trademark Office in counterpart U.S. Appl. No. 13/781,819. [cited by applicant]
Communication issued Dec. 22, 2016, issued by the European Patent Office in counterpart European Patent Application No. 13191285.9. [cited by applicant]
Communication from United States Patent and Trademark Office issued May 12, 2016, in U.S. Appl. No. 13/781,819. [cited by applicant]
Communication dated Jan. 15, 2016, issued by the United States Patent and Trademark Office in counterpart U.S. Appl. No. 13/781,819. [cited by applicant]
Communication dated Feb. 15, 2016, issued by the European Patent Office in counterpart European Application No. 13191285.9. [cited by applicant]
Communication dated Jul. 13, 2015 issued by United States Patent and Trademark Office in counterpart U.S. Appl. No. 13/781,819. [cited by applicant]
Communication dated May 1, 2015 issued by Japanese Patent Office in counterpart Japanese Patent Application No. 2013-231944. [cited by applicant]
Communication dated May 4, 2015 issued by European Patent Office in counterpart European Application No. 13191285.9. [cited by applicant]
Communication dated Oct. 28, 2014, issued by the Japanese Intellectual Property Office in counterpart Japanese Application No. 2013-231944. [cited by applicant]
Communication dated Jan. 28, 2014, issued by the European Patent Office in counterpart European Patent Application No. 13191285.9. [cited by applicant]
International Search Report (PCT/ISA/210), dated Mar. 3, 2014, issued by the International Searching Authority in counterpart International Patent Application No. PCT/KR2013/009880. [cited by applicant]
Communication issued Oct. 27, 2017, issued by the Federal Service for Intellectual Property in counterpart Russian Patent Application No. 2015121906. [cited by applicant]
Communication issued Nov. 3, 2017, issued by the European Patent Office in counterpart European Patent Application No. 13191285.9. [cited by applicant]
Communication issued Jul. 4, 2017, issued by the State Intellectual Property Office of the People's Republic of China in counterpart Chinese Patent Application No. 201510276510.6. [cited by applicant]
Communication issued Sep. 19, 2017, issued by the Japanese Patent Office in counterpart Japanese Patent Application No. 2015-178839. [cited by applicant]
Communication from United States Patent and Trademark Office issued Oct. 13, 2017, in U.S. Appl. No. 14/076,361. [cited by applicant]
Communication issued Apr. 30, 2019, issued by the Korean Intellectual Property Office in counterpart Korean Patent Application No. 10-2012-0126650. [cited by applicant]
Communication dated Sep. 10, 2018 issued by the United States Patent Office in Counterpart U.S. Appl. No. 15/671,178. [cited by applicant]
Communication dated Mar. 14, 2019 issued by the United States Patent Office in Counterpart U.S. Appl. No. 15/671,178. [cited by applicant]
Communication dated Jun. 14, 2019 issued by the United States Patent Office in Counterpart U.S. Appl. No. 15/671,178. [cited by applicant]
Communication dated May 26, 2020 issued by the Indian Patent Office in Indian Counterpart Application No. 4910/DELNP/2015. [cited by applicant]
Communication dated Jun. 2, 2020 issued by the European Intellectual Property Office in counterpart European Application No. 18 159 291.6. [cited by applicant]
Communication dated May 26, 2020 issued by the European Intellectual Property Office in counterpart European Application No. 18 159 291.6. [cited by applicant]
Communication dated Apr. 7, 2020 issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201510276510.6. [cited by applicant]
Communication dated Jun. 18, 2020 issued by the United States Patent Office in counterpart U.S. Appl. No. 15/489,101. [cited by applicant]
Communication dated Jun. 29, 2020 issued by the Korean Intellectual Property Office in counterpart Korean Application No. 10-2012-0126650. [cited by applicant]
Communication dated Jul. 13, 2020 issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201510276510.6. [cited by applicant]
Communication dated Jan. 29, 2021, issued by the European Patent Office in application No. 20202566.4. [cited by applicant]
Communication dated Feb. 23, 2021, issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201510276510.6. [cited by applicant]
Communication dated Feb. 26, 2021 issued by the Korean Patent Office in application No. 10-2020-0094662. [cited by applicant]
Office Action dated Nov. 15, 2023, issued by Indian Patent Office in Indian Patent Application No. 4910/DELNP/2015. [cited by applicant]
Communication dated Nov. 21, 2022, issued by the European Patent Office in counterpart European Patent Application No. 22187072.8. [cited by applicant]
Communication issued Feb. 26, 2024 by the European Patent Office in European Patent Application No. 20202566.4. [cited by applicant]
Communication issued on Apr. 28, 2023 by the Korean Intellectual Property Office for Korean Patent Application No. 10-2023-0016144. [cited by applicant]
Communication issued Dec. 17, 2024 by the United States Patent and Trademark Office in U.S. Appl. No. 18/068,935. [cited by applicant]
Communication issued Feb. 10, 2025 by the European Patent Office in European Application No. 22187072.8. [cited by applicant]
Communication issued Feb. 27, 2025 by the Korean Intellectual Property Office in Korean Application No. 10-2024-0027667. [cited by applicant]