IP Library › Granted Patent US 12,430,155
Granted Patent B2
US 12,430,155 · App. 18/347,391 · Granted Sep 30, 2025

Display apparatus and controlling method thereof

Inventors: Yang-Soo Kim (Yongin-si, KR); Suraj Singh Tanwar (Noida, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F9/454G06F3/0481G06F3/0484G06F3/167G06F40/263
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,155
App. No.
18/347,391
Granted
Sep 30, 2025
Kind
B2
Abstract

A display apparatus is provided. The display apparatus according to an embodiment includes a display, and a processor configured to control the display to display a UI screen including a plurality of text objects, control the display to display a text object in a different language from a preset language among the plurality of text objects, along with a preset number, and in response to a recognition result of a voice uttered by a user including the displayed number, perform an operation relating to a text object corresponding to the displayed number.

Claims (53)

1. A display apparatus, comprising:

a display; and

a processor configured to:

control the display to display a first screen including a plurality of objects,

receive a voice signal corresponding to a voice input received using a microphone of the display apparatus or an external apparatus,

process the voice signal to obtain a voice recognition result comprising a text,

determine that the text is included in the displayed plurality of objects,

based on determining that the text is included in a single object among the displayed plurality of objects, perform an operation related to the single object, and

based on determining that the text is commonly included in at least two objects among the displayed plurality of objects, control the display to display a modified first screen which additionally includes at least two icons,

wherein each icon of the at least two icons represents a number, and is displayed adjacent to a corresponding object from among the at least two objects.

2. The display apparatus as claimed in claim 1 , wherein the display apparatus further comprises a communicator, and

wherein the processor is further configured to:

control the communicator to transmit the voice signal to a server, and

receive, using the communicator, the voice recognition result from the server.

3. The display apparatus as claimed in claim 1 , wherein the processor is further configured to:

control the display to display the at least two icons based on information about positions of the at least two objects.

4. The display apparatus as claimed in claim 1 , wherein the voice input is a first voice input, the voice signal is a first voice signal, the voice recognition result is a first voice recognition result, the text is a first text, and the single object is a first single object, and

wherein the processor is further configured to:

receive a second voice signal corresponding to a second voice input received using the microphone of the display apparatus or the external apparatus,

process the second voice signal to obtain a second voice recognition result comprising a second text, and

based on the second text corresponding to a second single object among the at least two objects, perform an operation related to the second single object.

5. The display apparatus as claimed in claim 1 , wherein the number is expressed by a word of a basic language used for voice recognition.

6. The display apparatus as claimed in claim 1 , wherein the single object and the at least two objects are selectable based on the voice signal, and

wherein each of the single object and the at least two objects comprises a text object in a preset language.

7. The display apparatus as claimed in claim 1 , wherein the processor is further configured to:

control the display to display, along with the at least two icons, a phrase instructing a user to provide an additional voice input comprising the number.

8. The display apparatus as claimed in claim 1 , wherein the processor is further configured to:

based on determining that the plurality of objects do not correspond to the voice recognition result, control the display to display a search result based on the text included in the voice recognition result.

9. A method of controlling a display apparatus, the method comprising:

displaying a first screen including a plurality of objects,

receiving a voice signal corresponding to a voice input received using a microphone of the display apparatus or an external apparatus,

processing the voice signal to obtain a voice recognition result comprising a text,

determining that the text is included in the displayed plurality of objects,

based on determining that the text is included in a single object among the displayed plurality of objects, performing an operation related to the single object, and

based on determining that the text is commonly included in at least two objects among the displayed plurality of objects, displaying a modified first screen which additionally includes at least two icons,

wherein each icon of the at least two icons represents a number, and is displayed adjacent to a corresponding object from among the at least two objects.

10. The display apparatus as claimed in claim 9 , further comprising:

transmitting the voice signal to a server, and

receiving the voice recognition result from the server.

11. The display apparatus as claimed in claim 9 , further comprising:

displaying the at least two icons based on information about positions of the at least two objects.

12. The display apparatus as claimed in claim 9 , wherein the voice input is a first voice input, the voice signal is a first voice signal, the voice recognition result is a first voice recognition result, the text is a first text, and the single object is a first single object, and

wherein the method further comprises:

receiving a second voice signal corresponding to a second voice input received using the microphone of the display apparatus or the external apparatus,

processing the second voice signal to obtain a second voice recognition result comprising a second text, and

based on the second text corresponding to a second single object among the at least two objects, performing an operation related to the second single object.

13. The display apparatus as claimed in claim 9 , wherein the number is expressed by a word of a basic language used for voice recognition.

14. The display apparatus as claimed in claim 9 , wherein the single object and the at least two objects are selectable based on the voice signal, and

wherein each of the single object and the at least two objects comprises a text object in a preset language.

15. The display apparatus as claimed in claim 9 , further comprising:

displaying, along with the at least two icons, a phrase instructing a user to provide an additional voice input comprising the number.

16. The display apparatus as claimed in claim 9 , further comprising:

based on determining that the plurality of objects do not correspond to the voice recognition result, displaying a search result based on the text included in the voice recognition result.

Priority Claims (1)
KR 10-2017-0091494 · Jul 19, 2017 · national
Continuity (4)
Continuation 17010614 · Sep 2, 2020
Continuation 15974133 · May 8, 2018
Provisional Application 62505363 · May 12, 2017
Related Publication 20230350707A1 · Nov 2, 2023
References Cited (61)
US 8560322B2 · Lee et al. · 2013 [cited by applicant]
US 8635061B2 · Li et al. · 2014 [cited by applicant]
US 9002699B2 · Qin · 2015 [cited by applicant]
US 9026448B2 · Koivuniemi et al. · 2015 [cited by applicant]
US 9129011B2 · Yang · 2015 [cited by applicant]
US 9183832B2 · Bak et al. · 2015 [cited by applicant]
US 9355639B2 · Otani · 2016 [cited by applicant]
US 9886958B2 · Celikyilmaz · 2018 [cited by examiner]
US 10339823B2 · Bak · 2019 [cited by applicant]
US 10922990B2 · Bak · 2021 [cited by applicant]
US 20060106614A1 · Mowatt · 2006 [cited by examiner]
US 20060271352A1 · Nikitin et al. · 2006 [cited by applicant]
US 20100105364A1 · Yang · 2010 [cited by examiner]
US 20120095748A1 · Li · 2012 [cited by examiner]
US 20120313849A1 · Bak · 2012 [cited by examiner]
US 20130033644A1 · Kim · 2013 [cited by examiner]
US 20130124187A1 · Qin · 2013 [cited by examiner]
US 20140052450A1 · Cheong · 2014 [cited by examiner]
US 20140195230A1 · Han · 2014 [cited by examiner]
US 20140196087A1 · Park · 2014 [cited by examiner]
US 20140223273A1 · Chung · 2014 [cited by examiner]
US 20140358542A1 · Otani · 2014 [cited by examiner]
US 20150066473A1 · Jeong · 2015 [cited by examiner]
US 20150161099A1 · Lee et al. · 2015 [cited by applicant]
US 20150371629A9 · Julia et al. · 2015 [cited by applicant]
US 20160133146A1 · Bak · 2016 [cited by examiner]
US 20160202872A1 · Jang · 2016 [cited by examiner]
US 20190279523A1 · Bak · 2019 [cited by applicant]
US 20210065572A1 · Bak · 2021 [cited by applicant]
CN 101729656A · 2010 [cited by applicant]
CN 102402584A · 2012 [cited by applicant]
CN 102833582A · 2012 [cited by applicant]
CN 102866824A · 2013 [cited by applicant]
CN 103888799A · 2014 [cited by applicant]
CN 104423582A · 2015 [cited by applicant]
CN 104904227A · 2015 [cited by applicant]
CN 105592343A · 2016 [cited by applicant]
CN 106250474A · 2016 [cited by applicant]
EP 2533242A1 · 2012 [cited by applicant]
JP 2014235356A · 2014 [cited by applicant]
JP 5774035B2 · 2015 [cited by applicant]
KR 1020130018464A · 2013 [cited by applicant]
KR 1020140092873A · 2014 [cited by applicant]
KR 1020140100315A · 2014 [cited by applicant]
KR 1020150067489A · 2015 [cited by applicant]
KR 101545582B1 · 2015 [cited by applicant]
KR 1020160148173A · 2016 [cited by applicant]
WO 9948088A1 · 1999 [cited by applicant]
WO 2012050743A2 · 2012 [cited by applicant]
Communication issued Nov. 2, 2023 by the Indian Patent Office in Indian Patent Application No. 201814017689. [cited by applicant]
Communication dated May 31, 2023 by the China National Intellectual Property Administration in Chinese Application No. 201810467513.1. [cited by applicant]
Communication dated Aug. 30, 2022 issued by the Chinese Patent Office in Chinese Patent Application No. 201810467513.1. [cited by applicant]
Communication dated Apr. 11, 2022 issued by the Korean Patent Office in Korean Application No. 10- 2017-0091494. [cited by applicant]
Communication issued Oct. 8, 2021 by the European Patent Office in counterpart European Patent Application No. 18169943.0. [cited by applicant]
Communication issued Oct. 25, 2021 by the Korean Intellectual Property Office in counterpart Korean Patent Application No. 10-2017-0091494. [cited by applicant]
Communication issued Nov. 11, 2021 by the European Patent Office in counterpart European Patent Application No. 18169943.0. [cited by applicant]
Communication dated Mar. 29, 2021, issued by the European Patent Office in counterpart European Application No. 18169943.0. [cited by applicant]
Communication dated Nov. 25, 2020 issued by the Indian Patent Office in counterpart Indian Application No. 201814017689. [cited by applicant]
Communication issued Oct. 4, 2018 by the European Patent Office in counterpart European Patent Application No. 18169943.0. [cited by applicant]
Communication dated Aug. 19, 2020, from the European Patent Office in counterpart European Application No. 18169943.0. [cited by applicant]
Communication dated Jun. 29, 2025, issued by the China National Intellectual Property Administration in Chinese Patent Application No. 202310065267.8. [cited by applicant]