IP Library › Granted Patent US 10,802,851
Granted Patent B2
US 10,802,851 · App. 15/974,133 · Granted Oct 13, 2020

Display apparatus and controlling method thereof

Inventors: Yang-soo Kim (Yongin-si, KR); Suraj Singh Tanwar (Noida, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F9/454G06F3/0481G06F3/0484G06F3/167G06F40/263
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,802,851
App. No.
15/974,133
Granted
Oct 13, 2020
Kind
B2
Abstract

A display apparatus is provided. The display apparatus according to an embodiment includes a display, and a processor configured to control the display to display a UI screen including a plurality of text objects, control the display to display a text object in a different language from a preset language among the plurality of text objects, along with a preset number, and in response to a recognition result of a voice uttered by a user including the displayed number, perform an operation relating to a text object corresponding to the displayed number.

Claims (40)

1. A display apparatus, comprising:

a display; and

a processor configured to control the display to display user interface comprising a plurality of text objects, identify a first text object including text in a preset language and a second text object including text in a language different from the preset language, among the plurality of text objects, control the display to display an icon associated with the first text object and to display a symbol associated with the second text object, the icon informing that the first text object is selected by uttering the text in the preset language, and based on a recognition result of a voice uttered by a user which includes the symbol, perform an operation relating to the second text object associated with the symbol.

2. The display apparatus as claimed in claim 1 , wherein the processor is further configured to set a language which is set in a setting menu of the display apparatus as the preset language or set a most used language for the plurality of text objects as the preset language.

3. The display apparatus as claimed in claim 1 , wherein the user interface is a webpage, and

wherein the processor is further configured to set a language corresponding to language information of the webpage as the preset language.

4. The display apparatus as claimed in claim 1 , wherein the processor is further configured to determine a text object having at least two languages among the plurality of text objects, as the second text object including the text in the language different from the preset language based on a ratio of the at least two languages.

5. The display apparatus as claimed in claim 1 , wherein the processor is further configured to control the display to display the symbol adjacent to the second text object corresponding to the symbol.

6. The display apparatus as claimed in claim 1 , further comprising:

a communicator,

wherein the processor is further configured to control the display to display the symbol while a signal corresponding to selection of a specific button of an external apparatus is received by the communicator.

7. The display apparatus as claimed in claim 6 , wherein the external apparatus includes a microphone,

wherein the communicator is configured to receive a voice signal corresponding to a voice input through the microphone of the external apparatus, and

wherein the processor is further configured to, in response to a recognition result of the voice signal including the symbol, perform an operation relating to the second text object corresponding to the symbol.

8. The display apparatus as claimed in claim 6 , wherein the processor is further configured to, in response to a recognition result of the voice including a text corresponding to a text object among the plurality of text objects, perform an operation relating to the text object.

9. The display apparatus as claimed in claim 1 , wherein the operation relating to the second text object comprises an operation of displaying a webpage having an URL address corresponding to the second text object or an operation of executing an application program corresponding to the second text object.

10. The display apparatus as claimed in claim 1 , wherein the plurality of text objects is included in an execution screen of a first application, and

wherein the processor is further configured to, in response to determining that an object corresponding to a voice recognition result of a voice uttered by the user is not included in the execution screen of the first application while the execution screen of the first application is displayed, execute a second application different from the first application and perform an operation corresponding to the voice recognition result.

11. The display apparatus as claimed in claim 10 , wherein the second application provides a search result of a search word, and

wherein the processor is further configured to, in response to determining that the object corresponding to the voice recognition result of the voice uttered by the user is not included in the execution screen of the first application while the execution screen of the first application is displayed, execute the second application and provide a search result using a text corresponding to the voice recognition result as the search word.

12. The display apparatus as claimed in claim 1 , further comprising:

a communicator configured to perform communication with a server performing voice recognition of a plurality of different languages,

wherein the processor is further configured to control the communicator to provide a voice signal corresponding to the voice uttered by the user and information on the preset language to the server, and in response to a voice recognition result received from the server including a number, perform an operation relating to a text object corresponding to the symbol.

13. The display apparatus as claimed in claim 12 , wherein the processor is further configured to, in response to the voice recognition result received from the server including a text corresponding to one of the plurality of text objects, perform an operation relating to the text object.

14. A controlling method for a display apparatus, the method comprising:

displaying a user interface comprising a plurality of text objects;

identifying a first text object including text in a preset language and a second text object including text in a language different from the preset language, among the plurality of text objects,

displaying an icon associated with the first text object and displaying a symbol associated with the second text object, the icon informing that the first text object is selected by uttering the text in the preset language; and

based on a recognition result of a voice uttered by a user which includes the symbol, performing an operation relating to the second text object associated with the symbol.

15. The method as claimed in claim 14 , further comprising:

setting a language which is set in a setting menu of the display apparatus as the preset language or setting a most used language for the plurality of text objects as the preset language.

16. The method as claimed in claim 14 , wherein the user interface is a webpage, and

wherein the controlling method for the display apparatus further comprises setting a language corresponding to language information of the webpage as the preset language.

17. The method as claimed in 14 , further comprising:

determining a text object in at least two languages among the plurality of text objects, as the second text object including the text in the language different from the preset language based on a ratio of the at least two languages.

18. The method as claimed in claim 14 , wherein the displaying of the second text object along with the symbol comprises displaying the symbol adjacent to the second text object corresponding to the symbol.

19. The method claimed in claim 14 , wherein the displaying of the second text object along with the symbol comprises displaying the symbol while a signal corresponding to selection of a specific button of an external apparatus is received from the external apparatus.

20. A non-transitory computer readable recording medium having embodied thereon a program for executing a method of controlling a display apparatus, wherein the method comprises:

controlling the display apparatus to display a user interface comprising a plurality of text objects including a first text object and a second text object and display, on the user interface, an icon associated with the first text object including text in a preset language and a symbol associated with the second text object including text in a language different from the preset language, the icon informing that the first text object is selected by uttering the text in the preset language; and

in response to a recognition result of a voice uttered by a user which includes the symbol, performing an operation relating to the second text object associated with the symbol.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2018
From: KIM, YANG-SOO; TANWAR, SURAJ SINGH
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 046103/0959 →
Priority Claims (1)
KR 10-2017-0091494 · Jul 19, 2017 · national
Continuity (2)
Provisional Application 62505363 · May 12, 2017
Related Publication 20180329728A1 · Nov 15, 2018
Cited By (2)
US 12,361,962 US 12,380,914