IP Library › Granted Patent US 12,087,304
Granted Patent B2
US 12,087,304 · App. 17/497,668 · Granted Sep 10, 2024

Electronic device for providing text and control method therefor

Inventor: Youngdae Kim (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L15/26G10L15/02G10L15/183G10L15/22G10L21/10H04N21/488H04N21/4884
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,087,304
App. No.
17/497,668
Granted
Sep 10, 2024
Kind
B2
Abstract

An electronic device for providing content including an image and a voice is disclosed. The electronic device comprises: a display configured to display an image; a memory in which a voice recognition module including various executable instructions is stored; and a processor configured to acquire expected words that will possibly be included in a voice, based on information about content, using the expected words to perform voice recognition for the voice through the voice recognition module, and displaying, on the display, text converted from the voice based on the voice recognition.

Claims (32)

1. An electronic device configured to provide content comprising an image and a speech, the device, the electronic device comprising:

a display configured to display the image;

a memory storing a speech recognition module; and

a processor configured to:

obtain an expected word with a possibility of being included in the speech based on information on the content, perform speech recognition on the speech through the speech recognition module using the expected word, and display in the display a text converted from the speech based on the speech recognition,

perform, based on there being an error present in the text displayed on the display, speech recognition on the speech using a different expected word similar to the expected word which was the basis of converting the text with the error from among a plurality of expected words obtained based on information on the content.

2. The electronic device of claim 1 , wherein the processor is configured to: determine a type of the content, determine a content broadcast or published within a pre-set period based on a point at which the content is broadcast from among different contents of a same type as with the type of the content, and obtain a word associated with the determined content as the expected word.

3. The electronic device of claim 1 , wherein the processor is configured to: determine a type of the content, and obtain an expected word corresponding to the type of the content from a database in which an expected word for respective types of content is stored.

4. The electronic device of claim 1 , wherein the processor is configured to: perform a search on the content, and obtain a keyword extracted from the search result as the expected word.

5. The electronic device of claim 1 , wherein the processor is configured to: determine content expected to be viewed based on information on a viewing history or viewing reservation, obtain a word associated with the content expected to be viewed as the expected word, and perform, based on the content expected to be viewed being displayed in the display, speech recognition on a speech of the displayed content through the speech recognition module using the expected word.

6. The electronic device of claim 1 , wherein the processor is configured to: update, based on there being an error present in the text displayed in the display, the expected word based on a word a user uploaded to a server with respect to the content.

7. The electronic device of claim 1 , wherein the processor is configured to: obtain one or more sign language images corresponding to the text, and control the display to display the obtained sign language image.

8. The electronic device of claim 1 , further comprising:

a communicator comprising communication circuitry,

wherein the processor is configured to:

identify, based on information on a sign language broadcast being received from an external device through the communicator, content corresponding to the sign language broadcast based on the received information on the sign language broadcast;

control the display to display a list comprising the identified content; and

control, based on a content included in the list being selected, the display to display a composite image in which an image of the selected content and an image of a sign language broadcast corresponding to the selected content are combined.

9. A method of controlling an electronic device providing

content comprising an image and a speech, the method comprising:

displaying the image;

obtaining an expected word with a possibility of being included in the speech based on information on the content;

performing speech recognition on the speech through a pre-stored speech recognition module using the expected word; and

displaying a text converted from the speech based on the speech recognition,

wherein the method further comprises performing, based on there being an error present in the displayed text, speech recognition on the speech using a different expected word similar with the expected word which was the basis of converting the text with the error from among a plurality of expected words obtained based on information on the content.

10. The method of claim 9 , wherein the obtaining the expected word comprises: determining a type of the content, determining content broadcast or published within a pre-set period based on a point at which the content is broadcast from among different contents of a same type as with the type of the content, and obtaining a word associated with the determined content as the expected word.

11. The method of claim 9 , wherein the obtaining the expected word comprises: determining a type of the content, and obtaining an expected word corresponding to the type of the content from a database in which an expected word for respective types of content is stored.

12. The method of claim 9 , wherein the obtaining the expected word comprises: performing a search on the content, and obtaining a keyword extracted from the search result as the expected word.

13. The method of claim 9 , further comprising:

determining content expected to be viewed by a user based on information on a viewing history or a viewing reservation;

obtaining a word associated with the content expected to be viewed as the expected word; and

performing, based on the content expected to be viewed being displayed in a display of the electronic device, speech recognition on a speech of the displayed content through the speech recognition module using the expected word.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2021
From: KIM, YOUNGDAE
To: SAMSUNG ELECTRONICS CO., LTD
Reel/Frame 057744/0762 →
Priority Claims (1)
KR 10-2019-0044362 · Apr 16, 2019 · national
Continuity (2)
Continuation PCTKR2020004785 · Apr 9, 2020
Related Publication 20220028393A1 · Jan 27, 2022