IP Library Granted Patent US 12,223,956
Granted Patent B2
US 12,223,956 · App. 17/740,616 · Granted Feb 11, 2025

Display device and method for controlling same

Inventors: Donghoon Kang (Suwon-si, KR); Soohyang Kim (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G06F3/14G06F3/167G10L15/08G10L15/28G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,956
App. No.
17/740,616
Granted
Feb 11, 2025
Kind
B2
Abstract

A display device including a user input receiver configured to receive a user input; a voice receiver configured to receive a user voice input; a memory configured to store a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service; and a processor configured to based on a user input for performing a function corresponding to at least one VA application being received through the user input receiver, perform a function corresponding to a first VA application among the plurality of VA applications stored in the memory according to setting information designating the function corresponding to the first VA to be automatically performed according to the user input, and based on a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being included in the user voice input received through the voice receiver, change the setting information stored in the memory such that the function corresponding to the second VA application is automatically performed according to the user input.

Claims (30)

1. A display device comprising:

a user input receiver configured to receive a user input corresponding to a Push to Talk (PTT) function from a user;

a voice receiver configured to receive an utterance voice from the user;

a memory storing a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service based on the utterance voice from the user; and

a processor configured to:

based on the user input corresponding to the PTT function for performing a function corresponding to at least one VA application being received through the user input receiver, perform a function corresponding to a first VA application among the plurality of VA applications according to setting information of the function corresponding to the first VA application to be automatically performed by the user input corresponding to the PTT function, and

based on the utterance voice including a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being received through the voice receiver, change the setting information stored in the memory such that the function corresponding to the second VA application is automatically performed by the user input corresponding to the PTT function,

wherein the processor is further configured to:

based on the user input corresponding to the PTT function for performing the function corresponding to the at least one VA application through the user input receiver being received after changing the setting information, perform the function corresponding to the second VA application among the plurality of VA applications according to the changed setting information of the second VA application to be automatically performed by the user input corresponding to the PTT function,

wherein the first VA application is associated with a first VA server among the plurality of VA servers, and the second VA application is associated with a second VA server different from the first VA server among the plurality of VA servers.

2. The display device of claim 1 , wherein the processor is configured to perform preprocessing on the utterance voice from the user, received from the voice receiver, and transfer the preprocessed utterance voice from the user to the second VA application.

3. The display device of claim 1 , wherein the plurality of VA applications are configured to store conversation policies in the memory that define processing of the utterance obtained from the user through the voice receiver, and the processor is configured to provide voice messages based on the utterance voice from the user and the conversation policies, and update the conversation policies through the plurality of VA servers associated with the plurality of VA applications.

4. The display device of claim 3 , further comprising a sound outputter configured to output the voice messages,

wherein the processor is configured to control the sound outputter based on a voice message provided by the second VA application.

5. The display device of claim 1 , further comprising an image outputter configured to display a user interface,

wherein the processor is configured to display a user interface related to activation/deactivation of the setting information through the image outputter.

6. The display device of claim 1 , wherein the processor is configured to perform preprocessing on the utterance voice from the user, received through the voice receiver, and recognize the wake up word for performing the function corresponding to the second VA application from the preprocessed utterance voice from the user based on a preset time period.

7. The display device of claim 1 , wherein the processor is configured to perform preprocessing on the utterance voice from the user, received through the voice receiver, and determine whether the wake up word for performing the function corresponding to the second VA application is included in the preprocessed utterance voice from the user.

8. The display device of claim 1 , wherein the processor is configured to determine to change the setting information based on a repetition number of the wake up word for performing the function corresponding to the second VA application.

9. The display device of claim 1 , wherein the processor is configured to perform preprocessing on the utterance voice from the user based on at least one of noise removal, echo canceling, or beamforming.

10. A method for controlling a display device including a memory storing a plurality of Voice Assistance (VA) applications associated with a plurality of VA servers that provide a conversation service based on an utterance voice from a user, comprising:

receiving a user input corresponding to a Push to Talk, PTT, function for performing a function corresponding to at least one VA application among the plurality of VA applications through a user input receiver;

based on the user input corresponding to the PTT function for performing a function corresponding to at least one VA application being received through the user input receiver, performing a function corresponding to a first VA application among the plurality of VA applications according to setting information of the function corresponding to the first VA application to be automatically performed by the user input corresponding to the PTT function;

based on the utterance voice including a wake up word for performing a function corresponding to a second VA application among the plurality of VA applications being received through the voice receiver, changing the setting information such that the function corresponding to the second VA application is automatically performed by the user input corresponding to the PTT function; and

based on the user input corresponding to the PTT function for performing the function corresponding to the at least one VA application through the user input receiver being received after changing the setting information, performing the function corresponding to the second VA application among the plurality of VA applications according to the changed setting information of the second VA application to be automatically performed by the user input corresponding to the PTT function;

wherein the first VA application is associated with a first VA server among the plurality of VA servers, and the second VA application is associated with a second VA server different from the first VA server among the plurality of VA servers.

11. The method of claim 10 , further comprising performing preprocessing on the utterance voice from the user,

wherein the changing comprises recognizing the wake up word for performing the function corresponding to the second VA application from the preprocessed utterance voice from the user based on a preset time period.

12. The method of claim 11 , wherein the recognizing comprises determining whether the wake up word for performing the function corresponding to the second VA application is included in the preprocessed utterance voice from the user.

13. The method of claim 11 , wherein the changing comprises changing the setting information based on a repetition number of the wake up word for performing the function corresponding to the second VA application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: KANG, DONGHOON; KIM, SOOHYANG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059880/0079 →
Priority Claims (1)
KR 10-2020-0007759 · Jan 21, 2020 · national
Continuity (2)
Continuation PCTKR2020018679 · Dec 18, 2020
Related Publication 20220270608A1 · Aug 25, 2022
References Cited (20)
US 20150012279A1 · Kim et al. · 2015 [cited by applicant]
US 20190066672A1 · Wood et al. · 2019 [cited by applicant]
US 20190214002A1 · Park · 2019 [cited by examiner]
US 20210104242A1 · Hashimoto · 2021 [cited by examiner]
US 20210233556A1 · Kashima · 2021 [cited by examiner]
CN 107919123A · 2018 [cited by applicant]
EP 3567584A1 · 2019 [cited by applicant]
KR 1020140102339 · 2014 [cited by applicant]
KR 1020180084392A · 2018 [cited by applicant]
KR 1020180110971A · 2018 [cited by applicant]
KR 1020180130648A · 2018 [cited by applicant]
KR 1020190068133A · 2019 [cited by applicant]
KR 1020190079791A · 2019 [cited by applicant]
KR 1020190105175A · 2019 [cited by applicant]
WO WO2019198132A1 · 2019 [cited by applicant]
International Search Report issued in International Patent Application No. PCT/KR2020/018679 dated Apr. 9, 2021. [cited by applicant]
International Written Opinion issued in International Patent Application No. PCT/KR2020/018679 dated Apr. 9, 2021. [cited by applicant]
Extended European Search dated Nov. 22, 2022 in European Patent Application No. 20914836.0 (13 pages). [cited by applicant]
Communication under Rule 71(3) EPC dated Feb. 7, 2024 for corresponding European patent application 20 914 836.0-1224. [cited by applicant]
Office Action issued by the Korean Patent Office on Nov. 25, 2024 for the Korean Patent Application No. 10-2020-0007759. [cited by applicant]