IP Library Granted Patent US 12,198,692
Granted Patent B2
US 12,198,692 · App. 17/641,068 · Granted Jan 14, 2025

Display apparatus

Inventor: Jaekyung Lee (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G10L15/22G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,692
App. No.
17/641,068
Granted
Jan 14, 2025
Kind
B2
Abstract

A display device according to an embodiment of the present disclosure may include display unit; a wireless communication unit configured to wirelessly communicate with the home appliance; and a control unit configured to: receive a voice command, obtain the intention of the received voice command, identify one or more home appliances associated with the obtained intention, receive state information of the one or more home appliances from the identified one or more home appliances through the wireless communication unit, based on the received state information, obtain recommended operation information of the identified one or more home appliances, and display intention analysis information, the state information, and the recommended operation information, which are the analysis results of the intention, on the display unit.

Claims (57)

1. A display device comprising:

a display;

a wireless communication unit configured to wirelessly communicate with a home appliance; and

a control unit configured to:

receive a voice command,

obtain an analysis result comprising an intention of the received voice command and,

identify one or more home appliances associated with the obtained analysis result,

receive intention analysis information according to the intention from an external server or the one or more home appliances,

receive state information of the one or more home appliances from the identified one or more home appliances through the wireless communication unit,

based on the received state information and the analysis result of the voice command, generate recommended operation information for a recommended operation of the identified one or more home appliances, and

display, on the display, intention analysis information according to the intention of the voice command, the state information, and the recommended operation information for confirmation to perform operation of the identified one or more home appliances according to the recommended operation, based on analysis results of the intention.

2. The display device of claim 1 ,

wherein the control unit is further configured to identify one or more home appliances capable of providing information indicated by the intention among a plurality of home appliances provided in a house.

3. The display device of claim 1 ,

wherein the control unit is further configured to:

identify one or more home appliances capable of controlling information indicated by the intention among a plurality of home appliances provided in a house.

4. The display device of claim 1 ,

wherein the state information of the one or more home appliances includes at least one of measurement information measured by each home appliance and operation information related to operation of each home appliance.

5. The display device of claim 4 ,

wherein the control unit generates the recommended operation information for controlling operation of the one or more home appliances in a case where it is determined that a change in an environment in a house is necessary based on the measurement information.

6. The display device of claim 1 ,

wherein the control unit is further configured to receive an additional voice command according to a request for a recommended operation, and

transmit a control command based on the recommended operation information for the recommended operation to the one or more home appliances through the wireless communication unit, upon receiving the request for the recommended operation.

7. The display device of claim 1 ,

wherein the control unit identifies one or more home appliances that provide information on air quality state among a plurality of home appliances in a house, in a case where the intention is to provide weather information.

8. A display device comprising:

a display;

a network interface unit configured to communicate with an artificial intelligence server;

a microphone configured to receive voice commands; and

a control unit configured to:

transmit a received voice command to the artificial intelligence server,

receive, from the artificial intelligence server, intention analysis information that is a result of analyzing an intention of the voice command, state information of one or more home appliances associated with the intention, and recommended operation information for a recommended operation of the one or more home appliances generated based on the state information of the one or more home appliances and the result of analyzing the intention of the voice command, and

display, on the display, the intention analysis information according to the intention of the voice command, the state information, and the recommended operation information for confirmation to perform operation of the one or more home appliances according to the recommended operation.

9. The display device of claim 8 ,

wherein the recommended operation information includes information for guiding operation of the one or more home appliances to perform an operation associated with the intention of the voice command.

10. The display device of claim 8 ,

wherein the state information of the one or more home appliances includes at least one of measurement information measured by each home appliance and operation information related to operation of each home appliance.

11. The display device of claim 8 ,

wherein the control unit is further configured to:

receive an additional voice command according to a request for a recommended operation through the microphone, and

transmit a control command based on the recommended operation information for the recommended operation to the artificial intelligence server, upon receiving request for the recommended operation.

12. The display device of claim 8 ,

wherein, in a case where the intention of the voice command is to provide weather information, the intention analysis information is weather information, the state information is an indoor air quality state measured by an air purifier, and the recommended operation information is information that guides to turn on operation of the air purifier.

13. The display device of claim 8 ,

wherein, in a case where the intention of the voice command is to provide weather information, the intention analysis information is weather information, the state information includes an indoor air quality state measured by an air purifier and a temperature measured by an air conditioner, and the recommended operation information is information that turns on operation of the air purifier and guides an operation mode of the air conditioner to operate in a cooling mode.

14. The display device of claim 1 , wherein the one or more home appliances comprise a first home appliance and a second home appliance, and the control unit is further configured to:

identify the first home appliance and the second home appliance associated with the obtained analysis result,

receive a first state information of the first home appliance from the first home appliance through the wireless communication unit,

based on the received first state information, obtain a first recommended operation information of the first home appliance,

receive a second state information of the second home appliance from the second home appliance, and

based on the received second state information, obtain a second recommended operation information of the second home appliance.

15. The display device of claim 8 ,

wherein the one or more home appliances comprise a first home appliance and a second home appliance, and the control unit is further configured to:

receive, from the artificial intelligence server, a first state information of the first home appliance from the first home appliance through the network interface unit,

based on the received first state information, receive, from the artificial intelligence server, a first recommended operation information of the first home appliance,

receive, from the artificial intelligence server, a second state information of the second home appliance from the second home appliance, and

based on the received second state information, receive, from the artificial intelligence server, a second recommended operation information of the second home appliance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2022
From: LEE, JAEKYUNG
To: LG ELECTRONICS INC.
Reel/Frame 059201/0456 →
Continuity (1)
Related Publication 20220343909A1 · Oct 27, 2022
References Cited (19)
US 20180210703A1 · Meyers et al. · 2018 [cited by applicant]
US 20190267004A1 · Lee · 2019 [cited by examiner]
US 20200013407A1 · Chae · 2020 [cited by applicant]
CN 112513833B · 2024 [cited by examiner]
KR 1020170056586 · 2017 [cited by applicant]
KR 102389594B1 · 2017 [cited by examiner]
KR 20190008480 · 2019 [cited by applicant]
KR 1020190014569 · 2019 [cited by applicant]
KR 1020190026521 · 2019 [cited by applicant]
KR 20190042903 · 2019 [cited by applicant]
KR 20190070906A · 2019 [cited by examiner]
KR 1020190065200 · 2019 [cited by applicant]
WO WO2015088141A1 · 2015 [cited by examiner]
WO 2019050227 · 2019 [cited by applicant]
WO 2019136065 · 2019 [cited by applicant]
WO WO2019136065A1 · 2019 [cited by examiner]
PCT International Application No. PCT/KR2019/011550, International Search Report dated May 28, 2020, 4 pages. [cited by applicant]
European Patent Office Application Serial No. 19944542.0, Search Report dated Apr. 18, 2023, 3 pages. [cited by applicant]
European Patent Office Application Serial No. 19944542.0, Search Report dated Jul. 14, 2023, 2 pages. [cited by applicant]