IP Library Granted Patent US 11,341,966
Granted Patent B2
US 11,341,966 · App. 16/694,359 · Granted May 24, 2022

Output for improving information delivery corresponding to voice request

Inventor: Myeongsoo Shin (Seongnam-si, KR)
Assignees: NAVER CORPORATION; LINE CORPORATION
G10L15/22G10L13/02G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,341,966
App. No.
16/694,359
Granted
May 24, 2022
Kind
B2
Abstract

An output technology for improving information delivery corresponding to a voice request is provided. In one embodiment, a method by which an electronic device comprising a voice-based interface provides information comprises the steps of: receiving a voice request from a user through the voice-based interface; acquiring response information corresponding to the voice request; outputting the response information in a reply voice, which is an auditory output form, through at least one medium among a plurality of media including a main medium corresponding to the voice-based interface and a sub medium included in other electronic devices linkable with the electronic device; and providing other outputs for at least a part of the response information through at least one medium, which is the same as or different from the medium through which the reply voice is being outputted, among the plurality of media.

Claims (42)

1. An information providing method performed by an electronic device having a voice-based interface, the method comprising:

receiving a voice request from a user through the voice-based interface;

acquiring response information corresponding to the voice request;

outputting the response information in an answering voice that is an auditory output form through at least one of a plurality of pieces of media including a main medium corresponding to the voice-based interface and at least one sub medium included in at least one in-house device designed and constructed for use in, and in functioning of, a home or a building, the at least one in-house device being interactable with the electronic device through an internal network communicatively connecting the electronic device with the at least one in-house device;

analyzing the voice request or the response information for at least one information type desired by the user;

selecting at least one sub medium based on the analyzed at least one information type; and

providing another output with respect to at least a portion of the response information through the selected at least one sub medium among the plurality of pieces of media for instructing the at least one in-house device to operate as designed and constructed.

2. The method of claim 1 , wherein the other output is provided in at least one of a visual output form, a tactile output form, and an auditory output form.

3. The method of claim 1 , wherein the other output is provided with respect to information about a variable of an answer template for the answering voice or information to which a semantic tag is assigned in the response information.

4. The method of claim 1 , wherein the other output comprises at least one of grade information, numerical value information, and orientation information as primary information included in the response information.

5. The method of claim 1 , wherein the providing of the other output comprises differently providing at least one of a size, a type, and a pattern of the other output based on at least one of grade information, numerical value information, and orientation information included in the response information.

6. The method of claim 1 , wherein the providing of the other output comprises turning ON a light emitting diode (LED) based on at least one of grade information, numerical value information, and orientation information included in the response information, in response to outputting the answering voice.

7. The method of claim 1 , wherein the providing of the other output comprises synthesizing an additional tone based on at least one of grade information, numerical value information, and orientation information included in the response information, in response to outputting the answering voice.

8. The method of claim 1 , wherein the providing of the other output comprises providing multimedia content associated with the response information in response to outputting the answering voice.

9. The method of claim 1 , wherein the other output is provided through synchronization with an output of the answering voice.

10. A non-transitory computer-readable recording medium storing a program configured to be executed by a computer to implement the method according to claim 1 .

11. The method of claim 1 , wherein the in-house device includes a heater, an air conditioner, a refrigerator, a robot vacuum cleaner, an HVAC system, a door lock, a surveillance camera, or a lighting device.

12. An electronic device comprising:

a voice-based interface; and

at least one processor configured to execute a computer-readable instruction,

wherein the at least one processor is configured to

receive a voice request from a user through the voice-based interface,

acquire response information corresponding to the voice request,

output the response information in an answering voice that is an auditory output form through at least one of a plurality of pieces of media including a main medium corresponding to the voice-based interface and at least one sub medium included in at least one in-house device designed and constructed for use in, and in functioning of, a home or a building, the at least one in-house device being interactable with the electronic device through an internal network communicatively connecting the electronic device with the at least one in-house device,

analyze the voice request or the response information for at least one information type desired by the user,

select at least one sub medium based on the analyzed at least one information type, and

provide another output with respect to at least a portion of the response information through the selected at least one sub medium among the plurality of pieces of media for instructing the at least one in-house device to operate as designed and constructed.

13. The electronic device of claim 12 , wherein the other output is provided in at least one of a visual output form, a tactile output form, and an auditory output form.

14. The electronic device of claim 12 , wherein the other output is provided with respect to information about a variable of an answer template for the answering voice or information to which a semantic tag is assigned in the response information.

15. The electronic device of claim 12 , wherein the other output comprises at least one of grade information, numerical value information, and orientation information as primary information included in the response information.

16. The electronic device of claim 12 , wherein the at least one processor, to provide the other output, is configured to differently provide at least one of a size, a type, and a pattern of the other output based on at least one of grade information, numerical value information, and orientation information included in the response information.

17. The electronic device of claim 12 , wherein the at least one processor is configured to turn ON a light emitting diode (LED) as the other output based on at least one of grade information, numerical value information, and orientation information included in the response information, in response to outputting the answering voice.

18. The electronic device of claim 12 , wherein the at least one processor is configured to synthesize an additional tone as the other output based on at least one of grade information, numerical value information, and orientation information included in the response information, in response to outputting the answering voice.

19. The electronic device of claim 12 , wherein the at least one processor is configured to provide multimedia content associated with the response information as the other output in response to outputting the answering voice.

20. An information providing method performed by an electronic device having a voice-based interface, the method comprising:

receiving a voice request from a user through the voice-based interface;

acquiring response information corresponding to the voice request;

outputting the response information in an answering voice that is an auditory output form through at least one of a plurality of pieces of media including a main medium corresponding to the voice-based interface and at least one sub medium included in another electronic device interactable with the electronic device;

analyzing the voice request to determine an information type of the voice request corresponding to a select subject from a plurality of predetermined subjects;

selecting at least one sub medium including an application for outputting information associated with the determined at least one information type based on the determined information type corresponding to the select subject; and

providing another output with respect to at least a portion of the response information through the application of the selected at least one sub medium included in said another electronic device.

21. The method of claim 20 , wherein the plurality of predetermined subjects includes weather, locations, places, transportations, singers, or movies, and the application includes a map application for providing a map service, a search application for providing a search engine, or a schedule application for providing a schedule management.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067091/0109 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2020
From: SHIN, MYEONGSOO
To: NAVER CORPORATION; LINE CORPORATION
Reel/Frame 051768/0842 →
Priority Claims (1)
KR 10-2017-0063982 · May 24, 2017 · national
Continuity (2)
Continuation PCTKR2018004919 · Apr 27, 2018
Related Publication 20200098367A1 · Mar 26, 2020