IP Library Granted Patent US 11,720,324
Granted Patent B2
US 11,720,324 · App. 16/960,013 · Granted Aug 8, 2023

Method for displaying electronic document for processing voice command, and electronic device therefor

Inventors: Kyungtae Kim (Suwon-si, KR); Seonho Lee (Suwon-si, KR); Yoonjeong Choi (Suwon-si, KR); Hosung You (Suwon-si, KR); Bunam Jeon (Suwon-si, KR); Taeho Ha (Suwon-si, KR); Changho Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/167G06V30/412G06Q10/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,720,324
App. No.
16/960,013
Granted
Aug 8, 2023
Kind
B2
Abstract

Various embodiments of the present invention relate to an apparatus and a method for displaying an electronic document for processing a user's voice command in an electronic device. The electronic device includes an input device; a display; and a processor, wherein the processor may be configured to detect a voice command of a user using the input device, if outputting an electronic document corresponding to the voice command, identify at least one input field in the electronic document, determine guide information based on information of the at least one input field, and display the electronic document comprising the guide information using the display. Other embodiments may be possible.

Claims (59)

1. An electronic device comprising:

an input device;

a display; and

a processor, wherein the processor is configured to:

obtain, via the input device, a first voice command of a user,

based on output of an electronic document corresponding to the first voice command, identify multiple input fields in the electronic document,

determine a portion of texts representing an attribute of each of the multiple input fields as guide information,

display, via the display, the electronic document comprising the guide information and the multiple input fields, wherein the multiple input fields are activated to allow data to be entered and are displayed in a designated order,

obtain, via the input device, a second voice command of the user,

determine whether a portion of the second voice command matches the guide information,

in response to matching the portion of the second voice command and the guide information, display, via the display, information in the second voice command on at least one input field corresponding to the matched guide information,

obtain, via the input device, a third voice command of the user,

if the third voice command contains a continue command and data, display the data in one of the multiple input fields based on an order modified from the designated order by the continue command, and

if the third voice command contains a silence period exceeding a designated time and data, skip one of the multiple input fields and display the data in a next input field of the multiple input fields.

2. The electronic device of claim 1 , wherein the processor is configured to:

display data in the at least one input field based on at least part of the first voice command using the display, and

if there is a blank input field in the at least one input field, display designated data in the blank input field based on a use history using the display.

3. The electronic device of claim 1 , wherein the guide information of the multiple input fields comprises texts or identification information related to the multiple input fields.

4. The electronic device of claim 3 , wherein the processor is configured to:

extract part of the texts related to the multiple input fields based on a priority, and

determine the extracted part of the texts as part as the guide information.

5. The electronic device of claim 1 , wherein the processor is configured to:

extract guide information corresponding to any one input field of the multiple input fields based on a priority, and

if the extracted guide information overlaps with guide information corresponding to an other input field of the multiple input fields, extract other guide information corresponding to the other input field based on a next priority.

6. The electronic device of claim 1 , wherein the processor is configured to:

extract an additional voice command of the user using the input device,

if part of the additional voice command matches the guide information, display data in an input field corresponding to the matched guide information using the display, and

if the part of the additional voice command does not match the guide information, display a guide message using the display.

7. The electronic device of claim 1 , wherein the processor is configured to apply a graphic effect to the guide information such that the guide information is highlighted relative to at least one object in the electronic document.

8. The electronic device of claim 1 , wherein the processor is configured to:

detect an additional voice command of the user using the input device, and

if detecting a modify command in the additional voice command, change data displayed in the at least one input field based on the modify command.

9. The electronic device of claim 1 , wherein the processor is configured to:

detect an additional voice command of the user using the input device,

display data contained in the additional voice command in the at least one input field corresponding to the additional voice command using the display,

if there is no blank input field in the at least one input field, output additional guide information,

detect a voice command corresponding to the additional guide information, and

execute a function corresponding to the voice command corresponding to the additional guide information.

10. An operating method of an electronic device, comprising:

obtaining, via an input device of the electronic device, a first voice command of a user;

based on output of an electronic document corresponding to the first voice command, identifying multiple input fields in the electronic document;

determining a portion of texts representing an attribute of each of the multiple input fields as guide information;

displaying, via a display of the electronic device, the electronic document comprising the guide information and the multiple input fields, wherein the multiple input fields are activated to allow data to be entered and are displayed in a designated order;

obtaining, via the input device, a second voice command of the user;

determining whether a portion of the second voice command matches the guide information;

in response to matching the portion of the second voice command and the guide information, displaying, via the display, information in the second voice command on at least one input field corresponding to the matched guide information;

obtaining, via the input device, a third voice command of the user;

in response to the third voice command containing a continue command and data, displaying the data in one of the multiple input fields based on an order modified from the designated order by the continue command; and

in response to the third voice command containing a silence period exceeding a designated time and data, skipping one of the multiple input fields and displaying the data in a next input field of the multiple input fields.

11. The method of claim 10 , wherein displaying the electronic document comprises:

displaying data in the at least one input field based on at least part of the first voice command; and

if there is a blank input field in the at least one input field, displaying designated data in the blank input field based on a use history.

12. The method of claim 10 , wherein the guide information of the multiple input fields comprises texts or identification information related to the multiple input fields.

13. The method of claim 12 , wherein determining guide information comprises:

extracting part of the texts related to the multiple input fields based on a priority; and

determining the extracted part of the texts as the guide information.

14. The method of claim 10 , wherein determining guide information comprises:

extracting guide information corresponding to any one input field of the multiple input fields based on a priority; and

if the extracted guide information overlaps with guide information corresponding to an other input field of the multiple input fields, extracting other guide information corresponding to the other input field based on a next priority.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: KIM, KYUNGTAE; LEE, SEONHO; CHOI, YOONJEONG; YOU, HOSUNG; JEON, BUNAM; HA, TAEHO; LEE, CHANGHO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053114/0125 →
Priority Claims (1)
KR 10-2018-0001862 · Jan 5, 2018 · national
Continuity (1)
Related Publication 20210089269A1 · Mar 25, 2021
Cited By (1)
US 12,536,992