IP Library Granted Patent US 10,978,068
Granted Patent B2
US 10,978,068 · App. 16/345,491 · Granted Apr 13, 2021

Method and apparatus for executing application on basis of voice commands

Inventors: Sung-jin Kim (Yongin-si, KR); Il-koo Kim (Seongnam-si, KR); Sang-ha Kim (Seoul, KR); Kyoung-jin Moon (Suwon-si, KR); Ji-sang Yu (Seoul, KR); Byung-joon Chang (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L15/22G06F3/0481G06F3/0483G06F3/0484G06F3/16G06F3/167G10L15/26G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,978,068
App. No.
16/345,491
Granted
Apr 13, 2021
Kind
B2
Abstract

A method, performed by an electronic apparatus, of executing an application, based on a voice input of a user, and the electronic apparatus are provided. The method includes performing voice recognition on the voice command for executing the application, determining a target page among a plurality of pages displayable when the application is executed, based on a result of the voice recognition, generating a virtual input sequence for displaying a second screen corresponding to the target page, instead of a first screen currently displayed, and executing the application in response to the virtual input sequence.

Claims (41)

1. A method, performed by an electronic apparatus, of executing an application based on a voice command of a user, the method comprising:

performing voice recognition on the voice command for executing the application;

determining a page for performing an operation corresponding to the voice command as a target page among a plurality of pages displayable when the application is executed, based on a result of the voice recognition;

generating a virtual input sequence for displaying a second screen corresponding to the target page, instead of a first screen currently displayed; and

executing the application in response to the virtual input sequence.

2. The method of claim 1 , wherein the virtual input sequence comprises virtual inputs generated by the electronic apparatus such that the application is executed as if the electronic apparatus received user inputs with respect to the application from the user.

3. The method of claim 1 , further comprising:

determining a version of the application installed in the electronic apparatus, based on at least one of a size, a color of a user interface displayed on the first screen, text, a sign included in the user interface, or metadata related to the user interface; and

obtaining information about the plurality of pages, based on the determined version.

4. The method of claim 1 , further comprising recognizing a first page corresponding to the first screen among the plurality of pages, based on at least one of a size, a color of a user interface displayed on the first screen, text, a sign included in the user interface, or metadata related to the user interface.

5. The method of claim 1 , wherein the generating of the virtual input sequence comprises generating the virtual input sequence for moving from a first page corresponding to the first screen to the target page, within a tree structure of the plurality of pages with respect to the application.

6. The method of claim 1 , wherein the executing of the application comprises:

displaying the second screen corresponding to the target page;

generating a virtual input causing the application to perform the operation corresponding to the voice command; and

executing the application in response to the virtual input.

7. The method of claim 1 , further comprising, while the application is being executed before the voice command is received, storing information about a user input received from the user to move from a first page corresponding to the first screen to the target page,

wherein the generating of the virtual input sequence comprises generating a virtual input corresponding to the user input.

8. A non-transitory computer-readable recording medium having recorded thereon instructions that, when executed by at least one processor, cause the at least one processor to perform the method of claim 1 .

9. An electronic apparatus comprising:

a receiver configured to receive a voice command of a user;

at least one processor configured to:

perform voice recognition on the voice command,

determine a page for performing an operation corresponding to the voice command as a target page among a plurality of pages displayable when an application is executed, based on a result of the voice recognition,

generate a virtual input sequence for displaying a second screen corresponding to the target page, instead of a first screen currently displayed, and

execute the application in response to the virtual input sequence; and

a display displaying the first screen.

10. The electronic apparatus of claim 9 , wherein the virtual input sequence comprises virtual inputs generated by the electronic apparatus such that the application is executed as if the electronic apparatus received user inputs with respect to the application from the user.

11. The electronic apparatus of claim 9 , wherein the at least one processor is further configured to determine a version of the application installed in the electronic apparatus, based on at least one of a size, a color of a user interface displayed on the first screen, text, a sign included in the user interface, or metadata related to the user interface, and obtain information about the plurality of pages, based on the determined version.

12. The electronic apparatus of claim 9 , wherein the at least one processor is further configured to recognize a first page corresponding to the first screen among the plurality of pages, based on at least one of a size, a color of a user interface displayed on the first screen, text, a sign included in the user interface, or metadata related to the user interface.

13. The electronic apparatus of claim 9 , wherein the at least one processor is further configured to generate the virtual input sequence for moving from a first page corresponding to the first screen to the target page, within a tree structure of the plurality of pages with respect to the application.

14. The electronic apparatus of claim 9 , wherein the at least one processor is further configured to:

control the display to display the second screen corresponding to the target page by executing the application in response to the virtual input sequence; and

generate a virtual input causing the application to perform the operation corresponding to the voice command, and execute the application in response to the virtual input.

15. A server communicating with an electronic apparatus, the server comprising:

a receiver configured to receive a voice command of a user input through the electronic apparatus;

at least one processor configured to:

perform voice recognition on the voice command,

determine a page for performing an operation corresponding to the voice command as a target page among a plurality of pages displayable when an application is executed in the electronic apparatus, and

generate a virtual input sequence for controlling the electronic apparatus to display a second screen corresponding to the target page, instead of a first screen currently displayed by the electronic apparatus; and

a transmitter configured to transmit the virtual input sequence to the electronic apparatus,

wherein the electronic apparatus executes the application in response to the virtual input sequence.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: KIM, SUNG-JIN; KIM, IL-KOO; KIM, SANG-HA; MOON, KYOUNG-JIN; YU, JI-SANG; CHANG, BYUNG-JOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 049008/0514 →
Priority Claims (1)
KR 10-2016-0141177 · Oct 27, 2016 · national
Continuity (1)
Related Publication 20190311717A1 · Oct 10, 2019
Cited By (1)
US 12,300,229