IP Library Granted Patent US 11,221,822
Granted Patent B2
US 11,221,822 · App. 15/857,025 · Granted Jan 11, 2022

Method and apparatus for controlling page

Inventors: Yan Zhang (Beijing, CN); Binyuan Du (Beijing, CN); Fei Wang (Beijing, CN); Jing Li (Beijing, CN); Gaofei Cheng (Beijing, CN)
Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
G06F3/167G10L15/22G10L15/26G10L15/30G10L25/51G06F40/14G10L15/187G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,221,822
App. No.
15/857,025
Granted
Jan 11, 2022
Kind
B2
Abstract

Embodiments of the present disclosure disclose a method and apparatus for controlling a page. A specific embodiment of the method comprises: receiving voice information from a terminal and element information of at least one element in a displayed page; performing voice recognition on the voice information to acquire a voice recognition result, in response to determining the voice information being used for controlling the displayed page; matching the voice recognition result with the element content information of the at least one element; and generating page control information in response to determining successfully matching the voice recognition result with the element content information of the at least one element, and sending the page control information to the terminal to allow the terminal to control the displayed page based on the page control information.

Claims (62)

1. A method for controlling a page, comprising:

receiving, by a server, voice information and element information of at least one element in a displayed page simultaneously from a terminal, the displayed page being a page displayed on a screen of the terminal when the voice information is sent by the terminal, the element information comprising an element identifier, element content information, position information of an element on the displayed page, and a version number of an application corresponding to the displayed page;

performing, by the server, voice recognition on the voice information to acquire a voice recognition result, in response to determining the voice information being used for controlling the displayed page;

matching, by the server, the voice recognition result with the element content information of the at least one element in the displayed page; and

generating, by the server, page control information based on at least the element information in response to determining successfully matching the voice recognition result with the element content information of the at least one element, and sending, by the server, the page control information to the terminal to allow the terminal to control the displayed page based on the page control information, the page control information comprising a click operation for the element with matched element content information in the displayed page, an element identifier of the element with the matched element content information and position information of the element with the matched element content information on the displayed page,

wherein the element information of the at least one element is stored in a tree structure in the terminal, and

the matching the voice recognition result with the element content information of the at least one element comprises:

traversing each subnode of the tree structure; and

matching the element content information of the element represented by the each subnode and the voice recognition result.

2. The method according to claim 1 , wherein the matching the voice recognition result with the element content information of the at least one element comprises:

calculating, for element content information of each element among the at least one element, a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity.

3. The method according to claim 2 , wherein the calculating a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity comprises:

calculating a first edit distance between the voice recognition result and the element content information of the element;

determining whether the first edit distance is greater than a preset first threshold; and

determining the successfully matching the voice recognition result with the element content information of the element in response to determining the first edit distance being not greater than the first threshold.

4. The method according to claim 3 , wherein the calculating a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity further comprises:

calculating a second edit distance between a pronunciation corresponding to the voice recognition result and a pronunciation corresponding to the element content information of the element in response to determining the first edit distance being greater than the first threshold;

determining whether the second edit distance is greater than a preset second threshold;

determining the successfully matching the voice recognition result with the element in response to determining the second edit distance being not greater than the second threshold; and

determining unsuccessfully matching the voice recognition result with the element in response to determining the second edit distance being greater than the second threshold.

5. A method for controlling a page, applied to a terminal, comprising:

sending, in response to receiving voice information from a user, the voice information and element information of at least one element in a displayed page simultaneously to a server, the displayed page being a page displayed on a screen of the terminal, the element information comprising an element identifier, element content information, position information of an element on the displayed page, and a version number of an application corresponding to the displayed page;

receiving page control information from the server, the page control information being generated by the server based on at least the element information after the server determines the voice information being used for controlling the displayed page and a voice recognition result of the voice information matching the element content information of the at least one element in the displayed page, the page control information comprising a click operation for the element with matched element content information in the displayed page, an element identifier of the element with the matched element content information and position information of the element with the matched element content information on the displayed page; and

determining a position of the element with the matched element content information on the displayed page based on the element identifier of the element with the matched element content information and the position information of the element with the matched element content information, and executing the click operation in the determined position,

wherein the element information of the at least one element is stored in a tree structure in the terminal,

wherein the server matches the voice recognition result with the element content information of the at least one element by:

traversing each subnode of the tree structure; and

matching the element content information of the element represented by the each subnode and the voice recognition result.

6. An apparatus of a server for controlling a page, comprising:

at least one processor; and

a memory storing instructions, which when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

receiving voice information and element information of at least one element in a displayed page simultaneously from a terminal, the displayed page being a page displayed on a screen of the terminal when the voice information is sent by the terminal, the element information comprising an element identifier, element content information, position information of an element on the displayed page, and a version number of an application corresponding to the displayed page;

performing voice recognition on the voice information to acquire a voice recognition result, in response to determining the voice information being used for controlling the displayed page;

matching the voice recognition result with the element content information of the at least one element in the displayed page; and

generating page control information based on at least the element information in response to determining successfully matching the voice recognition result with the element content information of the at least one element, and sending the page control information to the terminal to allow the terminal to control the displayed page based on the page control information, the page control information comprising a click operation for the element with matched element content information in the displayed page, an element identifier of the element with the matched element content information and position information of the element with the matched element content information on the displayed page,

wherein the element information of the at least one element is stored in a tree structure in the terminal, and

the matching the voice recognition result with the element content information of the at least one element comprises:

traversing each subnode of the tree structure; and

matching the element content information of the element represented by the each subnode and the voice recognition result.

7. The apparatus according to claim 6 , wherein the matching the voice recognition result with the element content information of the at least one element comprises:

calculating, for element content information of each element among the at least one element, a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity.

8. The apparatus according to claim 7 , wherein the calculating a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity comprises:

calculating a first edit distance between the voice recognition result and the element content information of the element;

determining whether the first edit distance is greater than a preset first threshold; and

determining the successfully matching the voice recognition result with the element content information of the element in response to determining the first edit distance being not greater than the first threshold.

9. The apparatus according to claim 8 , wherein the calculating a similarity between the voice recognition result and the element content information of the element, and determining successfully matching of the voice recognition result with the element based on the calculated similarity further comprises:

calculating a second edit distance between a pronunciation corresponding to the voice recognition result and a pronunciation corresponding to the element content information of the element in response to determining the first edit distance being greater than the first threshold;

determining whether the second edit distance is greater than a preset second threshold;

determining the successfully matching the voice recognition result with the element in response to determining the second edit distance being not greater than the second threshold; and

determining unsuccessfully matching the voice recognition result with the element in response to determining the second edit distance being greater than the second threshold.

10. An apparatus for controlling a page, comprising:

at least one processor; and

a memory storing instructions, which when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

sending, in response to receiving voice information from a user, the voice information and element information of at least one element in a displayed page simultaneously to a server, the displayed page being a page displayed on a screen of a terminal, the element information comprising an element identifier, element content information, position information of an element on the displayed page, and a version number of an application corresponding to the displayed page;

receiving page control information from the server, the page control information being generated by the server based on at least the element information after the server determines the voice information being used for controlling the displayed page and a voice recognition result of the voice information matching the element content information of the at least one element, the page control information comprising a click operation for the element with matched element content information in the displayed page, an element identifier of the element with the matched element content information and position information of the element with the matched element content information on the displayed page; and

determining a position of the element with the matched element content information on the displayed page based on the element identifier of the element with the matched element content information, and executing the click operation in the determined position and the position information of the element with the matched element content information,

wherein the element information of the at least one element is stored in a tree structure in the terminal,

wherein the server matches the voice recognition result with the element content information of the at least one element by:

traversing each subnode of the tree structure; and

matching the element content information of the element represented by the each subnode and the voice recognition result.

11. A computer readable storage medium storing a computer program, wherein the program, when executed by a processor, cause the processor to perform the method according to claim 1 .

12. A computer readable storage medium storing a computer program, wherein the program, when executed by a processor, cause the processor to perform the method according to claim 5 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.; SHANGHAI XIAODU TECHNOLOGY CO. LTD.
Reel/Frame 056811/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2017
From: ZHANG, YAN; DU, BINYUAN; WANG, FEI; LI, JING; CHENG, GAOFEI
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 044995/0665 →
Priority Claims (1)
CN 201711126816.9 · Nov 15, 2017 · national
Continuity (1)
Related Publication 20190147861A1 · May 16, 2019