IP Library Granted Patent US 11,068,156
Granted Patent B2
US 11,068,156 · App. 16/000,666 · Granted Jul 20, 2021

Data processing method, apparatus, and smart terminal

Inventors: Ying Xian (Beijing, CN); Huan Zeng (Beijing, CN); Kezheng Liao (Beijing, CN)
Assignee: BANMA ZHIXING NETWORK (HONGKONG) CO., LIMITED
G06F3/04883G06F3/017G06F3/0482G06F3/0488G06F3/04817G06F3/04847G06F3/167G06F9/453H04M1/2746H04M1/27475H04M1/72403G06F9/44505G06F2203/0381H04M2250/22H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,068,156
App. No.
16/000,666
Granted
Jul 20, 2021
Kind
B2
Abstract

Embodiments of the present application relate to a method, device, and system for processing data. The method includes displaying, by one or more processors associated with a terminal, a system control, the system control comprising one or more interface elements associated with a current context of the terminal, and a screen of the terminal displays the system control and at least part of an interface for a current application; receiving, by the one or more processors associated with the terminal, an input to the system control; determining an operating instruction based at least in part on the input to the system control; and performing, by the one or more processors associated with the terminal, one or more operations based at least in part on the operating instruction.

Claims (105)

1. A method, comprising:

receiving, by one or more processors associated with a terminal, one or more user inputs to the terminal while a user is operating a current application;

determining, by the one or more processors associated with the terminal, that the user requires assistance via a system control while the user is operating the current application based at least in part on a manner by which the user interacts with the current application, wherein:

the manner by which the user interacts with the current application is based at least in part on the one or more user inputs to the terminal while the user is operating the current application;

a determination that the user requires assistance via the system control is performed without the user actively requesting invocation of the system control;

the determination that the user requires assistance via the system control is determined by a background process using the one or more user inputs while the user is operating the current application, wherein the background process runs at a level of an operating system, and the operating system runs on the terminal running on the terminal; and

the determination that the user requires assistance via the system control is based at least in part on: one or more user interactions with the current applicaiton while the user is operating the terminal, and a one or more previously stored user interactions with applications or application types;

in response to the determination that the user requires assistance via the system control, providing, by the one or more processors associated with the terminal, the system control and at least a part of an interface of the current application to be displayed by a screen, wherein:

the system control is displayed as an overlay to the current application currently running on the terminal;

the system control is a function of the operating system of the terminal; and

the system control comprises one or more interface elements associated with a current context of the terminal;

receiving, by the one or more processors associated with the terminal, an input to an interface element of the system control;

determining an operating instruction based at least in part on the input to the interface element of the system control; and

performing, by the one or more processors associated with the terminal, one or more operations based at least in part on the operating instruction to execute one or more corresponding functions of the operating system of the terminal.

2. The method of claim 1 , further comprising:

determining the one or more interface elements associated with the current context, comprising:

obtaining interface information of the current application or application package name of the current application; and

determining the one or more interface elements based at least in part on the application package name, the interface information, or both.

3. The method of claim 1 , wherein the providing the system control comprises:

customizing a system control display interface based at least in part on at least one of the one or more interface elements;

invoking a floating window with an application interface of the current application as a background; and

providing the system control display interface in the floating window.

4. The method of claim 1 , wherein the determining the operating instruction comprises:

obtaining the operating instruction based at least in part on a triggering of at least one of the one or more interface elements of the system control.

5. The method of claim 1 , wherein the one or more interface elements comprise at least one information tag and at least one function button.

6. The method of claim 5 , wherein the at least one function button comprises a voice input button, and the determining the operating instruction comprises:

obtaining speech signals in response to a triggering of the voice input button;

determining text data based at least in part on the speech signals; and

generating the operating instruction based at least in part on the text data.

7. The method of claim 1 , wherein performing the one or more operations based at least in part on the operating instruction comprises:

determining a processing entity for the operating instruction; and

issuing the operating instruction to the processing entity for processing, wherein the processing entity comprises: the current application or the system control.

8. The method of claim 7 , wherein the determining the processing entity for the operating instruction comprises:

determining whether the current application is capable of processing the operating instruction;

in response to determining that the current application is capable of processing the operating instruction, determining the current application to be the processing entity; and

in response to determining that the current application is not capable of processing the operating instruction, determining the system control to be the processing entity.

9. The method of claim 7 , further comprising:

in response to issuing the operating instruction to the processing entity wherein the processing entity corresponds to the system control, going to a main page corresponding to the system control to process the operating instruction; and

exiting the system control.

10. The method of claim 7 , further comprising:

in response to issuing the operating instruction to the processing entity wherein the processing entity corresponds to the system control, the system control determining a target application corresponding to the operating instruction; and

launching the target application and exiting the system control.

11. The method of claim 1 , wherein the displaying the system control comprises:

displaying the system control upon receiving a target input.

12. The method of claim 11 , wherein the target input comprises: active-start input and passive-start input.

13. The method of claim 12 , wherein the passive-start input comprises an upward sliding gesture, a clicking of a floating action button, a shaking operation, or a touchscreen double-tap operation.

14. The method of claim 13 , wherein:

the receiving the one or more user inputs to the terminal while the user is operating the current application comprises:

obtaining touchscreen sliding information; and

the determining that the user require assistance via the system control comprises:

determining whether the target input corresponds to an upward sliding gesture based at least in part on the touchscreen sliding information.

15. The method of claim 14 , wherein the sliding information comprises sliding distance and sliding direction.

16. The method of claim 15 , wherein the determining whether the target input corresponds to the upward sliding gesture based at least in part on the sliding information comprises:

determining whether the sliding direction is an upward sliding movement starting at the base;

in response to determining that the sliding direction is the upward sliding movement starting at the base, determining whether the sliding distance is at least a target distance; and

in response to determining that the sliding distance is at least the target distance, determining that the target input corresponds to an upward sliding gesture.

17. The method of claim 16 , wherein the sliding information further comprises:

a sliding time; and

in response to determining that the sliding direction is the upward sliding movement starting at the base, determining whether the sliding time is within a target time range.

18. The method of claim 12 , wherein the active-start input comprises: at least one sliding input.

19. The method of claim 18 , further comprising:

obtaining touchscreen sliding information for an input to the terminal, wherein the touchscreen sliding information comprises sliding direction and a sliding time;

determining a target sliding operation based at least in part on the sliding direction;

determining whether the sliding time is greater than a predetermined time;

in response to determining the sliding time of the target sliding operation is greater than the predetermined time, recording as sliding input of the target sliding operation;

determining whether a number of attempts corresponding to the sliding input of the target sliding operation is greater than a validity threshold value; and

in response to determining that the number of attempts corresponding to the sliding input of the target sliding operation is greater than the validity threshold value, determining that the sliding input corresponds to the active-start input.

20. The method of claim 1 , wherein the one or more interface elements comprise at least one information tag and at least one function button, and if the current context is a contact directory application, the at least one information tag comprises at least one of the following: frequently-used contact tag, recently-called contact tag, and contact group tag; and the at least one function button comprises: a voice input button.

21. The method of claim 1 , wherein the one or more interface elements comprise at least one information tag and at least one function button, and if the current context is a photo album application, the at least one information tag comprises at least one of the following: screenshot tag, recent photo tag, specific ranking tag, and marked tag; and the at least one function button comprises: a voice input button.

22. The method of claim 1 , wherein the one or more interface elements comprise at least one information tag and at least one function button, and if the current context is a system desktop, the at least one information tag comprises at least one of the following: entry point tag for recommended application and entry point tag for most frequently-used app; and the at least one function button comprises: a voice input button.

23. The method of claim 1 , wherein the one or more interface elements comprise at least one information tag and at least one function button, and if the current context is system settings, the at least one information tag comprises at least one of the following: entry point tag for recommended settings and entry point tag for most frequently-changed settings; and the at least one function button comprises: a voice input button.

24. The method of claim 1 , wherein the one or more interface elements are separate from the interface of the current application.

25. A terminal, comprising:

a display;

one or more processors configured to:

receive one or more user inputs to the terminal while a user is operating a current application;

determine that the user requires assistance via a system control while the user is operating the current application based at least in part on a manner by which the user interacts with the current application, wherein:

the manner by which the user interacts with the current application is based at least in part on the one or more user inputs to the terminal while the user is operating the current application;

a determination that the user requires assistance via the system control is performed without the user actively requesting invocation of the system control;

the determination that the user requires assistance via the system control is determined by a background process using the one or more user inputs while the user is operating the current application, wherein the background process runs at a level of an operating system, and the operating system runs on the terminal running on the terminal; and

the determination that the user requires assistance via the system control is based at least in part on: one or more user interactions with the current application while the user is operating the terminal, and one or more previously stored user interactions with applications or application types;

in response to the determination that the user requires assistance via the system control, provide the system control and at least a part of an interface of the current application to be displayed by a screen, wherein:

the system control is displayed as an overlay to the current application currently running on the terminal;

the system control is a function of the operating system of the terminal; and

the system control comprises one or more interface elements associated with a current context of the terminal;

receive an input to an interface element of the system control;

determine an operating instruction based at least in part on the input to the interface element of the system control; and

perform one or more operations based at least in part on the operating instruction to execute one or more corresponding functions of the operating system of the terminal; and

one or more memories coupled to the one or more processors, configured to provide the one or more processors with instructions.

26. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving, by one or more processors associated with a terminal, one or more user inputs to the terminal while a user is operating a current application;

determining, by the one or more processors associated with the terminal, that the user requires assistance via a system control while the user is operating the current application based at least in part on a manner by which the user interacts with the current application, wherein:

the manner by which the user interacts with the current application is based at least in part on the one or more user inputs to the terminal while the user is operating the current application; and

a determination that the user requires assistance via the system control is performed without the user actively requesting invocation of the system control;

the determination that the user requires assistance via the system control is determined by a background process using the one or more user inputs while the user is operating the current application, wherein the background process runs at a level of an operating system, and the operating system runs on the terminal running on the terminal; and

the determination that the user requires assistance via the system control is based at least in part on: one or more user interactions with the current application while the user is operating the terminal, and one or more previously stored user interactions with applications or application types;

in response to the determination that the user requires assistance via the system control, providing, by the one or more processors associated with the terminal, the system control and at least a part of an interface of the current application to be displayed by a screen, wherein:

the system control is displayed as an overlay to the current application currently running on the terminal;

the system control is a function of the operating system of the terminal; and

the system control comprises one or more interface elements associated with a current context of the terminal;

receiving, by the one or more processors associated with the terminal, an input to an interface element of the system control;

determining an operating instruction based at least in part on the input to the interface element of the system control; and

performing, by the one or more processors associated with the terminal, one or more operations based at least in part on the operating instruction to execute one or more corresponding functions of the operating system of the terminal.

27. The method of claim 1 , wherein the system control is displayed as the overlay to the current application based at least in part by invoking a floating window in which to provide the system control, and providing an interface for the current application in a background of the floating window.

28. The method of claim 1 , wherein the system control is a background process of the operating system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: BANMA ZHIXING NETWORK (HONGKONG) CO., LIMITED
Reel/Frame 054384/0014 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2019
From: XIAN, YING; ZENG, HUAN; LIAO, KEZHENG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 049070/0996 →
Priority Claims (1)
CN 201510906659.8 · Dec 9, 2015 · national
Continuity (2)
Continuation In Part PCTCN2016107594 · Nov 29, 2016
Related Publication 20190079665A1 · Mar 14, 2019