IP Library Granted Patent US 11,209,970
Granted Patent B2
US 11,209,970 · App. 16/666,008 · Granted Dec 28, 2021

Method, device, and system for providing an interface based on an interaction with a terminal

Inventors: Kan Xu (Hangzhou, CN); Wei Yao (Beijing, CN)
Assignee: BANMA ZHIXING NETWORK (HONGKONG) CO., LIMITED
G06F3/04847G06F3/04883G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,209,970
App. No.
16/666,008
Granted
Dec 28, 2021
Kind
B2
Abstract

The present application discloses methods, devices, and a system for an interaction between a terminal and a user. A method includes obtaining, by one or more processors, a first input, the first input being input via a first interaction mode, providing, by the one or more processors, an interface, the interface being displayed based at least in part on the first input, obtaining, by the one or more processors, a second input, the second input being input via a second interaction mode, the second interaction mode being different from the first interaction mode, and performing, by the one or more processors, a function corresponding to the interface, the function being based at least in part on one or more of the first input, the first interaction mode, the second input, and the second interaction mode.

Claims (51)

1. A method, comprising:

obtaining, by one or more processors, a first input, the first input being input via a first interaction mode;

providing, by the one or more processors, an interface on a display of a terminal, wherein:

a type of interface is provided based at least in part on the first input;

a target location of the display of the terminal at which the interface is provided is determined based at least in part on a location of a user relative to the terminal; and

the interface is provided based at least in part on the type of the interface and the target location;

obtaining, by the one or more processors, a second input, the second input being input via a second interaction mode, the second interaction mode being different from the first interaction mode; and

performing, by the one or more processors, a function corresponding to the interface, the function being based at least in part on one or more of the first input, the first interaction mode, the second input, and the second interaction mode.

2. The method of claim 1 , wherein the target position is determined based at least in part on a position of a user in relation to a terminal when the first input is input to the terminal.

3. The method of claim 1 , wherein the first interaction mode is a voice interaction mode, and the second interaction mode is a gesture interaction mode or a touch interaction mode; or

the first interaction mode is the touch interaction mode, and the second interaction mode is the gesture interaction mode or the voice interaction mode; or

the first interaction mode is the gesture interaction mode, and the second interaction mode is the touch interaction mode or the voice interaction mode.

4. The method of claim 1 , wherein the first interaction mode is a voice interaction mode, the first input is a voice command, and the voice command indicates the function to be invoked in connection with the second input.

5. The method of claim 4 , wherein the second interaction mode is determined to be a touch interaction mode in response to a determination that a touch input is input to a touchscreen of a terminal.

6. The method of claim 4 , wherein the second interaction mode is determined to be a gesture interaction mode in response to a determination that a gesture is input before a touch input is input to a touchscreen of a terminal.

7. The method of claim 1 , wherein the interface is provided at a target position, the target position is determined based at least in part on a position of a user in relation to a terminal at a time at which the first input is input to the terminal, and the position of the user in relation to the terminal corresponds to a position of a hand of the user.

8. The method of claim 1 , wherein the interface comprises: a widget, the widget including a control element, and the control element is configured to respond to a slide event.

9. The method of claim 8 , wherein a position of the control element matches a position of a hand of a user.

10. The method of claim 1 , wherein the interface comprises: function information.

11. The method of claim 10 , wherein the second interaction mode is a gesture interaction mode, and the performing the function corresponding to the interface comprises:

in response to a determination that the second input corresponds to a function-selecting gesture, executing a target function corresponding to the function-selecting gesture.

12. The method of claim 11 , wherein a position at which the function information is displayed is mapped to an orientation of the function-selecting gesture.

13. The method of claim 1 , further comprising:

stopping the display of the interface in response to a determination that a third input satisfies one or more predefined conditions.

14. A device, comprising:

one or more processors configured to:

obtain a first input, the first input being input via a first interaction mode;

provide an interface on a display of the device, wherein:

a type of interface is provided based at least in part on the first input;

a target location of the display of a terminal at which the interface is provided is determined based at least in part on a location of a user relative to the terminal; and

the interface is provided based at least in part on the type of the interface and the target location;

obtain a second input, the second input being input via a second interaction mode, the second interaction mode being different from the first interaction mode; and

perform a function corresponding to the interface, the function being based at least in part on one or more of the first input, the first interaction mode, the second input, and the second interaction mode; and

one or more memories coupled to the one or more processors, configured to provide the one or more processors with instructions.

15. The device of claim 14 , wherein the target position is determined based at least in part on a position of a user in relation to the device at a time at which the first input is input to the device.

16. The device of claim 14 , wherein the first interaction mode is a voice interaction mode, and the second interaction mode is a gesture interaction mode or a touch interaction mode; or

the first interaction mode is the touch interaction mode, and the second interaction mode is the gesture interaction mode or the voice interaction mode; or

the first interaction mode is the gesture interaction mode, and the second interaction mode is the touch interaction mode or the voice interaction mode.

17. The device of claim 14 , wherein the first interaction mode indicates the function to be invoked in connection with the second input.

18. The device of claim 17 , further comprising a touchscreen, wherein:

the second interaction mode is determined to be a touch interaction mode in response to a determination that a touch input is input to the touchscreen; or

the second interaction mode is determined to be a gesture interaction mode in response to a determination that a gesture is input before a touch input is input to the touchscreen.

19. The device of claim 14 , wherein the interface comprises: a widget, the widget including a control element, and the control element is configured to respond to a slide event, and a position of the control element matches a position of a hand of a user.

20. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

obtaining, by one or more processors, a first input, the first input being input via a first interaction mode;

providing, by the one or more processors, an interface on a display of a terminal, wherein:

a type of interface is displayed based at least in part on the first input;

a target location of the display of the terminal at which the interface is provided is determined based at least in part on a location of a user relative to the terminal; and

the interface is provided based at least in part on the type of the interface and the target location;

obtaining, by the one or more processors, a second input, the second input being input via a second interaction mode, the second interaction mode being different from the first interaction mode; and

performing, by the one or more processors, a function corresponding to the interface, the function being based at least in part on one or more of the first input, the first interaction mode, the second input, and the second interaction mode.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: BANMA ZHIXING NETWORK (HONGKONG) CO., LIMITED
Reel/Frame 054384/0014 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2020
From: XU, KAN; YAO, WEI
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 051566/0801 →
Priority Claims (1)
CN 201811280800.8 · Oct 30, 2018 · national
Continuity (1)
Related Publication 20200167064A1 · May 28, 2020