IP Library Granted Patent US 11,604,572
Granted Patent B2
US 11,604,572 · App. 16/934,904 · Granted Mar 14, 2023

Multi-screen interaction method and apparatus, and storage medium

Inventors: Jiayi Li (Beijing, CN); Ming Liu (Beijing, CN)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
G06F3/04845G06F3/04817G06F3/1454H04M1/72469
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,604,572
App. No.
16/934,904
Granted
Mar 14, 2023
Kind
B2
Abstract

A multi-screen interaction method includes: a first interface of a second terminal is projected on a display screen of a first terminal; detection is performed on a first operation acting on the first interface; and when the first operation on a first object in the first interface is detected, the first operation on the first object is responded in the first terminal.

Claims (87)

1. A method for multi-screen interaction, implemented by a first terminal, the method comprising:

receiving a projection of a first interface of a second terminal on a display screen of the first terminal;

appending an interface added control adjacent to the first interface;

in response to a first operation on the interface added control of the first interface being detected,

receiving a projection of a second interface of the second terminal on the display screen of the first terminal,

wherein the second interface comprises a desktop of the second terminal,

wherein the method further comprises:

detecting a second operation on a second object on the desktop of the second interface, wherein the second operation comprises dragging the second object from the second interface to a desktop of the first terminal;

based on both the detecting the second operation and determining that the second object is an icon of an application program, receiving, from the second terminal, a projection of a third interface of the application program on the display screen of the first terminal;

concurrently displaying the received projections of the first, second, and third interfaces on the display screen of the first terminal;

detecting a third operation on a third object in the first interface, wherein the third operation comprises dragging the third object from the first interface to the desktop of the first terminal; and

based on both the detecting the third operation and determining that the third object is a file, receiving the file by the first terminal from the second terminal, and storing the file at the first terminal.

2. The method according to claim 1 , further comprising:

detecting an operation on a link address in the first interface; and

opening a page connected to the link address according to the link address.

3. A device set implementing the method according to claim 1 , comprising a plurality of terminals including the first terminal and the second terminal, wherein the first terminal and the second terminal include a mobile phone and a computer, and wherein:

the first terminal is configured to:

receive content shared by the second terminal; and

control the second terminal, thereby simplifying an interactive user operation between the first terminal and the second terminal, and facilitating selecting the first terminal and/or the second terminal based on an operation input by a user to perform corresponding operations;

the second terminal is configured to:

project the first interface to a display screen of the first terminal; and

respond to the first operation detected by the first terminal on the first object in the first interface.

4. The device set according to claim 3 , wherein:

the first terminal is configured to:

open the content in the second terminal, and use tools of the first terminal to edit the content; and

automatically send the edited content without a dragging operation;

the first terminal is a computer, and the second terminal is a mobile phone, wherein the shared content is displayed on a display screen of the computer that is larger than a display screen of the mobile phone, thereby improving user visual experience; and

the computer is configured to respond to the first operation, thereby utilizing hardware processing of the computer that is faster than that of the mobile phone.

5. The device set of claim 3 , wherein

the first interface of the second terminal comprises a message prompt interface, and the interface added control in the first interface comprises a message display control;

a screen projection control interface is displayed on the second terminal and comprises a silence setting control configured to set the second terminal as a silent mode;

when the second terminal is in the silent mode, the second terminal is configured to, in response to the first operation acting on the message display control in the message prompt interface being detected, project a message display interface of the second terminal to the display screen of the first terminal, without making any ringing or vibration to remind a user of a message received at the second terminal; and

the first terminal is configured to receive the message display interface of the second terminal and display the message on the display screen of the first terminal.

6. A method for multi-screen interaction, implemented by a second terminal, the method comprising:

projecting a first interface to a display screen of a first terminal; and

in response to a first operation being detected by the first terminal to act on an interface added control appended adjacent to the first interface, projecting a second interface of the second terminal to the display screen of the first terminal,

wherein the second interface comprises a desktop of the second terminal, and

wherein the method further comprises:

receiving, at the second terminal, a detection of a second operation on a second object on the desktop of the second interface, wherein the second operation comprises dragging the second object from the second interface to a desktop of the first terminal;

in response to both the detecting the second operation and determining that the second object is an icon of an application program, sending, from the second terminal, a projection of a third interface of the application program to the display screen of the first terminal;

concurrently displaying, at the first terminal, the received projections of the first, second, and third interfaces on the display screen of the first terminal;

receiving, at the second terminal, a detection of a third operation on a third object in the first interface, wherein the third operation comprises dragging the third object from the first interface to the desktop of the first terminal; and

in response to both the detecting the third operation and determining that the third object is a file, sending the third object by the second terminal to the first terminal.

7. The method according to claim 6 , further comprising:

receiving an object from the first terminal, wherein the object is sent after the first terminal detects an operation of dragging the object outside the first interface into the first interface; and

saving the object.

8. The method according to claim 6 , further comprising:

detecting an operation on a file in the first interface;

receiving an edited file from the first terminal, the edited file being a file stored in the second terminal and opened in the first terminal; and

saving the edited file.

9. An apparatus for multi-screen interaction, implemented by a first terminal, the apparatus comprising:

a processor; and

memory configured to store instructions executable by the processor,

wherein the processor is configured to:

receive a projection of a first interface of a second terminal on a display screen of the first terminal;

append an interface added control adjacent to the first interface; and

in response to a first operation acting on the interface added control of the first interface being detected, receive a projection of a second interface of the second terminal on the display screen of the first terminal,

wherein the second interface comprises a desktop of the second terminal,

wherein the processor is further configured to:

detect a second operation on a second object on the desktop of the second interface, wherein the second operation comprises dragging the second object from the second interface to a desktop of the first terminal;

based on both the detecting the second operation and determining that the second object is an icon of an application program, receive, from the second terminal, a projection of a third interface of the application program on the display screen of the first terminal;

concurrently display the received projections of the first, second, and third interfaces on the display screen of the first terminal;

detect a third operation on a third object in the first interface, wherein the third operation comprises dragging the third object from the first interface to the desktop of the first terminal; and

based on both the detecting the third operation and determining that the third object is a file, receive the file from the second terminal, and store the file at the first terminal.

10. The apparatus according to claim 9 , wherein the first interface comprises a message prompt interface, and the interface added control comprises a message display control; and

the processor is further configured to, in response to the first operation acting on the message display control in the message prompt interface being detected, receive a projection of a message display interface of the second terminal on the display screen of the first terminal.

11. An apparatus for multi-screen interaction, implemented by a second terminal, the apparatus comprising:

a processor; and

memory configured to store instructions executable by the processor,

wherein the processor is configured to:

project a first interface to a display screen of a first terminal; and

in response to a first operation being detected by the first terminal to act on an interface added control appended adjacent to the first interface, project a second interface of the second terminal to the display screen of the first terminal,

wherein the second interface comprises a desktop of the second terminal,

wherein the processor is further configured to:

receive a detection of a second operation on a second object on the desktop of the second interface, wherein the second operation comprises dragging the second object from the second interface to a desktop of the first terminal;

in response to both the detection of the second operation and a determination that the second object is an icon of an application program, sending, from the second terminal, a projection of a third interface of the application program to the display screen of the first terminal;

send a projection of a third interface of the application program to the display screen of the first terminal, wherein the projections of the first, second, and third interfaces are concurrently displayed on the display screen of the first terminal; and

receive a detection of a third operation on a third object in the first interface, wherein the third operation comprises dragging the third object from the first interface to the desktop of the first terminal; and

in response to both the detection of the third operation and a determination that the third object is a file, sending the third object by the second terminal to the first terminal.

12. The apparatus according to claim 11 , wherein the first interface comprises a message prompt interface, and the interface added control comprises a message display control; and

the processor is further configured to, in response to the first operation being detected by the first terminal to act on the interface display control in the message prompt interface, project a message display interface to the display screen of the first terminal.

13. The apparatus according to claim 11 , wherein the processor is further configured to:

display a screen projection control interface;

detect a fifth operation acting on the screen projection control interface; and

respond to the fifth operation in response to that the fifth operation on a fourth object in the screen projection control interface being detected.

14. The apparatus according to claim 13 , wherein the fourth object comprises a silence setting control; and

the processor is further configured to set the second terminal as a silent mode, in response to the fifth operation on the silence setting control being detected.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2020
From: LI, JIAYI; LIU, MING
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 053270/0939 →
Priority Claims (1)
CN 202010117281.4 · Feb 25, 2020 · national
Continuity (1)
Related Publication 20210263642A1 · Aug 26, 2021
Cited By (1)
US 12,393,328