Multi-screen interaction method and apparatus, terminal device, and vehicle
View Patent ↗A multi-screen interaction method includes, after detecting a specific gesture, content displayed on a first display is converted into a sub-image, and an identifier of another display capable of displaying the sub-image and orientation information relative to the first display are displayed on the first display, so that a user can intuitively see a movement direction of a subsequent gesture. Then, a second display is determined based on a movement direction of the specific gesture, and the sub-image is controlled to move as the specific gesture moves on the first display. When detecting that a movement distance of the specific gesture is greater than a specified threshold, the sub-image moves to the second display. Therefore, a multi-screen interaction function is implemented.
1 . A method, comprising:
obtaining sensing information, wherein the sensing information comprises gesture information;
triggering, based on the gesture information, a first display to display a first interface image, wherein the first interface image comprises a sub-image and position information, wherein a movement trend of the sub-image is associated with the gesture information, and wherein the position information comprises:
an identifier of at least one other display capable of displaying the sub-image; and
orientation information of the at least one other display relative to the first display; and
triggering, based on the movement trend, the sub-image to be displayed on a second display.
2 . The method of claim 1 , wherein when the gesture information comprises a five-finger capture gesture, the sub-image comprises all of the first interface image.
3 . The method of claim 1 , wherein when the gesture information comprises a two-finger capture gesture, the sub-image comprises an interface presented by a first application in the first interface image.
4 . The method of claim 1 , wherein before triggering the sub-image to be displayed on the second display, the method further comprises setting attributes of the second display based on first position information, second position information, and stored orientation information of the at least one other display relative to the first display, wherein the first position information is of a first gesture of the gesture information, wherein the second position information is of a second gesture at a current moment, and wherein the at least one other display comprises the second display.
5 . The method of claim 4 , wherein setting the attributes of the second display comprises:
determining, based on the first position information and the second position information, first orientation information of the second position information relative to the first position information;
comparing the first orientation information with the stored orientation information; and
determining, when the first orientation information is the same as second orientation information of the second display relative to the first display, the second display.
6 . The method of claim 4 , wherein triggering the sub-image to be displayed on the second display comprises triggering, when detecting that a distance between the first position information and the second position information is greater than a specified threshold, the sub-image to be displayed on the second display.
7 . The method of claim 1 , wherein when the sub-image is an application icon, triggering the sub-image to be displayed on the second display comprises triggering an image indicated by the sub-image to be displayed on the second display.
8 . The method of claim 1 , wherein a size of the sub-image is less than a size of the first display.
9 . The method of claim 1 , further comprising displaying the position information on an edge position of the first display.
10 . An apparatus, comprising:
a sensor configured to obtain sensing information, wherein the sensing information comprises gesture information; and
a processor coupled to the sensor and configured to:
trigger, based on the gesture information, a first display to display a first interface image, wherein the first interface image comprises a sub-image and position information, wherein a movement trend of the sub-image is associated with the gesture information, and wherein the position information comprises:
an identifier of at least one other display capable of displaying the sub-image; and
orientation information of the at least one other display relative to the first display; and
trigger, based on the movement trend, the sub-image to be displayed on a second display.
11 . The apparatus of claim 10 , wherein when the sub-image is an application icon, the processor is further configured to trigger an image indicated by the sub-image to be displayed on the second display.
12 . The apparatus of claim 10 , wherein a size of the sub-image is less than a size of the first display.
13 . The apparatus of claim 10 , wherein the processor is further configured to display position information on an edge position of the first display.
14 . A vehicle, comprising:
a first display;
a second display;
at least one memory configured to store instructions; and
one or more processors coupled to the at least one memory and configured to execute the instructions to cause the vehicle to:
obtain sensing information, wherein the sensing information comprises gesture information;
trigger, based on the gesture information, the first display to display a first interface image, wherein the first interface image comprises a sub-image and position information, wherein a movement trend of the sub-image is associated with the gesture information, and wherein the position information comprises:
an identifier of at least one other display capable of displaying the sub-image; and
orientation information of the at least one other display relative to the first display; and
trigger, based on the movement trend, the sub-image to be displayed on the second display.
15 . A computer program product comprising instructions that are stored on a computer-readable storage medium and that, when executed by a processor, cause an apparatus to:
obtain sensing information, wherein the sensing information comprises gesture information;
trigger, based on the gesture information, a first display to display a first interface image, wherein the first interface image comprises a sub-image and position information, wherein a movement trend of the sub-image is associated with the gesture information, and wherein the position information comprises:
an identifier of at least one other display capable of displaying the sub-image; and
orientation information of the at least one other display relative to the first display; and
trigger the sub-image to be displayed on a second display.
16 . The computer program product of claim 15 , wherein when the sub-image is an application icon, the instructions, when executed by the processor, cause the apparatus to trigger the sub-image to be displayed on the second display by triggering an image indicated by the sub-image to be displayed on the second display, wherein a size of the sub-image is less than a size of the first display, and wherein the position information is displayed on an edge position of the first display.
17 . The apparatus of claim 10 , wherein when the gesture information comprises a five-finger capture gesture, the sub-image comprises all of the first interface image, wherein when the gesture information comprises a two-finger capture gesture, the sub-image comprises an interface presented by a first application in the first interface image.
18 . The apparatus of claim 10 , wherein before triggering the sub-image to be displayed on the second display, the processor is further configured to set attributes of the second display based on first position information, second position information, and stored orientation information of the at least one other display relative to the first display, wherein the first position information is of a first gesture of the gesture information, wherein the second position information is of a second gesture at a current moment, and wherein the at least one other display comprises the second display.
19 . The apparatus of claim 18 , wherein the processor is further configured to set the attributes of the second display by:
determining, based on the first position information and the second position information, first orientation information of the second position information relative to the first position information;
comparing the first orientation information with the stored orientation information; and
determining, when the first orientation information is the same as second orientation information of the second display relative to the first display, the second display.
20 . The apparatus of claim 18 , wherein the processor is further configured to trigger the sub-image to be displayed on the second display by triggering, when detecting that a distance between the first position information and the second position information is greater than a specified threshold, the sub-image to be displayed on the second display.