IP Library › Granted Patent US 12,019,947
Granted Patent B2
US 12,019,947 · App. 18/254,998 · Granted Jun 25, 2024

Projection method and system

Inventors: Kai Qian (Shenzhen, CN); Weisong Nie (Xi'an, CN); Manjie Wang (Xi'an, CN)
Assignee: Huawei Technologies Co., Ltd.
G06F3/1454G06F3/017G06F3/0485
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,019,947
App. No.
18/254,998
Granted
Jun 25, 2024
Kind
B2
Abstract

Projection methods and systems are disclosed in this disclosure. In an implementation, a method includes: A first device that displays first content, detects a first gesture operation, and recognizes the detected first gesture operation, where the first gesture operation is a continuous and moving gesture operation; a second device detects the first gesture operation, and recognizes the detected first gesture operation, where the second device establishes a communication connection to the first device; if recognizing that the first gesture operation is a projecting gesture, the first device projects, to the second device, the first content displayed by the first device; and if recognizing that the first gesture operation is a projected gesture, the second device receives the first content projected by the first device, and displays the first content on the second device.

Claims (85)

1. A projection method comprising:

displaying, by a first device of a projection system, first content;

detecting, by the first device, a first gesture operation;

identifying, by the first device, the detected first gesture operation, wherein the first gesture operation is a continuous and moving gesture operation;

detecting, by a second device, the first gesture operation;

establishing, by the second device, a communication connection to the first device;

identifying, by the second device, whether the detected first gesture operation is a projected gesture or a projecting gesture;

in response to identifying that the first gesture operation is a projected gesture:

receiving, by the second device, the first content displayed by the first device; and

displaying the first content on the second device; and

in response to identifying that the first gesture operation is a projecting gesture:

sending, by the first device, a handshake request to the second device to establish a communication connection to the second device;

receiving, by the second device, the handshake request sent by the first device;

sending a handshake confirmation message to the first device based on the handshake request to indicate that the communication connection between the first device and the second device is successfully established;

receiving, by the first device, the handshake confirmation message sent by the second device; and

projecting, by the first device to the second device through the communication connection, the first content displayed by the first device.

2. The method according to claim 1 , wherein the projecting, to the second device, the first content displayed by the first device comprises:

moving out, by the first device, the first content from a side of a display screen of the first device in a moving process of the first gesture operation, wherein a proportion of the first content that moves out from the display screen of the first device is associated with a movement distance of the first gesture operation relative to the first device.

3. The method according to claim 1 , wherein the receiving the first content projected by the first device, and displaying the first content on the second device comprises:

moving in, by the second device, the first content from a side of a display screen of the second device in a moving process of the first gesture operation, wherein a proportion of the first content to the display screen of the second device is associated with a movement distance of the first gesture operation relative to the second device.

4. The method according to claim 2 , wherein the moving out, by the first device, the first content from a side of a display screen of the first device in a moving process of the first gesture operation comprises:

determining, by the first device in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the first device; and

determining, by the first device based on the movement distance of the first gesture operation relative to the first device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the first device and a proportion of the first content that moves out from the display screen of the first device, the proportion of the first content that moves out from the display screen of the first device.

5. The method according to claim 3 , wherein the moving in, by the second device, the first content from a side of a display screen of the second device in a moving process of the first gesture operation comprises:

determining, by the second device in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the second device; and

determining, by the second device based on the movement distance of the first gesture operation relative to the second device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the second device and a proportion of the first content that moves in to the display screen of the second device, the proportion of the first content that moves in to the display screen of the second device.

6. The method according to claim 1 , wherein after recognizing the detected first gesture operation, the method further comprises:

sending, by the first device, a recognition result of the first gesture operation to the second device; and

receiving, by the second device, the recognition result of the first gesture operation sent by the first device.

7. The method according to claim 2 , wherein before the moving out the first content from a side of a display screen of the first device, the method further comprises:

determining, by the first device, a movement direction of the first gesture operation; and

determining, by the first device based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the first device, the side of the display screen of the first device and from which the first content is moved out.

8. The method according to claim 3 , wherein before the moving in the first content from a side of a display screen of the second device, the method further comprises:

determining, by the second device, a movement direction of the first gesture operation; and

determining, by the second device based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the second device, the side of the display screen of the second device and from which the first content is moved in.

9. The method according to claim 1 , wherein the projecting, to the second device, the first content displayed by the first device comprises one of:

performing, by the first device, screen recording on the first content displayed by the first device, and sending screen recording data to the second device;

obtaining, by the first device, streaming media data of the first content displayed by the first device, and sending the streaming media data to the second device; or

obtaining, by the first device, content-related information of the first content displayed by the first device, and sending the content-related information to the second device.

10. The method according to claim 1 , wherein the detecting, by the first device, a first gesture operation, and recognizing the detected first gesture operation comprises:

capturing, by the first device by using a photographing assembly, an image comprising the first gesture operation, and performing image analysis on the captured image to obtain a gesture recognition result; and

the detecting, by the second device, the first gesture operation, and recognizing the detected first gesture operation comprises:

capturing, by the second device by using a photographing assembly, an image comprising the first gesture operation, and performing image analysis on the captured image to obtain a gesture recognition result.

11. A projection system, wherein the projection system comprises a first device and a second device;

the first device is configured to:

display first content;

detect a first gesture operation; and

identify the detected first gesture operation, wherein the first gesture operation is a continuous and moving gesture operation;

the second device is configured to:

detect the first gesture operation;

establish a communication connection to the first device;

identify whether the detected first gesture operation is a projected gesture or a projecting gesture, wherein the second device establishes a communication connection to the first device;

in response to identifying that the first gesture operation is a projected gesture, the second device is further configured to:

receive the first content projected by the first device, and display the first content on the second device;

in response to identifying that the first gesture operation is a projecting gesture:

the first device is configured to:

project, to the second device, the first content displayed by the first device; and

send a handshake request to the second device, wherein the handshake request is used to request to establish a communication connection to the second device;

the second device is further configured to:

receive the handshake request sent by the first device, and send a handshake confirmation message to the first device based on the handshake request, wherein the handshake confirmation message indicates that the communication connection between the first device and the second device is successfully established;

the first device is further configured to:

receive the handshake confirmation message sent by the second device; and

project, to the second device through the communication connection, the first content displayed by the first device.

12. The projection system according to claim 11 , wherein

the first device is configured to move out the first content from a side of a display screen of the first device in a moving process of the first gesture operation, wherein a proportion of the first content that moves out from the display screen of the first device is associated with a movement distance of the first gesture operation relative to the first device.

13. The projection system according to claim 11 , wherein

the second device is configured to move in the first content from a side of a display screen of the second device in a moving process of the first gesture operation, wherein a proportion of the first content to the display screen of the second device is associated with a movement distance of the first gesture operation relative to the second device.

14. The projection system according to claim 12 , wherein

the first device is configured to: determine, in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the first device; and determine, based on the movement distance of the first gesture operation relative to the first device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the first device and a proportion of the first content that moves out from the display screen of the first device, the proportion of the first content that moves out from the display screen of the first device.

15. The projection system according to claim 13 , wherein

the second device is configured to: determine, in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the second device; and determine, based on the movement distance of the first gesture operation relative to the second device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the second device and a proportion of the first content that moves in to the display screen of the second device, the proportion of the first content that moves in to the display screen of the second device.

16. The projection system according to claim 11 , wherein

the first device is further configured to send a recognition result of the first gesture operation to the second device; and

the second device is further configured to receive the recognition result of the first gesture operation sent by the first device.

17. The projection system according to claim 12 , wherein

the first device is further configured to: determine a movement direction of the first gesture operation; and determine, based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the first device, the side that is of the display screen of the first device and from which the first content is moved out.

18. The projection system according to claim 13 , wherein

the second device is further configured to: determine a movement direction of the first gesture operation; and determine, based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the second device, the side of the display screen of the second device and from which the first content is moved in.

19. The projection system according to claim 11 , wherein the first device is configured to:

perform screen recording on the first content displayed by the first device, and send screen recording data to the second device;

obtain streaming media data of the first content displayed by the first device, and send the streaming media data to the second device; or

obtain content-related information of the first content displayed by the first device, and send the content-related information to the second device.

20. The projection system according to claim 11 , wherein

the first device is configured to: capture, by using a photographing assembly, an image comprising the first gesture operation, and perform image analysis on the captured image to obtain a gesture recognition result; and

the second device is configured to: capture, by using a photographing assembly, an image comprising the first gesture operation, and perform image analysis on the captured image to obtain a gesture recognition result.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: QIAN, KAI; NIE, WEISONG; WANG, MANJIE
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 066590/0175 →
Priority Claims (1)
CN 202011384624.X · Nov 30, 2020 · national
Continuity (1)
Related Publication 20240004603A1 · Jan 4, 2024