IP Library Granted Patent US 12,079,647
Granted Patent B2
US 12,079,647 · App. 18/184,204 · Granted Sep 3, 2024

Encoding scheduling method, server, client, and system for acquiring remote desktop

Inventors: Xianghong Jia (Hangzhou, CN); Hongbo Min (Hangzhou, CN); Xiang Hu (Hangzhou, CN)
Assignee: Alibaba Group Holding Limited
G06F9/452G06F3/1454
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,079,647
App. No.
18/184,204
Granted
Sep 3, 2024
Kind
B2
Abstract

An encoding scheduling method, a server, a client, and a system for acquiring a remote desktop are provided. An encoding scheduling method includes: determining, by a server, encoding requirement information of an encoding task according to information reflecting a remote desktop creation requirement; and calling hardware encoding resources according to the encoding requirement information of the encoding task, to implement encoding of the encoding task.

Claims (66)

1. An encoding scheduling method, comprising:

determining, by a server, encoding requirement information of an encoding task according to information reflecting a remote desktop creation requirement, wherein the information reflecting the remote desktop creation requirement comprises remote desktop image quality requirement information comprising user interface elements information used for representing text information and image information comprised in image frames; and

calling hardware encoding resources according to the encoding requirement information of the encoding task, to implement encoding of the encoding task;

wherein operations of determining the encoding requirement information of the encoding task comprise:

in a case that the user interface elements information indicates that a proportion of image information in a current image frame is greater than a preset first threshold, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be reducing the hardware encoding resources.

2. The encoding scheduling method of claim 1 , wherein the information reflecting the remote desktop creation requirement further comprises any one or a combination of the following: information of a client initiating remote desktop creation, and network transmission quality information.

3. The encoding scheduling method of claim 2 , wherein the remote desktop image quality requirement information further comprises:

updated region information used for representing a region in which information update occurs obtained by comparing an image frame transmitted later with an adjacent image frame transmitted earlier.

4. The encoding scheduling method of claim 3 , wherein the determining the encoding requirement information of the encoding task comprises:

in a case that the updated region information indicates that information update occurs in a partial region when the current image frame is compared with a previous image frame, determining the hardware encoding resource requirement information in the encoding requirement information of the encoding task to be calling the hardware encoding resources according to the updated region information.

5. The encoding scheduling method of claim 2 , wherein the information of the client initiating remote desktop creation comprises any one or a combination of the following:

application information used for determining whether an application is a popular application;

user configuration information used for displaying a priority of a user; and

user event information used for representing a user event of the client.

6. The encoding scheduling method of claim 5 , wherein the determining the encoding requirement information of the encoding task comprises:

in a case that the application information indicates that the application is a popular application, determining the encoding requirement information of the encoding task to be raising the priority;

in a case that the user configuration information indicates that the user is a higher-priority user, determining the encoding requirement information of the encoding task is a higher priority; and

in a case that the user event information indicates that the user event of the client continues to occur within a preset duration, determining the encoding requirement information of the encoding task to be raising the priority.

7. The encoding scheduling method of claim 2 , wherein the network transmission quality information comprises network quality-of-service information; and

the determining the encoding requirement information of the encoding task comprises:

in a case that the network quality-of-service information of the client indicates that network quality is poor, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be reducing the hardware encoding resources.

8. The encoding scheduling method of claim 3 , wherein the determining the encoding requirement information of the encoding task further comprises:

in a case that the user interface elements information indicates that a proportion of text information in the current image frame is greater than a preset fourth threshold, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be increasing the hardware encoding resources; and

the determining the encoding requirement information of the encoding task further comprises:

according to a load status of a current hardware encoding resource and the encoding requirement information of the encoding task, increasing calling of the hardware encoding resources to perform transmission according to a priority corresponding to the encoding task when the load status of the current hardware encoding resource is capable of meeting an increased requirement of the hardware encoding resources.

9. The encoding scheduling method of claim 3 , wherein the determining the encoding requirement information of the encoding task further comprises:

in a case that the updated region information indicates that information update occurs in a partial region when the current image frame is compared with a previous image frame, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be maintaining the hardware encoding resources unchanged; and

the determining the encoding requirement information of the encoding task further comprises:

according to a load status of a current hardware encoding resource and the encoding requirement information of the encoding task, increasing calling of the hardware encoding resources to perform transmission according to a priority corresponding to the encoding task when the load status of the current hardware encoding resource is capable of meeting an increased requirement of hardware encoding resources.

10. The encoding scheduling method of claim 1 , wherein the encoding requirement information comprises: priority information, encoding parameter information, and hardware encoding resource requirement information of the encoding task.

11. The encoding scheduling method of claim 10 , wherein the calling the hardware encoding resources according to the encoding requirement information of the encoding task comprises:

determining the hardware encoding resource requirement information according to the encoding parameter information;

calling the hardware encoding resources according to the hardware encoding resource requirement information; and

encoding the encoding task according to the priority in descending order.

12. The encoding scheduling method of claim 1 , further comprising:

transmitting an image video stream of a remote desktop obtained after the encoding to a client.

13. A server, comprising:

one or more processors; and

a memory storing one or more programs executable by the one or more processors to cause the server to:

determine encoding requirement information of an encoding task according to information reflecting a remote desktop creation requirement, wherein the information reflecting the remote desktop creation requirement comprises remote desktop image quality requirement information comprising user interface elements information used for representing text information and image information comprised in image frames; and

call, according to the encoding requirement information of the encoding task, hardware encoding resources to implement encoding of the encoding task;

wherein operations of determining the encoding requirement information of the encoding task comprise: in a case that the user interface elements information indicates that a proportion of image information in a current image frame is greater than a preset first threshold, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be reducing the hardware encoding resources.

14. The server of claim 13 , wherein the information reflecting the remote desktop creation requirement further comprises any one or a combination of the following: information of a client initiating remote desktop creation, and network transmission quality information.

15. The server of claim 14 , wherein the information reflecting the remote desktop creation requirement further comprises any one or a combination of the following:

updated region information used for representing a region in which information update occurs obtained by comparing an image frame transmitted later with an adjacent image frame transmitted earlier;

application information used for determining whether an application is a popular application;

user configuration information used for displaying a priority of a user;

user event information used for representing a user event of the client; and

network quality-of-service information.

16. The server of claim 13 , wherein the one or more programs are executable by the one or more processors to further cause the server to:

determine hardware encoding resource requirement information according to encoding parameter information;

call the hardware encoding resources according to the hardware encoding resource requirement information; and

encode the encoding task according to the priority in descending order.

17. The server of claim 16 , wherein the one or more programs are executable by the one or more processors to further cause the server to:

transmit an image video stream of a remote desktop obtained after the encoding to a client.

18. The server of claim 13 , wherein the server comprises a hardware encoder providing the hardware encoding resources.

19. A non-transitory computer-readable storage medium that stores one or more programs executable by one or more processors to cause a server to:

receive a request for remote desktop creation;

determine encoding requirement information of an encoding task according to information reflecting a remote desktop creation requirement, wherein the information reflecting the remote desktop creation requirement comprises remote desktop image quality requirement information comprising user interface elements information used for representing text information and image information comprised in image frames;

calling, according to the encoding requirement information of the encoding task, hardware encoding resources provided by a hardware encoding module, to implement encoding of the encoding task; and

transmitting image video stream of a remote desktop obtained after the encoding to one or more clients;

wherein operations of determining the encoding requirement information of the encoding task comprise:

in a case that the user interface elements information indicates that a proportion of image information in a current image frame is greater than a preset first threshold, determining hardware encoding resource requirement information in the encoding requirement information of the encoding task to be reducing the hardware encoding resources.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the one or more programs are executable by the one or more processors to cause one or more clients to:

initiate the request for the remote desktop creation to the server; and

receive the image video stream of the remote desktop obtained after the encoding from the server.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PRIVATE LIMITED
Reel/Frame 075478/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2023
From: JIA, XIANGHONG; MIN, HONGBO; HU, XIANG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 063443/0137 →
Priority Claims (1)
CN 202010973546.0 · Sep 16, 2020 · national
Continuity (2)
Continuation PCTCN2021117361 · Sep 9, 2021
Related Publication 20230221969A1 · Jul 13, 2023