IP Library Granted Patent US 9,819,937
Granted Patent B1
US 9,819,937 · App. 14/686,320 · Granted Nov 14, 2017

Resource-aware desktop image decimation method and apparatus

Inventors: Paul Andrew Helter (Port Moody, CA); Joseph Michel Kenneth Savage (Vancouver, CA)
Assignee: Teradici Corporation
H04N19/119H04L67/10H04L67/2828H04N19/124H04N19/146H04N19/154H04N19/156H04N19/162H04N19/167H04N19/169H04N19/17H04N19/428H04N19/587H04N19/59
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,819,937
App. No.
14/686,320
Granted
Nov 14, 2017
Kind
B1
Abstract

A method and apparatus for transmitting a desktop display comprising classifying a first region of the desktop display as persistently changed and a second region of the desktop display as sporadically changed, adjusting, in relation to a user experience (UX) bias and a resource constraint, a target image quality for the first region, decimating the first region in accordance with a spatial decimation factor to generate a first decimated region, compressing the first decimated region at the target image quality and compressing the second region to generate a plurality of compressed regions and transmitting the plurality of compressed regions to a client via an IP network.

Claims (45)

1. A method for transmitting a desktop display comprising:

classifying a first region of the desktop display as persistently changed and a second region of the desktop display as sporadically changed, wherein the first region is selectively chosen from a sequence of frames of the desktop display to maintain a specified central processing unit (CPU) resource utilization target;

adjusting, in relation to a user experience (UX) bias and a resource constraint, a target image quality for the first region;

decimating the first region in accordance with a spatial decimation factor to generate a first decimated region;

compressing the first decimated region at the target image quality and compressing the second region to generate a plurality of compressed regions; and

transmitting the plurality of compressed regions to a client via an IP network.

2. The method of claim 1 , wherein the spatial decimation factor is at least four to one.

3. The method of claim 1 , wherein the target image quality is further specified by a quantization value weighted by the UX bias.

4. The method of claim 1 , wherein the UX bias comprises a value on a trade-off scale between maximum image quality and maximum frame rate.

5. The method of claim 1 , wherein the UX bias is adjusted in response to input received from the client.

6. The method of claim 1 , wherein the resource constraint is adjusted for resource utilization requirements of the second region.

7. The method of claim 1 , wherein decimating comprises,

representing a block of pixels as a single pixel, the single pixel comprising a gamma-corrected average of the block of pixels.

8. The method of claim 1 , wherein compressing further comprises:

transforming the decimated first region and the second region using a block size common to the decimated first region and the second region.

9. The method of claim 1 , wherein compressing the second region comprises:

generating a progressive refinement of a previously changed block of pixels.

10. The method of claim 1 , further comprising:

demarcating, prior to decimating, a zone in the first region which is excluded from decimating.

11. The method of claim 1 , wherein the resource constraint comprises the most significant of i) a bandwidth constraint of the IP network, ii) a client processor utilization target and iii) a host processor utilization target.

12. The method of claim 11 , wherein the client processor utilization target is reduced if the first region is determined to be out of focus.

13. The method of claim 11 , wherein the host processor utilization target is reduced if the first region is determined to be out of focus.

14. The method of claim 11 , wherein the client processor utilization target is adjusted according to power consumption requirements of the client.

15. The method of claim 1 further comprising, prior to decimating and compressing:

predicting resource utilization based on the target image quality and readjusting the target image quality in relation to at least a second resource constraint and the UX bias.

16. The method of claim 15 , wherein adjusting the target image quality comprises:

determining a dampened quality value determined respective of a previous image quality of a previous frame and an un-dampened image quality of a current frame being processed for decimation and compression.

17. An apparatus for transmitting a desktop display comprising:

a host processor; and

memory, storing thereon computer executable code for a resource aware encoder that when executed by the host processor performs a method comprising:

classifying a first region of the desktop display as persistently changed and a second region of the desktop display as sporadically changed, wherein the first region is selectively chosen from a sequence of frames of the desktop display to maintain a specified central processing unit (CPU) resource utilization target;

adjusting, in relation to a user experience (UX) bias and a resource constraint, a target image quality for the first region;

decimating the first region in accordance with a spatial decimation factor to generate a first decimated region; and

compressing the first decimated region at the target image quality and compressing the second region to generate a plurality of compressed regions,

wherein the host processor transmits the plurality of compressed regions to a client via an IP network.

18. The apparatus of claim 17 , wherein the resource aware encoder further:

demarcates, prior to decimating, a zone in the first region which is excluded from decimating.

19. The apparatus of claim 17 wherein the resource aware encoder, prior to decimating and compressing:

predicts resource utilization based on the target image quality and readjusting the target image quality in relation to at least a second resource constraint and the UX bias.

20. A method for transmitting a desktop display comprising:

classifying a first region of the desktop display as persistently changed and a second region of the desktop display as sporadically changed;

adjusting, in relation to a user experience (UX) bias and a resource constraint, a target image quality for the first region, wherein the resource constraint comprises one of i) a bandwidth constraint of an IP network, ii) a client processor utilization target and iii) a host processor utilization target, and wherein the client processor utilization target is reduced if the first region is determined to be out of focus or adjusted according to power consumption requirements of a client, and the host processor utilization target is reduced if the first region is determined to be out of focus;

decimating the first region in accordance with a spatial decimation factor to generate a first decimated region;

compressing the first decimated region at the target image quality and compressing the second region to generate a plurality of compressed regions; and

transmitting the plurality of compressed regions to the client via an IP network.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2025
From: TERADICI CO.
To: HP TECHNOLOGY HOLDINGS LLC
Reel/Frame 071854/0373 →
CHANGE OF NAME Recorded May 19, 2025
From: TERADICI CORPORATION
To: TERADICI CO.
Reel/Frame 071296/0559 →
RELEASE OF SECURITY INTEREST Recorded May 13, 2025
From: COMERICA BANK
To: TERADICI CORPORATION
Reel/Frame 071097/0240 →
RELEASE OF SECURITY INTEREST Recorded Feb 28, 2019
From: BEEDIE CAPITAL PARTNERS FUND I LIMITED PARTNERSHIP
To: TERADICI CORPORATION
Reel/Frame 048473/0846 →
SECURITY INTEREST Recorded Feb 27, 2019
From: TERADICI CORPORATION
To: COMERICA BANK
Reel/Frame 048454/0895 →
SECURITY INTEREST Recorded Mar 3, 2016
From: TERADICI CORPORATION
To: BEEDIE CAPITAL PARTNERS FUND I LIMITED PARTNERSHIP
Reel/Frame 037988/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2015
From: HELTER, PAUL ANDREW; SAVAGE, JOSEPH MICHEL KENNETH
To: TERADICI CORPORATION
Reel/Frame 035515/0666 →