IP Library › Granted Patent US 8,767,820
Granted Patent B2
US 8,767,820 · App. 12/616,716 · Granted Jul 1, 2014

Adaptive display compression for wireless transmission of rendered pixel data

Inventor: Bruce C. Montag (Austin, TX)
Assignee: Dell Products, LP
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,767,820
App. No.
12/616,716
Filed
Nov 11, 2009
Granted
Jul 1, 2014
Kind
B2
Art Unit
2486
USPC
375/240.01
Abstract

A system employs adaptive data rate reduction of rendered pixel data for wireless transmission between a source device and a display device. The source device determines the display properties of the display device and the current available bandwidth of a wireless channel connecting the source device to the display device. The source device adjusts a data rate reduction process that is applied to the rendered pixel data before the resulting pixel data is wirelessly transmitted based on these parameters. In response to a change in the data rate reduction process, the source device further can transmit to the display device an indicator that identifies the current data rate reduction type and effective compression ratio being applied by the source device. The display device can use this indicator to configure the processing of the rendered pixel data at the display device so as to mirror or otherwise comply with the particular data rate reduction process applied by the source device.

Claims (64)

1. A method comprising:

wirelessly transmitting rendered pixel data from a source device to a display device via a wireless channel;

monitoring the wireless channel by a wireless interface of the source device;

dynamically adjusting, at the source device, a data rate reduction process that is applied to the rendered pixel data prior to transmission from the source device based on parameters of the wireless channel provided by the wireless interface, wherein:

the parameters are based upon the monitoring; and

the dynamically adjusting the data rate reduction process comprises:

if a bandwidth of the wireless channel is adequate for uncompressed transmission of the rendered pixel data, bypassing application of the data rate reduction process;

if the bandwidth of the wireless channel drops to 10% to 20% below an amount needed for uncompressed transmission, implementing low ratio I-frame only H.264 encoding; and

if the bandwidth of the wireless channel drops to 30% or more below an amount needed for uncompressed transmission, implementing full H.264 mode or another data rate adaptation process that results in a high compression ratio; and

wirelessly transmitting from the source device to the display device a protocol ID to describe adjustments to the rendered pixel data, the protocol ID having a data structure comprising:

a first bit to indicate whether the data reduction process has been applied to produce the rendered pixel data;

a second bit to indicate whether an encryption process has been applied to produce the rendered pixel data;

a first field to indicate a compression type that has been applied to produce the rendered pixel data; and

a second field to indicate a compression ratio that has been applied to produce the rendered pixel data.

2. The method of claim 1 , wherein dynamically adjusting the data rate reduction process comprises dynamically adjusting the data rate reduction process further based on at least one display property of the display device.

3. The method of claim 2 , further comprising:

receiving, at the source device, an indicator of the at least one display property from the display device via the wireless channel; and

determining the at least one display property from the indicator.

4. The method of claim 3 , wherein the indicator comprises an Extended Display Identifier Data (EDID) message.

5. The method of claim 2 , wherein the source device comprises a desktop computer.

6. The method of claim 5 , wherein the display device comprises a computer display panel.

7. The method of claim 1 , further comprising:

wirelessly transmitting an indicator from the source device to the display device via the wireless channel in response to adjusting the data rate reduction process, the indicator identifying a resulting adjustment to the data rate reduction process; and

dynamically adjusting, at the display device, a data recovery process that is applied to the rendered pixel data prior to display of the rendered pixel data at the display device based on the indicator.

8. The method of claim 1 , wherein the data rate reduction process comprises a compression process and wherein dynamically adjusting the data rate reduction process comprises increasing a compression ratio of the compression process in response to a decrease in an available bandwidth of the wireless channel and decreasing the compression ratio of the compression process in response to an increase in the available bandwidth.

9. A source device comprising:

a wireless interface to establish a wireless channel with a display device and to monitor the wireless channel;

a graphics processor to generate first rendered pixel data, wherein the first rendered pixel data is formatted into a stream of micro-packets in compliance with DisplayPort standard;

a data reduction module to apply a data reduction process on the first rendered pixel data to generate second rendered pixel data representative of the first rendered pixel data;

a display interface to provide a representation of the second rendered pixel data to the wireless interface for wireless communication to the display device via the wireless channel, the representation comprising a protocol ID having a data structure comprising:

a first bit to indicate whether the data reduction process has been applied to produce the second rendered pixel data;

a second bit to indicate whether an encryption process has been applied to produce the second rendered pixel data;

a first field to indicate a compression type that has been applied to produce the rendered pixel data; and

a second field to indicate a compression ratio that has been applied to produce the rendered pixel data; and

a transmission controller to dynamically adjust a data rate reduction process that is applied by the data reduction module to the first rendered pixel data in generating the second rendered pixel data based on parameters of the wireless channel provided by the wireless interface, the parameters are based upon the monitoring, wherein the dynamically adjusting the data rate reduction process comprises:

if a bandwidth of the wireless channel is adequate for uncompressed transmission of the first rendered pixel data, bypassing application of the data rate reduction process;

if the bandwidth of the wireless channel drops to 10% to 20% below an amount needed for uncompressed transmission, implementing low ratio I-frame only H.264 encoding; and

if the bandwidth of the wireless channel drops to 30% or more below an amount needed for uncompressed transmission, implementing full H.264 mode or another data rate adaptation process that results in a high compression ratio.

10. The source device of claim 9 , wherein the transmission controller is to dynamically adjust the data rate reduction process further based on at least one display property of the display device.

11. The source device of claim 10 , wherein the transmission controller is to determine the at least one display property based on an indicator of the at least one display property received from the display device via the wireless channel.

12. The source device of claim 11 , wherein the indicator comprises an Extended Display Identifier Data (EDID) message.

13. The source device of claim 9 , wherein the first rendered pixel data comprises a plurality of data packets and wherein the data reduction module is configured to separately compress or rate adapt each packet.

14. The source device of claim 9 , wherein the transmission controller further is to provide an indicator to the wireless interface for communication to the display device in response to an adjustment to the data rate reduction process, the indicator identifying the adjustment to the data rate reduction process.

15. The source device of claim 9 , whereby the dynamically adjusting the data reduction process comprises applying the data reduction process to each micro-packet of the stream of micro-packets separately.

16. The source device of claim 9 further comprising a desktop computer.

17. A display device comprising:

a wireless interface to receive first rendered pixel data from a source device via a wireless channel;

a data recovery module to apply a data recovery process and a decryption process to the first rendered pixel data to generate a second rendered pixel data;

a display panel to display one or more frames represented by the second rendered pixel data; and

a reception controller to receive a protocol ID representative of an adjustment made to a data rate reduction process applied by the source device to produce the first rendered pixel data and representative of an encryption process applied by the source device and to adjust the data recovery process and the decryption process, both adjustments based on the protocol ID, wherein the protocol ID has a data structure comprising:

a first bit to indicate whether the data reduction process has been applied to produce the first rendered pixel data;

a second bit to indicate whether the encryption process has been applied to produce the first rendered pixel data;

a first field to indicate a compression type that has been applied to produce the first rendered pixel data; and

a second field to indicate a compression ratio that has been applied to produce the first rendered pixel data,

wherein the adjustment made to the data rate reduction process applied by the source device comprises:

if a bandwidth of the wireless channel is adequate for uncompressed transmission of the first rendered pixel data, bypassing application of the data rate reduction process;

if the bandwidth of the wireless channel drops to 10% to 20% below an amount needed for uncompressed transmission, implementing low ratio I-frame only H.264 encoding; and

if the bandwidth of the wireless channel drops to 30% or more below an amount needed for uncompressed transmission, implementing full H.264 mode or another data rate adaptation process that results in a high compression ratio.

18. The display device of claim 17 , wherein the protocol ID comprises a DisplayPort Configuration Data (DPCD) value.

19. The display device of claim 17 , wherein:

the rendered pixel data is formatted into a stream of micro-packets in compliance with the DisplayPort standard;

applying the data reduction process comprises applying the data reduction process to each micro-packet of the stream of micro-packets separately; and

receiving the protocol ID representative of the encryption process applied by the source device comprises receiving a protocol ID representative of an encryption process for each micro-packet of the stream of micro-packets separately.

20. The display device of claim 17 , wherein the first field is 8 bits and the second field is 8 bits.

Assignments (15)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040040/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040065/0618 →
RELEASE OF SECURITY INTEREST Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLANT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040065/0216 →
PATENT SECURITY AGREEMENT (ABL) Recorded Jan 2, 2014
From: DELL INC.; APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 031898/0001 →
PATENT SECURITY AGREEMENT (TERM LOAN) Recorded Jan 2, 2014
From: DELL INC.; APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 031899/0261 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Jan 2, 2014
From: APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS FIRST LIEN COLLATERAL AGENT
Reel/Frame 031897/0348 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2009
From: MONTAG, BRUCE C.
To: DELL PRODUCTS, LP
Reel/Frame 023712/0604 →
Continuity (1)
Related Publication 20110109792A1 · May 12, 2011