IP Library Granted Patent US 8,527,654
Granted Patent B2
US 8,527,654 · App. 13/486,939 · Granted Sep 3, 2013

Method and system for low-latency transfer protocol

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,527,654
App. No.
13/486,939
Granted
Sep 3, 2013
Kind
B2
Abstract

A method and system for providing computer-generated output and in particular graphical output. An output capturing and encoding engine is configured to intercept graphical output from an application on a server, organize the output into regions having similar motion and/or graphical characteristics, and convert the data from each region into a format suitable to balance transmission efficiencies versus display quality or capability at the receiving end.

Claims (37)

1. A system for providing a low-latency transfer protocol, the system comprising:

a server in communication with one or more clients over a digital computer network;

and

an application program instantiated on the server, the application program providing a computer-generated output;

wherein the server is configured to implement the low-latency transfer protocol including being configured to:

intercept the computer-generated output from the application program;

identify a plurality of regions within the computer-generated output from the application program;

for each specific region of the plurality of regions, determine and select a specific format for data conversion, wherein each of the plurality of regions has at least a characteristic affecting quality retention of the data conversion;

for each specific region, convert the corresponding computer-generated output from the application program into the corresponding specific format, thereby generating a converted output with the plurality of regions having one or more different formats; and

transmit the converted output over the digital computer network to the one or more clients.

2. The system of claim 1 , wherein the server is further configured to smooth border areas between the regions of the converted output.

3. The system of claim 1 , wherein the specific format is determined and selected according to operating systems or other commands used to render a graphical output of the specific region, or graphical commands represented by a universal intermediary graphical command language.

4. The system of claim 3 , wherein the server is further configured to convert the graphical output into video codec data utilizing at least one of a localized motion detection routine and a motion estimation routine, wherein each of the plurality of regions shares similar motion characteristics.

5. The system of claim 4 , wherein the server is further configured to compute a motion score for each specific region, wherein the motion scores represent motion characteristics.

6. The system of claim 3 , wherein the server is further configured to transmit the converted output to the one or more clients through one or more types of channels.

7. The system of claim 6 , wherein the one or more types of channels includes guaranteed delivery, non-guaranteed delivery, and non-guaranteed delivery with forward error correction.

8. The system of claim 7 , wherein a specific region of the plurality of regions is transmitted at a specific rate to the one or more clients for improved user experience.

9. The systems of claim 1 , wherein the server is further configured to pre-process the computer-generated output before converting by selecting regions with graphical activity for processing.

10. The system of claim 9 , wherein the pre-processing further includes overlaying a mask on the graphical output to obscure static regions.

11. The system of claim 10 , wherein some of the plurality of regions are cached and not required for transmitting.

12. The system of claim 1 , wherein the one or more clients is or are configured to

execute, decode, and render graphics and video;

render the graphical output in response to receiving transmitted converted output from the server;

intercept user inputs, and

transmit the intercepted user inputs to the server over the digital computer network.

13. The system of claim 12 , wherein the server is further configured to receive the intercepted user inputs from the one or more clients, and provide the intercepted user inputs to the application program for processing.

14. A computer-implemented method for providing a low-latency transfer protocol, the method comprising:

intercepting a computer-generated output from an executing application program;

dividing the computer-generated output into a plurality of regions;

for each specific region of the plurality of regions, selecting a specific format;

for each specific region, converting the corresponding computer-generated output from the application program into the corresponding specific format, wherein the plurality of regions of the converted computer-generated output has one or more different formats;

smoothing border areas among at least some of the plurality of regions;

and

transmitting the converted computer-generated output over the digital computer network to one or more clients.

15. The computer-implemented method of claim 14 , further comprising:

receiving user inputs from the one or more clients; and

providing the users inputs to the application program for processing.

Assignments (28)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: WICKR LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 057366/0573 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 25, 2021
From: SILICON VALLEY BANK
To: WICKR INC.
Reel/Frame 056684/0366 →
SECURITY AGREEMENT Recorded Dec 12, 2017
From: WICKR INC.
To: SILICON VALLEY BANK
Reel/Frame 044872/0729 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE ADDRESS PREVIOUSLY RECORDED AT REEL: 039810 FRAME: 0277. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 24, 2016
From: NET POWER AND LIGHT, INC.
To: WICKR INC.
Reel/Frame 040262/0085 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS FROM 71 S. WACKER DR. SUITE 2385 CHICAGO, ILLINOIS 60606 TO 459 18TH ST., #313, SAN FRANCISCO, CALIFORNIA 94107 PREVIOUSLY RECORDED ON REEL 039810 FRAME 0277. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 24, 2016
From: NET POWER AND LIGHT, INC.
To: WICKR INC.
Reel/Frame 040267/0459 →
MERGER Recorded Aug 25, 2016
From: NET POWER AND LIGHT, INC.
To: WICKR INC.
Reel/Frame 039810/0277 →
MERGER Recorded Aug 24, 2016
From: NET POWER AND LIGHT, INC.
To: NET POWER AND LIGHT, INC.
Reel/Frame 039809/0346 →
NOTE AND WARRANT CONVERSION AGREEMENT Recorded Apr 28, 2016
From: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUI TY
To: NET POWER & LIGHT, INC.
Reel/Frame 038543/0889 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2016
From: NET POWER & LIGHT, INC.
To: NET POWER & LIGHT, INC.
Reel/Frame 038398/0934 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2016
From: NET POWER & LIGHT, INC.
To: NET POWER & LIGHT, INC.
Reel/Frame 038398/0940 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2016
From: NET POWER & LIGHT, INC.
To: NET POWER & LIGHT, INC.
Reel/Frame 038398/0946 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2016
From: NET POWER & LIGHT, INC.
To: NET POWER & LIGHT, INC.
Reel/Frame 038398/0958 →
NOTE AND WARRANT CONVERSION AGREEMENT Recorded Apr 28, 2016
From: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUI TY
To: NET POWER & LIGHT, INC.
Reel/Frame 038543/0942 →
NOTE AND WARRANT CONVERSION AGREEMENT Recorded Apr 28, 2016
From: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUI TY
To: NET POWER & LIGHT, INC.
Reel/Frame 038543/0966 →
NOTE AND WARRANT CONVERSION AGREEMENT Recorded Apr 28, 2016
From: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY
To: NET POWER & LIGHT, INC.
Reel/Frame 038600/0779 →
NOTE AND WARRANT CONVERSION AGREEMENT Recorded Apr 27, 2016
From: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.
To: NET POWER & LIGHT, INC.
Reel/Frame 038543/0839 →
RELEASE OF SECURITY INTEREST Recorded Apr 27, 2016
From: NET POWER & LIGHT, INC.
To: NET POWER & LIGHT, INC.
Reel/Frame 038543/0831 →
SECURITY INTEREST Recorded Feb 22, 2016
From: NET POWER AND LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHINE, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUI TY
Reel/Frame 037786/0090 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037333 FRAME: 0680. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2015
From: NET POWER AND LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUITY
Reel/Frame 037394/0150 →
SECURITY INTEREST Recorded Dec 18, 2015
From: NET POWER AND LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOVS PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUITY
Reel/Frame 037333/0680 →
SECURITY INTEREST Recorded Oct 6, 2015
From: NET POWER & LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B.; BROWN, JOHN SEELY; SHIN, JEANNIE; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; WANG, TA-HUI TY
Reel/Frame 036740/0252 →
SECURITY INTEREST Recorded Dec 4, 2014
From: NET POWER AND LIGHT, INC.
To: ALSOP LOUIE CAPITAL 1, L.P.; PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); BROWN, JOHN SEELY; ORRICK INVESTMENTS 2010, LLC; ORRICK INVESTMENTS 2011, LLC; LOW, LAWRENCE B.; SHIN, JEANNIE; WANG, TA-HUITY
Reel/Frame 034374/0920 →
SECURITY INTEREST Recorded Dec 3, 2014
From: NET POWER AND LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL 1, L.P.; SINGTEL INNOV8 PTE. LTD.; TWB INVESTMENT PARTNERSHIP II, LP; THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY (DAPER I); LOW, LAWRENCE B; BROWN, JOHN SEELY
Reel/Frame 034361/0439 →
SECURITY INTEREST Recorded Jun 4, 2014
From: NET POWER AND LIGHT, INC.
To: PENINSULA TECHNOLOGY VENTURES, L.P.; PENINSULA VENTURE PRINCIPALS, L.P.; ALSOP LOUIE CAPITAL I, L.P.
Reel/Frame 033086/0001 →
RELEASE OF SECURITY INTEREST Recorded Feb 6, 2014
From: ALSOP LOUIE CAPITAL, L.P.; SINGTEL INNOV8 PTE. LTD.
To: NET POWER AND LIGHT, INC.
Reel/Frame 032158/0112 →
SECURITY AGREEMENT Recorded Dec 23, 2013
From: NET POWER AND LIGHT, INC.
To: ALSOP LOUIE CAPITAL, L.P.; SINGTEL INNOV8 PTE. LTD.
Reel/Frame 031868/0927 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2013
From: VONOG, STANISLAV; SURIN, NIKOLAY; SHTAYURA, VADIM
To: NET POWER AND LIGHT, INC.; MUSIGY USA, INC.
Reel/Frame 030963/0242 →
CHANGE OF NAME Recorded Aug 7, 2013
From: MUSIGY USA, INC.
To: NET POWER AND LIGHT, INC.
Reel/Frame 030985/0207 →