IP Library Granted Patent US 11,108,848
Granted Patent B2
US 11,108,848 · App. 16/874,512 · Granted Aug 31, 2021

Methods and systems for use in providing a remote user interface

Inventors: Graham Clift (Poway, CA); Stephane Lejeune (San Diego, CA)
Assignee: Saturn Licensing LLC
H04L67/10A63F13/355G06F3/0481G06F9/452G06T15/005A63F2300/209A63F2300/538
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,108,848
App. No.
16/874,512
Granted
Aug 31, 2021
Kind
B2
Abstract

The present embodiments provide systems, methods and apparatuses for use in providing the playback of content. Some of these embodiments provide methods of playing back multimedia content, comprising: implementing, on a multimedia rendering client device coupled with a LAN, a simplified Internet browser that establishes a browser environment; establishing a network connection over the LAN between the client device and a remote server; operating, within the browser environment, a lightweight remote user interface (RUI) protocol client application that is operated with a JavaScript based graphics application program interface to a graphics protocol stack of the client device; receiving graphics commands; implementing, through the RUI protocol client application in cooperation with the JavaScript based graphics application program interface, the graphics commands and generating graphics in accordance with the graphics commands; and displaying on the client device the graphics consistent with the graphics commands.

Claims (49)

1. A method of playing back multimedia content, the method comprising:

implementing, on a multimedia rendering client device an Internet browser for establishing a browser environment,

establishing a network connection between the client device and a remote server;

operating, within the browser environment on the client device, a remote user interface (RUI) protocol client application operated with a JavaScript based graphics application program interface to a graphics protocol stack of the client device;

receiving, through the RUI protocol client application and from the server over the network, graphics commands;

implementing, through the RUI protocol client application in cooperation with the JavaScript based graphics application program interface, the graphics commands and generating graphics in accordance with the graphics commands; and

displaying on the client device the graphics consistent with the graphics commands.

2. The method of claim 1 , wherein the browser comprises a HTML5 browser compatible with at least one of WebGL, Web Sockets and JavaScript technologies.

3. The method of claim 2 , wherein the HTML5 browser is configured to use declarative (XML) graphical methods.

4. The method of claim 2 , wherein the HTML5 browser includes library support for Canvas 2D and WebGL APIs.

5. The method of claim 1 , wherein establishing the network connection comprises establishing persistent full-duplex communications channel over a single Transmission Control Protocol (TCP) socket between the client device and the remote server.

6. The method of claim 1 , wherein receiving the graphics commands comprises receiving streamed graphics commands streamed over a persistent full-duplex communications channel; and

wherein the implementing the graphics commands comprises translating, through the RUI protocol client application, the streamed graphics commands from a streaming format to a JavaScript based graphics application program interface compatible format.

7. The method of claim 6 , wherein translating the streamed graphics commands comprises translating the streamed graphics commands from the streaming format to a text based formatted protocol based on the JavaScript based graphics application program interface compatible format.

8. The method of claim 1 , further comprising:

preventing a refresh of a display screen of the client device until graphics are available to generate a full screen of graphics.

9. The method of claim 8 , further comprising: distinguishing, at the RUI protocol client application, between synchronous and

asynchronous commands; and

buffering asynchronous commands until a full display screen is available.

10. The method of claim 1 , further comprising:

activating a command protocol at the client device;

processing, through the command protocol, one or more control commands and packaging the one or more commands; and

communicating the packaged one or more commands via the network connection to the server, where the control of the playback of the multimedia content is implemented at the remote server.

11. A device for playing back multimedia content, the device comprising one or more processors configured for:

implementing, on the device an Internet browser for establishing a browser environment;

establishing a network connection between the client device and a remote server;

operating, within the browser environment, a remote user interface (RUI) protocol client application operated with a JavaScript based graphics application program interface to a graphics protocol stack of the device;

receiving, through the RUI protocol client application and from the server over the network, graphics commands;

implementing, through the RUI protocol client application in cooperation with the JavaScript based graphics application program interface, the graphics commands and generating graphics in accordance with the graphics commands; and

displaying on the client device the graphics consistent with the graphics commands.

12. The device of claim 11 , wherein the browser comprises a HTML5 browser compatible with at least one of WebGL, Web Sockets and JavaScript technologies.

13. The device of claim 12 , wherein the HTML5 browser is configured to use declarative (XML) graphical methods.

14. The device of claim 12 , wherein the HTML5 browser includes library support for Canvas 2D and WebGL APIs.

15. The device of claim 11 , wherein the one or more processors are configured to establish the network connection by establishing persistent full-duplex communications channel over a single Transmission Control Protocol (TCP) socket between the client device and the remote server.

16. The device of claim 11 , wherein the one or more processors are configured to receive streamed graphics commands streamed over a persistent full-duplex communications channel; and

implement the graphics commands by translating, through the RUI protocol client application, the streamed graphics commands from a streaming format to a JavaScript based graphics application program interface compatible format.

17. The device of claim 16 , wherein the one or more processors are configured to translate the streamed graphics commands from the streaming format to a text based formatted protocol based on the JavaScript based graphics application program interface compatible format.

18. The device of claim 11 , wherein the one or more processors are configured to generate a refresh of a display screen of the client device until graphics are available to generate a full screen of graphics.

19. The device of claim 11 , wherein the one or more processors are configured to:

activate a command protocol at the client device;

process, through the command protocol, one or more control commands and packaging the one or more commands; and

communicate the packaged one or more commands via the network connection to the server, where the control of the playback of the multimedia content is implemented at the remote server.

20. A computer program product comprising a non-transitory medium for embodying a computer program for input to a processor based system and a computer program embodied in the medium for causing the processor based system to:

implement, on a multimedia rendering client device an Internet browser for establishing a browser environment,

establish a network connection between the client device and a remote server;

operate, within the browser environment on the client device, a remote user interface (RUI) protocol client application operated with a JavaScript based graphics application program interface to a graphics protocol stack of the client device;

receive, through the RUI protocol client application and from the server over the network, graphics commands;

implement, through the RUI protocol client application in cooperation with the JavaScript based graphics application program interface, the graphics commands and generating graphics in accordance with the graphics commands; and

display on the client device the graphics consistent with the graphics commands.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2025
From: SATURN LICENSING LLC
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 071157/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2020
From: CLIFT, GRAHAM; LEJEUNE, STEPHANE
To: SONY CORPORATION
Reel/Frame 052818/0107 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2020
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 052819/0122 →