System, method, and graphical user interface for controlling an application on a tablet
View Patent ↗A system, method, and graphical user interface for playing games and/or executing applications on a tablet-based client. One embodiment of a graphical user interface (GUI) for playing a video game on a tablet-based client device comprises: a virtual controller rendered on a display of the tablet computer, the virtual controller substantially mimicking the control provided by a thumb stick of a physical game controller and providing omnidirectional, free-form movement in a synchronous direction in which a user moves a finger on the display of the tablet-based client.
1. A method, comprising:
communicating, by a client device, with a hosting service a selection of an online application;
receiving, by the client device, streaming video content from execution of the online application on a server of the hosting service, for rendering at a user interface of the client device;
receiving, by the client device, program code for a configuration of a virtual controller used for interacting with the streaming video content from the hosting service, the program code being specific for the online application, wherein the program code includes user specific adjustments to the configuration defined for the online application from a previous configuration session;
executing, by the client device, the program code of the virtual controller, the execution causing an interactive image of the virtual controller to be rendered at the user interface, the interactive image of the virtual controller identifying controls of the virtual controller that are specific for the client device;
receiving, by the client device, user input via the controls provided by the virtual controller to communicate functionality that parallels functionality of buttons of a physical game controller, the user input being interpreted based on the user specific adjustments, the user input provided to control aspects of the online application being executed by the server.
2. The method of claim 1 , wherein the program code of the virtual controller defined for the client device is stored in a database of the hosting service and the user specific adjustments included in the program code are provided by a user during previous interactive sessions of the online application.
3. The method of claim 2 , further includes receiving additional user specific adjustments to the configuration of the virtual controller during current session, the additional user specific adjustments from the current session updated to the program code of the virtual controller stored in the database for use during subsequent sessions of the online application.
4. The method of claim 1 , wherein the user specific adjustment causes rendering of the interactive image of the virtual controller in a specific region of the display of the client device.
5. The method of claim 1 , wherein the configuration of the virtual controller specifies a size of the virtual controller and a region on the user interface for rendering the virtual controller, wherein the size and the region being configurable by a user.
6. The method of claim 1 , wherein the configuration of the virtual controller specifies a rendering state of the virtual controller when rendered on the user interface, wherein the rendering state of the virtual controller is one of transparent state and semi-transparent state.
7. The method of claim 1 , wherein the configuration of the virtual controller specifies sensitivity index for different controls of the virtual controller.
8. The method of claim 1 , wherein the user specific adjustment includes rendering the image of the virtual controller in a relative mode or an absolute mode, wherein in the relative mode the interactive image of the virtual controller is drawn on the user interface at an initial touch point and the user input on the display is determined in relation to the initial touch point, and
wherein in the absolute mode the interactive image of the virtual controller is drawn in a fixed location on the user interface, wherein the fixed location is determined based on the user specific adjustment to the configuration.
9. The method of claim 1 , wherein the program code of the configuration of the virtual controller, when executed, produces the interactive image of the virtual controller that includes graphics for buttons that are configurable on a per user basis.
10. The method of claim 1 , wherein the program code of the configuration of the virtual controller, when executed, produces the interactive image of the virtual controller that includes graphics for buttons that are configurable based on content of the online application.
11. A non-transitory computer readable storage medium having program instructions, which when executed by a processor of a client device performs a method, the program instructions comprising:
program instructions for communicating with a hosting service a selection of an online application;
program instructions for receiving streaming video content from execution of the online application on a server of the hosting service, for rendering at a user interface of the client device;
program instructions for receiving program code for a configuration of a virtual controller used for interacting with the streaming video content from the hosting service, the program code being specific for the online application, wherein the program code includes user specific adjustments to the configuration defined for the online application from a previous configuration session;
program instructions for executing the program code of the virtual controller, the execution causing an interactive image of the virtual controller to be rendered at the user interface, the interactive image of the virtual controller identifying controls of the virtual controller that are specific for the client device;
program instructions for receiving user input via the controls provided by the virtual controller to communicate functionality that parallels functionality of buttons of a physical game controller, the user input being interpreted based on the user specific adjustments, the user input provided to control aspects of the online application being executed by the server.
12. The computer readable storage medium of claim 11 , further includes program instructions for receiving additional user specific adjustments to the configuration of the virtual controller during current session, the additional user specific adjustments from the current session updated to the program code of the virtual controller stored in a database for use during subsequent sessions of the online application.
13. The computer readable storage medium of claim 11 , wherein the program instructions for executing the program code further includes program instructions for rendering the interactive image of the virtual controller in a relative mode or an absolute mode, wherein in the relative mode, the interactive image of the virtual controller to be drawn on the user interface at an initial touch point and the user input on the display is computed in relation to the initial touch point, and
wherein in the absolute mode the interactive image of the virtual controller is drawn in a fixed location on the user interface, wherein the fixed location is determined based on user specific adjustment to the configuration.
14. A method, comprising:
communicating, by a client device, with a cloud hosting service a selection of an online application;
receiving, by the client device, streaming video content from execution of the online application on a server of the cloud hosting service for rendering at a display screen associated with the client device, and program code for a configuration of a virtual controller defined during a previous configuration session, the virtual controller used for interacting with the streaming video content provided by the cloud hosting service, the streaming video content and the program code being specific for a type of the client device used in interacting with the online application;
executing, by the client device, the program code of the virtual controller, the execution causing an interactive image of the virtual controller to be rendered at the user interface, the interactive image of the virtual controller identifying controls of the virtual controller that are specific for the type of the client device;
receiving, by the client device, user input to the online application via the controls provided by the virtual controller to communicate functionality that parallels functionality of buttons of a physical game controller, the user input provided to control aspects of the online application being executed by the server.
15. The method of claim 14 , wherein the configuration of the virtual controller includes user specific adjustments to the configuration previously defined for the online application, and wherein the user input provided via the controls is interpreted based on the user specific adjustments.
16. The method of claim 14 , wherein the type of client device used in interacting with the online application is determined during initialization of the client device.
17. The method of claim 14 , wherein the streaming video content provided by the server to the client device is selected based on a format that is appropriate for a type of the display screen associated with the client device.
18. The method of claim 14 , wherein the display screen is external to the client device and is communicatively connected to the client device, and the streaming video content provided for rendering is formatted for the external display screen.
19. The method of claim 14 , wherein the configuration of the virtual controller specifies one or more modes of operation, a location and a mode of operation of the controls in the virtual controller specified based on a type of the online application and on user specific adjustments to the configuration.
20. The method of claim 14 , wherein the configuration of the virtual controller specifies a size of the virtual controller and a region on the user interface of the display screen for rendering the virtual controller, wherein the size and the region being specific for the online application and is configurable using user specific adjustments.