IP Library › Granted Patent US 12,102,917
Granted Patent B2
US 12,102,917 · App. 17/433,973 · Granted Oct 1, 2024

Variable end-point user interface rendering

Inventors: Nicholas Vining (Kitchener, CA); Paul LaLonde (Kitchener, CA)
Assignee: Google LLC
A63F13/537H04N21/234363H04N21/4312H04N21/6547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,102,917
App. No.
17/433,973
Granted
Oct 1, 2024
Kind
B2
Abstract

Methods and systems for rendering distinct components of a combined user interface (UI) are described herein. A processing device receives a user request for a media item to be presented via a combined UI including one or more video content components and one or more UI control components. The processing device generates a rendering of the video content components and transmits a first stream including the rendering of the video content components to an endpoint device, wherein the first stream is encoded to a first resolution and wherein the rendering of the video content components is to be merged with a rendering of the UI control components into the combined UI at the endpoint device, the combined UI having a second resolution.

Claims (40)

1. A method comprising:

receiving, at a server, a user request for a media item to be presented via a combined user interface (UI) including one or more video content components and one or more UI control components;

generating a rendering of the video content components; and

transmitting a first stream including the rendering of the video content components and a second stream including the rendering of the UI control components to an endpoint device, wherein the first stream is encoded to a first resolution and the second stream is encoded to a second resolution that is higher than the first resolution, and wherein the rendering of the video content components is to be merged with a rendering of the UI control components into the combined UI at the endpoint device, the combined UI having the second resolution.

2. The method of claim 1 , further comprising:

executing, at the server, a set of commands to generate the rendering of the UI control components.

3. The method of claim 1 , further comprising:

determining whether to generate a rendering of the UI control components at the server or at the endpoint device; and

responsive to determining to generate the rendering of the UI control components at the server:

executing, at the server, a set of commands for rendering the UI control components to generate the rendering of the UI control components.

4. The method of claim 3 , wherein the second resolution is higher than the first resolution, and the rendering of the video content components is to be modified to match the second resolution of the UI control components at the endpoint device.

5. The method of claim 3 , wherein the determination of whether to execute the set of commands at the server or at the endpoint device is based on at least one of: a hardware capability of the endpoint device, a resolution of the endpoint device, a target resolution of the combined UI, a rendering capability of the server, or a bandwidth available on a network.

6. The method of claim 1 , wherein the combined UI is to present an online game that receives user input via the UI control components.

7. A system comprising:

a memory; and

a processing device coupled to the memory, the processing device to:

receive a user request for a media item to be presented via a combined user interface (UI) including one or more video content components and one or more UI control components;

generate a rendering of the video content components; and

transmit a first stream including the rendering of the video content components and a second stream including the rendering of the UI control components to an endpoint device, wherein the first stream is encoded to a first resolution and the second stream is encoded to a second resolution that is higher than the first resolution, and wherein the rendering of the video content components is to be merged with a rendering of the UI control components into the combined UI at the endpoint device, the combined UI having the second resolution.

8. The system of claim 7 , wherein the processing device is further to:

execute a set of commands to generate the rendering of the UI control components.

9. The system of claim 7 , wherein the processing device is further to:

determine whether to generate a rendering of the UI control components at a server or at the endpoint device; and

responsive to determining to generate the rendering of the UI control components at the server:

execute a set of commands for rendering the UI control components to generate the rendering of the UI control components.

10. The system of claim 9 , wherein the second resolution is higher than the first resolution, and the rendering of the video content components is to be modified to match the second resolution of the UI control components at the endpoint device.

11. The system of claim 9 , wherein the determination of whether to execute the set of commands at the server or at the endpoint device is based on at least one of: a hardware capability of the endpoint device, a resolution of the endpoint device, a target resolution of the combined UI, a rendering capability of the server, or a bandwidth available on a network.

12. The system of claim 7 , wherein the combined UI is to present an online game that receives user input via the UI control components.

13. A non-transitory computer readable storage medium including instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving, at a server, a user request for a media item to be presented via a combined user interface (UI) including one or more video content components and one or more UI control components;

generating a rendering of the video content components; and

transmitting a first stream including the rendering of the video content components and a second stream including the rendering of the UI control components to an endpoint device, wherein the first stream is encoded to a first resolution and the second stream is encoded to a second resolution that is higher than the first resolution and wherein the rendering of the video content components is to be merged with a rendering of the UI control components into the combined UI at the endpoint device, the combined UI having the second resolution.

14. The non-transitory computer readable storage medium of claim 13 , the operations further comprising:

executing, at the server, a set of commands to generate the rendering of the UI control components.

15. The non-transitory computer readable storage medium of claim 13 , the operations further comprising:

determining whether to generate a rendering of the UI control components at the server or at the endpoint device; and

responsive to determining to generate the rendering of the UI control components at the server:

executing, at the server, a set of commands for rendering the UI control components to generate the rendering of the UI control components.

16. The non-transitory computer readable storage medium of claim 15 , wherein the second resolution is higher than the first resolution, and the rendering of the video content components is to be modified to match the second resolution of the UI control components at the endpoint device.

17. The non-transitory computer readable storage medium of claim 15 , wherein the determination of whether to execute the set of commands at the server or at the endpoint device is based on at least one of: a hardware capability of the endpoint device, a resolution of the endpoint device, a target resolution of the combined UI, a rendering capability of the server, or a bandwidth available on a network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2021
From: VINING, NICHOLAS; LALONDE, PAUL
To: GOOGLE LLC
Reel/Frame 058011/0904 →
Continuity (1)
Related Publication 20220134227A1 · May 5, 2022