IP Library Granted Patent US 11,731,043
Granted Patent B2
US 11,731,043 · App. 16/688,369 · Granted Aug 22, 2023

Adaptive graphics for cloud gaming

Inventor: Roelof Roderick Colenbrander (Costa Mesa, CA)
Assignee: Sony Interactive Entertainment Inc.
A63F13/355A63F13/335A63F13/358A63F2300/538
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,731,043
App. No.
16/688,369
Granted
Aug 22, 2023
Kind
B2
Abstract

A method is provided, including the following operations: executing a video game by a cloud game machine, the execution of the video game includes rendering gameplay video; processing the gameplay video by a streaming server for streaming over a network to a client device; monitoring connection quality over the network between the streaming server and the client device; responsive to detecting a change in the connection quality between the streaming server and the client device, then adjusting the rendering of the gameplay video by the cloud game machine.

Claims (22)

1. A method, comprising:

executing a video game by a cloud game machine, the execution of the video game includes rendering gameplay video and gameplay audio;

processing the rendered gameplay video and gameplay audio by a streaming server for streaming over a network to a client device, wherein processing the gameplay video by the streaming server includes encoding the rendered gameplay video in a compressed video format;

monitoring connection quality over the network between the streaming server and the client device, wherein monitoring connection quality includes monitoring packet loss occurring during the streaming of the gameplay video;

responsive to detecting a change in the connection quality between the streaming server and the client device, then adjusting the rendering of the gameplay video and gameplay audio by the cloud game machine, wherein adjusting the rendering includes adjusting an amount of virtual objects to be rendered in the gameplay video based on a pre-defined priority ranking of the virtual objects for inclusion in, and exclusion from, the rendered gameplay video, the pre-defined priority ranking defining an order in which the virtual objects will be included in, and excluded from, a scene depicted by the gameplay video in response to changes in the connection quality, and wherein adjusting the rendering of the gameplay video by the cloud game machine includes adjusting a frame rate or a resolution for the gameplay video, and wherein adjusting the rendering of the gameplay audio by the cloud game machine includes adjusting one or more of an audio configuration, a sound effect, or background audio;

wherein adjusting the rendering further includes causing the cloud game machine to modify, based on an amount of said change in the connection quality, an effect associated with an in-game player assistance feature.

2. The method of claim 1 , wherein adjusting the rendering of the gameplay video by the cloud game machine includes adjusting a level of detail for the rendering of the gameplay video.

3. The method of claim 1 ,

wherein the change in the connection quality is defined by a degradation in the connection quality;

wherein adjusting the rendering of the gameplay video by the cloud game machine is configured to reduce a bit rate of the streaming of the gameplay video over the network.

4. The method of claim 1 ,

wherein the change in the connection quality is defined by an improvement in the connection quality;

wherein adjusting the rendering of the gameplay video by the cloud game machine is configured to increase a bit rate of the streaming of the gameplay video over the network.

5. The method of claim 1 , wherein detecting the change in the connection quality triggers transmission of a message from the streaming server to the cloud game machine, and wherein the adjusting of the rendering of the gameplay video by the cloud game machine is responsive to said message.

6. A system, comprising:

a cloud game machine that executes a video game, the execution of the video game includes rendering gameplay video;

a streaming server that processes the rendered gameplay video for streaming over a network to a client device, wherein the streaming server monitors connection quality over the network between the streaming server and the client device;

wherein responsive to detecting a change in the connection quality between the streaming server and the client device, then the rendering of the gameplay video and a game difficulty of the video game are adjusted by the cloud game machine, wherein the game difficulty is adjusted by adjusting a timing deadline for an input to perform an action in the video game, wherein adjusting the game difficulty further includes modifying an effect associated with an in-game player assistance feature, wherein adjusting the rendering includes adjusting an amount of virtual objects to be rendered in the gameplay video based on a pre-defined priority ranking of the virtual objects for inclusion in, and exclusion from, the rendered gameplay video, the pre-defined priority ranking defining an order in which the virtual objects will be included in, and excluded from, a scene depicted by the gameplay video in response to changes in the connection quality, and wherein the adjusting the rendering uses a user preference setting that indicates relative preference levels for aspects of the rendering by the game engine.

7. The system of claim 6 , wherein processing the gameplay video by the streaming server includes encoding the rendered gameplay video in a compressed video format.

8. The system of claim 6 , wherein monitoring connection quality includes monitoring one or more of bandwidth or latency.

9. The system of claim 6 , wherein monitoring connection quality includes monitoring packet loss occurring during the streaming of the gameplay video.

10. The system of claim 6 , wherein adjusting the rendering of the gameplay video by the cloud game machine includes adjusting a frame rate or a resolution for the gameplay video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: COLENBRANDER, ROELOF RODERICK
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 055720/0388 →
Continuity (1)
Related Publication 20210146240A1 · May 20, 2021