IP Library › Granted Patent US 10,971,115
Granted Patent B2
US 10,971,115 · App. 16/559,965 · Granted Apr 6, 2021

Foveated rendering system and method

Inventors: Matthew William Sanders (Middlesex, GB); Nigel John Williams (London, GB); Richard James Forster (London, GB); Andrew William Walker (London, GB); Jessica Rose Grant (London, GB)
Assignee: Sony Interactive Entertainment Inc.
G09G5/373G06F3/012G06F3/013G09G2340/045G09G2340/0407G09G2340/0464G09G2354/00H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,971,115
App. No.
16/559,965
Granted
Apr 6, 2021
Kind
B2
Abstract

A foveated rendering system for modifying content to be displayed includes a user profile obtaining unit operable to obtain a user profile comprising information about head motion and eye motion for a user, and a foveated rendering unit operable to apply a foveated rendering process to the content to be displayed in dependence upon obtained user profile information.

Claims (35)

1. A foveated rendering system for modifying content to be displayed, the system comprising:

a user profile obtaining unit operable to obtain a user profile, comprising user profile information about head motion and eye motion for a user;

a foveated rendering unit operable to apply a foveated rendering process to the content to be displayed; and

a user profile analysis unit operable to determine characteristics of one or more groups of users in dependence upon the obtained user profiles,

wherein the foveated rendering process is dependent on the user profile information obtained from the user profile, and

wherein at least one of:

(i) the user profile analysis unit is operable to identify characteristics that correspond to an above-threshold number of users representing the group of all users, and

(ii) the user profile analysis unit is operable to identify one or more groups of users according to shared characteristics between user profiles, and the foveated rendering unit is operable to apply the foveated rendering process to the content to be displayed in dependence upon the characteristics determined by the user profile analysis unit so as to generate a processed content to be displayed for each group.

2. The foveated rendering system according to claim 1 , wherein the user profile identifies user preferences for eye motion and head motion.

3. The foveated rendering system according to claim 2 , wherein the user profile identifies proportions of head motion and eye motion used by a user in performing one or more viewing transitions between displayed content elements.

4. The foveated rendering system according to claim 1 , wherein:

the user profile analysis unit is operable to determine characteristics of a single group comprising all users, and

the foveated rendering unit is operable to apply a foveated rendering process to the content to be displayed in dependence upon the characteristics determined by the user profile analysis unit.

5. The foveated rendering system according to claim 1 , wherein the foveated rendering unit is operable to apply a foveated rendering process to content to be displayed that has already been subjected to a foveated rendering process.

6. The foveated rendering system according to claim 1 , comprising a gaze detection arrangement operable to detect a user's gaze direction,

wherein the foveated rendering unit is operable to apply a foveated rendering process to the content to be displayed in dependence upon the user's detected gaze direction.

7. The foveated rendering system according to claim 1 , wherein the foveated rendering unit is operable to modify the size and location of high-quality image regions in the processed image in dependence upon obtained user profile information.

8. The foveated rendering system according to claim 7 , wherein the size and location of high-quality image regions are dependent upon head motion and eye motion used by a user in performing one or more viewing transitions between regions of the displayed content.

9. The foveated rendering system according to claim 1 , wherein high-quality image regions comprise one or more of an increased resolution, increased number of colours, increased frame rate, and/or an increased use of three-dimensional imagery.

10. A foveated rendering method for modifying content to be displayed, the method comprising:

obtaining the user profile comprising user profile information about head motion and eye motion for a user; and

applying a foveated rendering process to the content to be displayed; and

determining characteristics of one or more groups of users in dependence upon the obtained user profiles,

wherein the foveated rendering process is dependent on the user profile information obtained from the user profile, and

wherein at least one of:

(i) the determining characteristics step includes identifying characteristics that correspond to an above-threshold number of users representing the group of all users, and

(ii) the determining characteristics step includes identifying one or more groups of users according to shared characteristics between user profiles, and the foveated rendering process includes applying the foveated rendering process to the content to be displayed in dependence upon the characteristics determined by the determining characteristics step so as to generate a processed content to be displayed for each group.

11. A non-transitory, machine-readable storage medium which stores computer software, which when executed by a computer, causes the computer to carry out actions for modifying content to be displayed, the actions comprising:

obtaining the user profile comprising user profile information about head motion and eye motion for a user; and

applying a foveated rendering process to the content to be displayed; and

determining characteristics of one or more groups of users in dependence upon the obtained user profiles,

wherein the foveated rendering process is dependent on the user profile information obtained from the user profile, and

wherein at least one of:

(i) the determining characteristics step includes identifying characteristics that correspond to an above-threshold number of users representing the group of all users, and

(ii) the determining characteristics step includes identifying one or more groups of users according to shared characteristics between user profiles, and the foveated rendering process includes applying the foveated rendering process to the content to be displayed in dependence upon the characteristics determined by the determining characteristics step so as to generate a processed content to be displayed for each group.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2019
From: WALKER, ANDREW WILLIAM
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 050678/0807 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: SANDERS, MATTHEW WILLIAM; WILLIAMS, NIGEL JOHN; FORSTER, RICHARD JAMES; GRANT, JESSICA ROSE
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 050261/0705 →
Priority Claims (1)
GB 1814507 · Sep 6, 2018 · national
Continuity (1)
Related Publication 20200082794A1 · Mar 12, 2020