IP Library Granted Patent US 11,037,363
Granted Patent B2
US 11,037,363 · App. 16/624,504 · Granted Jun 15, 2021

Content modification device and method

Inventor: Jason Gordon Doig (London, GB)
Assignee: Sony Interactive Entertainment Inc.
G06T15/20G06T5/009G06T15/04G06T15/506G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,037,363
App. No.
16/624,504
Granted
Jun 15, 2021
Kind
B2
Abstract

A content modification system for modifying computer-generated content, the system including a rendering unit operable to render an image for display in dependence upon content to be rendered, an information output unit operable to output viewpoint data for the rendered images, the viewpoint data comprising information enabling the viewpoint to be reconstructed at a later time, a viewpoint reconstruction unit operable to generate an image to be displayed using the outputted viewpoint data, an image modifying unit operable to modify the generated image; and a content modifying unit operable to modify the content to be rendered in dependence upon the modifications to the generated image.

Claims (31)

1. A content modification system for modifying computer-generated content, the system comprising:

a rendering unit operable to render an image for display in dependence upon content to be rendered;

an information output unit operable to output viewpoint data for the rendered image, the viewpoint data comprising information enabling the viewpoint to be reconstructed at a later time;

a viewpoint reconstruction unit operable to generate an image to be displayed using the outputted viewpoint data;

an image modifying unit operable to modify the generated image; and

a content modifying unit operable to modify the content to be rendered in dependence upon the modifications to the generated image,

wherein the content modifying unit is operable to apply a colour grading and/or tone mapping effect to the content to be rendered.

2. A system according to claim 1 , wherein the viewpoint data comprises information describing lighting conditions within a virtual scene described by the content to be rendered.

3. A system according to claim 2 , wherein the information describing lighting conditions is represented by data that comprises information about a plurality of related viewpoints.

4. A system according to claim 1 , wherein the rendering unit is located in an entertainment device, and the viewpoint reconstruction unit is located in a separate processing device.

5. A system according to claim 4 , wherein the entertainment device and the processing device are operable to display content in parallel.

6. A system according to claim 4 , wherein modifications to the content are input using the processing device and are implemented by the entertainment device.

7. A system according to claim 1 , wherein the content modifying unit is operable to change the location and/or light output characteristics of objects within a virtual scene described by the content to be rendered.

8. A system according to claim 1 , wherein the viewpoint data comprises a screenshot of the rendered view.

9. A system according to claim 1 , wherein virtual cameras each defining a viewpoint are arranged within a virtual scene described by content to be rendered.

10. A system according to claim 9 , wherein the virtual cameras are arranged to represent the most common viewpoints within the virtual scene.

11. A system according to claim 1 , wherein the modification of the content to be rendered is dependent on a viewpoint for which the content is to be rendered.

12. A content modification method for modifying computer-generated content, the method comprising:

rendering an image for display in dependence upon content to be rendered;

outputting viewpoint data for the rendered image, the viewpoint data comprising information enabling the viewpoint to be reconstructed at a later time;

generating an image to be displayed using the outputted viewpoint data;

modifying the generated image; and

modifying the content to be rendered in dependence upon the modifications to the generated image,

wherein the modifying the content includes applying a colour grading and/or tone mapping effect to the content to be rendered.

13. A machine-readable non-transitory storage medium which stores computer software, which when executed by a computer, causes the computer to perform a content modification method for modifying computer-generated content by carrying out actions, comprising:

rendering an image for display in dependence upon content to be rendered;

outputting viewpoint data for the rendered image, the viewpoint data comprising information enabling the viewpoint to be reconstructed at a later time;

generating an image to be displayed using the outputted viewpoint data;

modifying the generated image; and

modifying the content to be rendered in dependence upon the modifications to the generated image,

wherein the modifying the content includes applying a colour grading and/or tone mapping effect to the content to be rendered.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: DOIG, JASON
To: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
Reel/Frame 052923/0535 →
CHANGE OF NAME Recorded Jun 12, 2020
From: SONY COMPUTER ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
Reel/Frame 052923/0549 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052923/0566 →
Priority Claims (1)
GB 1710484 · Jun 30, 2017 · national
Continuity (1)
Related Publication 20200175749A1 · Jun 4, 2020