IP Library Granted Patent US 8,559,798
Granted Patent B2
US 8,559,798 · App. 11/133,169 · Granted Oct 15, 2013

Image frame processing method and device for displaying moving images to a variety of displays

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,559,798
App. No.
11/133,169
Granted
Oct 15, 2013
Kind
B2
Abstract

A rendering process for rendering an image frame and a postprocess for adapting the image frame to a display are separated. A rendering processing unit 42 generates an image frame sequence by performing rendering at a predetermined frame rate regardless of a condition that the image frame should meet for output to the display. A postprocessing unit 50 subjects the image frame sequence generated by the rendering processing unit to a merge process so as to generate and output an updated image frame sequence that meets the condition. Since the rendering process and the postprocess are separated, the image frame sequence can be generated regardless of the specification of the display such as resolution and frame rate of the display.

Claims (42)

1. An image frame processing device comprising:

an interface unit for acquiring a condition that an image frame should meet for output to a display, wherein the condition is an output resolution defined depending on whether contents of images displayed on the display comprise a still image or moving images;

a rendering processing unit for performing rendering at a predetermined frame rate independent of said condition to generate an image frame sequence based on given geometry data;

a postprocessing unit for performing a predetermined process on the image frame sequence generated by said rendering processing unit, in accordance with said condition acquired by said interface unit, to generate an updated image frame sequence for the display;

a first memory storing the image frame generated by said rendering processing unit; and

a second memory used by said postprocessing unit as a work area,

wherein said rendering processing unit starts rendering a set of image frames in the image frame sequence with mutually different offsets of coordinates in a rendering space, and

wherein said postprocessing unit locates the set of image frames generated by the offset rendering in a single coordinate system and samples pixels in the coordinate system to generate an updated image frame sequence with a higher resolution and a lower frame rate than those of the image frame sequence output from said rendering processing unit, and

wherein said first memory has a capacity for storing at least one image frame generated by said rendering processing unit, the image frame temporarily stored in said first memory is transferred to said second memory, and said postprocessing unit reads out a plurality of image frames for the predetermined process from said second memory.

2. The image frame processing device according to claim 1 , further comprising:

a first memory storing the image frame generated by said rendering processing unit; and

a second memory used by said postprocessing unit as a work area,

wherein said first memory is built into the same semiconductor circuit element as at least said rendering processing unit.

3. The image frame processing device according to claim 2 , wherein a main memory is used as said second memory.

4. A rendering method of a processor, said method comprising:

acquiring a condition that an image frame should meet for output to a display, wherein the condition is an output resolution defined depending on whether contents of images displayed on the display comprise a still image or moving images;

rendering, by said processor, at a predetermined frame rate independent of the condition that an image frame sequence should meet for output to the display; and

converting, by said processor, the image frame sequence generated by said rendering into an updated image frame sequence which is dependent on said condition in postprocessing,

wherein said rendering further includes starting rendering a set of image frames in the image frame sequence with mutually different offsets of coordinates in a rendering space, and

wherein said postprocessing further includes locating the set of image frames generated by offset rendering in a single coordinate system and sampling pixels in the single coordinate system to generate an updated image frame sequence with a higher resolution and a lower frame rate than those of the image frame sequence output from said rendering step,

wherein the image frame generated by said rendering step is stored in a first memory and said postprocessing uses a second memory as a work area, and

wherein said first memory has a capacity for storing at least one image frame generated by said rendering step, the image frame temporarily stored in said first memory is transferred to said second memory, and said postprocessing includes reading out a plurality of image frames for a predetermined process from said second memory.

5. The rendering method according to claim 4 , wherein a memory storing the image frame generated by said rendering is built into a same semiconductor circuit element as said processor.

6. An image frame processing device comprising:

an interface unit for acquiring a condition that an image frame should meet for output to a display, wherein the condition is an output resolution defined depending on whether contents of images displayed on the display comprise a still image or moving images;

a rendering processing unit for performing rendering at a predetermined frame rate independent of said condition to generate an image frame sequence based on given geometry data;

a postprocessing unit for performing a predetermined process on the image frame sequence generated by said rendering processing unit, in accordance with said condition acquired by said interface unit, to generate an updated image frame sequence for the display;

a first memory storing the image frame generated by said rendering processing unit; and

a second memory used by said postprocessing unit as a work area,

wherein said rendering processing unit starts rendering a set of image frames in the image frame sequence with mutually different offsets of coordinates in a rendering space,

wherein said postprocessing unit locates the set of image frames generated by the offset rendering in a single coordinate system and blends pixels in the coordinate system to generate an updated image frame sequence with the same resolution and a lower frame rate than those of the image frame sequence output from said rendering processing unit, and

wherein said first memory has a capacity for storing at least one image frame generated by said rendering processing unit, the image frame temporarily stored in said first memory is transferred to said second memory, and said postprocessing unit reads out a plurality of image frames for the predetermined process from said second memory.

7. A non-transitory computer-readable medium having stored therein a program causing a computer to execute steps of:

acquiring a condition that an image frame should meet for output to a display, wherein the condition is an output resolution defined depending on whether contents of images displayed on the display comprise a still image or moving images;

rendering an image frame sequence on a memory based on given geometry data; and

postprocessing the image frame sequence generated by said rendering step so as to adapt it to the display,

wherein said rendering step generates the image frame sequence by performing rendering at a predetermined frame rate independent of the condition that the image frame should meet for output to the display,

said postprocessing step subjects the image frame sequence generated by the rendering step to a predetermined process so as to generate and output an updated image frame sequence that meets said condition,

wherein said rendering includes starting rendering a set of image frames in the image frame sequence with mutually different offsets of coordinates in a rendering space, and

wherein said postprocessing unit locates the set of image frames generated by the offset rendering in a single coordinate system and blends pixels in the coordinate system to generate an updated image frame sequence with the same resolution and a lower frame rate than those of the image frame sequence output from said rendering processing unit,

wherein the image frame generated by said rendering step is stored in a first memory and said postprocessing step uses a second memory as a work area, and

wherein said first memory has a capacity for storing at least one image frame generated by said rendering step, the image frame temporarily stored in said first memory is transferred to said second memory, and said postprocessing step includes reading out a plurality of image frames for a predetermined process from said second memory.

Assignments (6)
CHANGE OF NAME Recorded Sep 6, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2013
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 030733/0859 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2011
From: SONY NETWORK ENTERTAINMENT PLATFORM INC.
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 027557/0001 →
CHANGE OF NAME Recorded Dec 26, 2011
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Reel/Frame 027446/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2005
From: AOKI, SACHIYO; OHBA, AKIO; OKA, MASAAKI; SASAKI, NOBUO
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 016304/0075 →