IP Library Granted Patent US 9,939,890
Granted Patent B2
US 9,939,890 · App. 15/320,489 · Granted Apr 10, 2018

Image generation apparatus and image generation method of generating a wide viewing angle image

Inventor: Tomohiro Oto (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
G06F3/012A63F13/211A63F13/332A63F13/35A63F13/428G06T3/0018G06T15/06G06T15/20G06T19/20A63F2300/105A63F2300/6045G06T2215/16G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,939,890
App. No.
15/320,489
Granted
Apr 10, 2018
Kind
B2
Abstract

A panorama image processing unit generates a wide viewing angle image like a panorama image which is seen from a given point of view. An image conversion unit converts the generated wide viewing angle image into an image of a transmission format in which the angular resolution which is a number of pixels per unit angle centered at the point of view is adjusted in response to a ray direction toward the point of view. An image provision unit transmits the image in the transmission format in which the angular resolution is adjusted to a head-mounted display unit. The head-mounted display unit converts the received image so as to conform the image to an optical characteristic of a device and displays the image on the device.

Claims (20)

1. An image generation apparatus comprising:

a coordinate transformation unit configured to update a viewpoint position and a sight line direction of a user from information of a position and rotation of the head of the user acquired from a head-mounted display unit and perform coordinate transformation for generating an image of a wide viewing angle to be displayed on the head-mounted display unit;

an image generation unit configured to generate an image of a wide viewing angle which is seen in the updated sight line direction from the updated viewpoint position and is to be transmitted to the head-mounted display unit in accordance with the coordinate transformation by the coordinate transformation unit; and

an image conversion unit configured to convert the generated image into an image of a transmission format in which an angular resolution which is a number of pixels per unit angle centered at the point of view is adjusted in response to a ray direction toward the point of view.

2. The image generation apparatus according to claim 1 , wherein the image conversion unit converts the generated image into an image of a transmission format in which the angular resolution is adjusted so as to be uniform irrespective of the ray direction toward the point of view.

3. The image generation apparatus according to claim 1 , wherein the image conversion unit converts the generated image into an image of a transmission format in which the angular resolution is adjusted such that the angular resolution in a ray direction from an opposite position toward the point of view is higher than the angular resolution in a ray direction from an oblique position toward the point of view.

4. The image generation apparatus according to claim 1 , wherein the transmission format includes a variable parameter which is capable of adjusting the angular resolution in accordance with the ray direction toward the point of view.

5. The image generation apparatus according to claim 1 , wherein the generated image is an image of a wide viewing angle to be transmitted to the head-mounted display unit, and the transmission format is a common format which does not rely upon an optical characteristic of each individual head-mounted display unit.

6. An image generation apparatus comprising:

a coordinate transformation unit configured to update a viewpoint position and a sight line direction of a user from information of a position and rotation of the head of the user acquired from a head-mounted display unit and perform coordinate transformation for generating an image of a wide viewing angle to be displayed on the head-mounted display unit; and

a ray tracing unit configured to trace, in a reverse direction, a ray of light directed toward the updated viewpoint position to render an image of a wide viewing angle which is seen in the updated sight line direction from the updated viewpoint position and is to be transmitted to the head-mounted display unit in accordance with the coordinate transformation by the coordinate transformation unit;

the ray tracing unit generating an image in a transmission format in which an angular resolution which is a number of pixels per unit angle centered at the point of view is adjusted in response to a ray direction toward the point of view.

7. An image generation method comprising:

updating a viewpoint position and a sight line direction of a user from information of a position and rotation of the head of the user acquired from a head-mounted display unit and performing coordinate transformation for generating an image of a wide viewing angle to be displayed on the head-mounted display unit;

generating an image of a wide viewing angle which is seen in the updated sight line direction from the updated viewpoint position and is to be transmitted to the head-mounted display unit in accordance with the coordinate transformation by the performing coordinate transformation; and

converting the generated image into an image of a transmission format in which an angular resolution which is a number of pixels per unit angle centered at the point of view is adjusted in response to a ray direction toward the point of view.

8. An image generation method comprising:

updating a viewpoint position and a sight line direction of a user from information of a position and rotation of the head of the user acquired from a head-mounted display unit and performing coordinate transformation for generating an image of a wide viewing angle to be displayed on the head-mounted display unit; and

tracing, in a reverse direction, a ray of light entering the updated viewpoint position to render an image of a wide viewing angle which is seen in the updated sight line direction from the updated viewpoint position and is to be transmitted to the head-mounted display unit in accordance with the coordinate transformation by the performing coordinate transformation;

the ray tracing generating an image in a transmission format in which an angular resolution which is a number of pixels per unit angle centered at the point of view is adjusted in response to a ray direction toward the point of view.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2016
From: OTO, TOMOHIRO
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 040690/0389 →
Priority Claims (1)
JP 2014-137819 · Jul 3, 2014 · national
Continuity (1)
Related Publication 20170160796A1 · Jun 8, 2017