IP Library › Granted Patent US 11,951,394
Granted Patent B2
US 11,951,394 · App. 17/235,528 · Granted Apr 9, 2024

Apparatus and method for acquiring in-game 360 VR image by using plurality of virtual cameras

Inventors: Junhwan Jang (Goyang-si, KR); Woochool Park (Incheon, KR); Jinwook Yang (Uijeongbu-si, KR); Sangpil Yoon (Seoul, KR); Minsu Choi (Seoul, KR); Junsuk Lee (Seoul, KR); Suho Song (Pyeongtaek-si, KR); Bonjae Koo (Suwon-si, KR)
Assignee: Korea Electronics Technology Institute
A63F13/5252H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,951,394
App. No.
17/235,528
Granted
Apr 9, 2024
Kind
B2
Abstract

An image acquisition apparatus for acquiring an in-game 360 virtual reality (VR) image by using a plurality of virtual cameras includes a virtual camera group taking in-game images by using the plurality of virtual cameras. The image acquisition apparatus may also include a renderer generating textures for the taken images, generating a panoramic image by performing an equirectangular projection (ERP) mapping of the generated textures, and encoding the generated panoramic image. The image acquisition apparatus may further include an image generator generating a 360 VR image by combining audio information with the encoded panoramic image.

Claims (23)

1. An in-game 360 virtual reality (VR) image acquisition apparatus using a plurality of virtual cameras, the apparatus comprising:

a virtual camera group configured to take in-game images by using the plurality of virtual cameras;

a renderer configured to generate textures for the taken images, generate a panoramic image by performing an equirectangular projection (ERP) mapping of the generated textures, and encode the generated panoramic image; and

an image generator configured to generate a 360 VR image by combining audio information with the encoded panoramic image, and further configured to video-stream the generated 360 VR image and output the video-streamed 360 VR image to an outside of the apparatus,

wherein in the virtual camera group, omni-direction from a reference point for taking the images is divided into N (N is a natural number greater than 4), and a pair of left and right virtual cameras are arranged in each of N directions.

2. The apparatus of claim 1 , wherein in the virtual camera group, omni-direction from a reference point for taking the images is divided into 4, the pair of left and right virtual cameras are arranged in each direction facing front, back, left, and right from a reference point for taking the images, and wherein the pair of left and right virtual cameras are arranged in each direction facing top and bottom of the front.

3. The apparatus of claim 2 , wherein the respective virtual cameras of the virtual camera group are arranged to have an angle of π/2.

4. The apparatus of claim 1 , top and bottom virtual cameras are arranged in each of the N directions.

5. The apparatus of claim 1 , wherein the respective virtual cameras of the virtual camera group are arranged to have an angle of 2π/N.

6. The apparatus of claim 1 , wherein the renderer includes:

a texture generator configured to capture the images and generate textures for the respective images;

a general-purpose computing on graphics processing unit (GPGPU) ERP engine configured to perform ERP mapping of the generated textures by using pixel mapping data indicating a location of a pixel to be mapped, and generate the panoramic image through the ERP mapping; and

an encoder configured to encode the generated panoramic image for each frame.

7. The apparatus of claim 6 , wherein the GPGPU ERP engine is configured to perform respective steps in a parallel structure of a pipeline scheme.

8. The apparatus of claim 6 , wherein the GPGPU ERP engine is configured to generate in advance the pixel mapping data in an initialization process.

9. The apparatus of claim 6 , wherein the GPGPU ERP engine is configured to get a writer from a circular buffer disposed between the GPGPU ERP engine and the encoder to perform the ERP mapping.

10. An image acquisition method to be performed in an in-game 360 virtual reality (VR) image acquisition apparatus using a plurality of virtual cameras, the method, comprising:

at an image acquisition apparatus, taking in-game images by using a virtual camera group comprising a plurality of virtual cameras;

at the image acquisition apparatus, generating textures for the taken images, generating a panoramic image by performing an equirectangular projection (ERP) mapping of the generated textures, and encoding the generated panoramic image;

at the image acquisition apparatus, generating a 360 virtual reality (VR) image by combining audio information with the encoded panoramic image;

at the image acquisition apparatus, video-streaming the generated 360 VR image; and

at the image acquisition apparatus, outputting the video-streamed 360 VR image to an outside of the image acquisition apparatus,

wherein in the virtual camera group, omni-direction from a reference point for taking the images is divided into N (N is a natural number greater than 4), and a pair of left and right virtual cameras are arranged in each of N directions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2021
From: JANG, JUNHWAN; PARK, WOOCHOOL; YANG, JINWOOK; YOON, SANGPIL; CHOI, MINSU; LEE, JUNSUK; SONG, SUHO; KOO, BONJAE
To: KOREA ELECTRONICS TECHNOLOGY INSTITUTE
Reel/Frame 055979/0276 →
Priority Claims (1)
KR 10-2018-0125822 · Oct 22, 2018 · national
Continuity (2)
Continuation PCTKR2018014568 · Nov 23, 2018
Related Publication 20210236929A1 · Aug 5, 2021
Cited By (1)
US 12,541,834