IP Library Granted Patent US 10,951,871
Granted Patent B2
US 10,951,871 · App. 16/467,618 · Granted Mar 16, 2021

Generation device, identification information generation method, reproduction device, and image reproduction related to stereo packing of projected frames

Inventors: Ryohei Takahashi (Kanagawa, JP); Mitsuhiro Hirabayashi (Tokyo, JP); Teruhiko Suzuki (Kanagawa, JP); Ohji Nakagami (Tokyo, JP)
Assignee: SONY CORPORATION
H04N13/111H04N13/122H04N13/349H04N13/359H04N13/361
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,951,871
App. No.
16/467,618
Granted
Mar 16, 2021
Kind
B2
Abstract

There is provided a generation device, an identification information generation method, a reproduction device, and an image reproduction method capable of identifying a packing scheme. Stereo packing identification information for identifying a scheme of packing is generated with regard to a plurality of region images of a celestial sphere image packed in a packed frame. In a case in which packing is performed by one of a plurality of packing schemes, stereo packing identification information indicating a packing method can be generated, a projected frame can be generated easily on the basis of the identification information, and the projected frame can be rendered. The present technology can be applied to a case in which a celestial sphere stereoscopic image is transmitted to be reproduced on a reception side.

Claims (37)

1. A file generation device comprising:

a region-wise packing processing unit configured to generate a packed frame for an image comprising information of two projected frames by determining whether or not to perform a region-wise packing process of arranging a plurality of region images of each projected frame of the two projected frames in the packed frame; and

a file generation unit configured to generate a file including

the packed frame,

information indicating whether or not the region-wise packing process is performed for each packed frame, and

for each packed frame that the region-wise packing process is performed, information indicating a packing type of the region-wise packing process performed for arranging the plurality of region images of each projected frame,

wherein the two projected frames include a first projected frame corresponding to a first omnidirectional image and a second projected frame corresponding to a second omnidirectional image,

wherein the packing type is selected from among

either a monoscopic packing type or a first stereoscopic packing type in which the plurality of region images of the first projected frame are arranged in a first configuration and the plurality of region images of the second projected frame are arranged in a second configuration in different areas of the packed frame, wherein either the monoscopic packing type or the first stereoscopic packing type is determined using a same information indicating the packing type according to whether the image is monoscopic or stereoscopic, or

a second stereoscopic packing type in which the plurality of region images of the first projected frame and the plurality of region images of the second projected frame are interspersed in the packed frame, and

wherein the region-wise packing processing unit and the file generation unit are each implemented via at least one processor.

2. The file generation device according to claim 1 , wherein the region-wise packing processing unit is further configured to

generate the information indicating the packing type, and

store the information indicating the packing type in a Region Mapping Box.

3. The file generation device according to claim 1 ,

wherein the region-wise packing process of the first stereoscopic packing type is performed such that the first configuration and the second configuration are identical.

4. A file generation method, implemented via at least one processor, the method comprising:

generating a packed frame for an image comprising information of two projected frames by determining whether or not to perform a region-wise packing process of arranging a plurality of region images of each projected frame of the two projected frames in the packed frame; and

generating a file including

the packed frame,

information indicating whether or not the region-wise packing process is performed for each packed frame, and

for each packed frame that the region-wise packing process is performed, information indicating a packing type of the region-wise packing process performed for arranging the plurality of region images of each projected frame,

wherein the two projected frames include a first projected frame corresponding to a first omnidirectional image and a second projected frame corresponding to a second omnidirectional image, and

wherein the packing type is selected from among

either a monoscopic packing type or a first stereoscopic packing type in which the plurality of region images of the first projected frame are arranged in a first configuration and the plurality of region images of the second projected frame are arranged in a second configuration in different areas of the packed frame, wherein either the monoscopic packing type or the first stereoscopic packing type is determined using a same information indicating the packing type according to whether the image is monoscopic or stereoscopic, or

a second stereoscopic packing type in which the plurality of region images of the first projected frame and the plurality of region images of the second projected frame are interspersed in the packed frame.

5. A client device comprising:

a file acquisition unit configured to acquire a file including a packed frame for an image comprising information of two projected frames; and

a decoder configured to decode the packed frame for the image comprising information of the two projected frames by determining whether or not the packed frame was generated by performing a region-wise packing process of arranging a plurality of region images of each projected frame of the two projected frames in the packed frame,

wherein the file further includes

information indicating whether or not the region-wise packing process is performed for each packed frame, and

for each packed frame that the region-wise packing process is performed, information indicating a packing type of the region-wise packing process performed for arranging the plurality of region images of each projected frame,

wherein the two projected frames include a first projected frame corresponding to a first omnidirectional image and a second projected frame corresponding to a second omnidirectional image,

wherein the packing type is selected from among

either a monoscopic packing type or a first stereoscopic packing type in which the plurality of region images of the first projected frame are arranged in a first configuration and the plurality of region images of the second projected frame are arranged in a second configuration in different areas of the packed frame, wherein either the monoscopic packing type or the first stereoscopic packing type is determined using a same information indicating the packing type according to whether the image is monoscopic or stereoscopic, or

a second stereoscopic packing type in which the plurality of region images of the first projected frame and the plurality of region images of the second projected frame are interspersed in the packed frame, and

wherein the file acquisition unit and the decoder are each implemented via at least one processor.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2019
From: TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO; SUZUKI, TERUHIKO; NAKAGAMI, OHJI
To: SONY CORPORATION
Reel/Frame 049402/0876 →
Cited By (2)
US 12,323,626 US 12,526,471