IP Library Granted Patent US 10,945,000
Granted Patent B2
US 10,945,000 · App. 16/067,505 · Granted Mar 9, 2021

File generation apparatus and file generation method as well as reproduction apparatus and reproduction method

Inventors: Mitsuru Katsumata (Tokyo, JP); Mitsuhiro Hirabayashi (Tokyo, JP); Toshiya Hamada (Saitama, JP)
Assignee: SONY CORPORATION
H04N21/23412G06T15/04H04L65/607H04N5/76H04N5/91H04N13/00H04N13/20H04N21/21805H04N21/26258H04N21/44029H04N21/643H04N21/816H04N21/8456H04N21/85406
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,945,000
App. No.
16/067,505
Granted
Mar 9, 2021
Kind
B2
Abstract

There is provided a file generation apparatus and a file generation method as well as a reproduction apparatus and a reproduction method by which a file in which quality information of a depth-related image at least including a depth image is efficiently stored can be managed. An MPD file generation unit generates an MPD file. The MPD file is a management file that manages a file in which quality information representative of quality of a plurality of depth-related images including at least a depth image is disposed in a form divided in a plurality of tracks or subsamples and the management file in which a correspondence relationship between the respective tracks and associationID that specifies the depth-related images is described. The present disclosure can be applied when a segment file and an MPD file of a video content are distributed, for example, in a method that complies with MPEG-DASH.

Claims (53)

1. A file generation apparatus comprising:

a file generation unit configured to

generate a Media Presentation Description (MPD) file in which link information that specifies a plurality of tracks included in a quality file is described, wherein the MPD file is configured by assigning the plurality of tracks to respective plurality of quality information regarding quality of two or more depth images, and

generate a plurality of AssociationIDs for the respective plurality of tracks as access information, wherein a respective AssociationID of the plurality of AssociationIDs is information to specify a respective depth image of the two or more depth images associated with a respective quality information of the plurality of quality information corresponding to a respective track of the plurality of tracks,

wherein the file generation unit is implemented via at least one processor.

2. The file generation apparatus according to claim 1 , wherein

the MPD file describes combinations of, from among the two or more depth images and texture images corresponding to the two or more depth images, the texture images and the depth images of the two or more depth images that become use candidates upon reproduction into the MPD file.

3. The file generation apparatus according to claim 1 , wherein

the two or more depth images include an occlusion image that is a texture image of an occlusion region corresponding to the depth image.

4. The file generation apparatus according to claim 1 , wherein

the plurality of quality information of the two or more depth images is information representative of quality of a 3D image to be generated using the two or more depth images and texture images corresponding to the two or more depth images, and

in the MPD file, a correspondence relationship between the respective track and the respective AssociationID and texture image specification information for specifying the texture images is described.

5. The file generation apparatus according to claim 4 , wherein

in the MPD file, quality information of the texture images corresponding to the two or more depth images is disposed on a track different from a track of the plurality of quality information of the two or more depth images, and

in the MPD file, a correspondence relationship between the track of the quality information of the texture images and texture image specification information for specifying the texture images is described.

6. The file generation apparatus according to claim 1 , wherein

the plurality of quality information representative of the two or more depth images is disposed in a form divided in the plurality of tracks or subsamples,

in the MPD file, information that associates the subsamples and levels with each other is described, and

in the MPD file, a correspondence relationship between the levels and the plurality of AssociationIDs is described.

7. A file generation method, wherein the method includes:

generating a Media Presentation Description (MPD) file in which link information that specifies a plurality of tracks included in a quality file is described, wherein the MPD file is configured by assigning the plurality of tracks to respective plurality of quality information regarding quality of two or more depth images; and

generating a plurality of AssociationIDs for the respective plurality of tracks as access information, wherein a respective AssociationID of the plurality of AssociationIDs is information to specify a respective depth image of the two or more depth images associated with a respective quality information of the plurality of quality information corresponding to a respective track of the plurality of tracks.

8. A reproduction apparatus comprising:

an acquisition unit configured to acquire, on a basis of a Media Presentation Description (MPD) file in which link information that specifies a plurality of tracks included in a quality file is described and configured by assigning the plurality of tracks to respective plurality of quality information regarding quality of two or more depth images, the quality information of at least part of the two or more depth images,

wherein the MPD file includes a plurality of AssociationIDs for the respective plurality of tracks as access information,

wherein a respective Association ID of the plurality of Association IDs is information to specify a respective depth image of the two or more depth images associated with a respective quality information of the plurality of quality information corresponding to a respective track of the plurality of tracks, and

wherein the acquisition unit is implemented via at least one processor.

9. The reproduction apparatus according to claim 8 , wherein

bit rates of the two or more depth images are different from each other,

in the MPD file, the bit rates of the two or more depth images are described, and

the acquisition unit acquires the quality information of at least part of the two or more depth images on a basis of the bit rates of the two or more depth images and the correspondence relationship.

10. The reproduction apparatus according to claim 9 , wherein

in the MPD file, texture images corresponding to the two or more depth images are disposed,

in the MPD file, bit rates of the texture images are described, and

the acquisition unit acquires the quality information of at least part of the two or more depth images on a basis of the bit rates of the texture images.

11. The reproduction apparatus according to claim 10 , wherein

in MPD the file, a plurality of the texture images having different bit rates from each other are disposed, and

in the MPD file, the bit rates of the plurality of texture images are described.

12. The reproduction apparatus according to claim 8 , wherein

the acquisition unit selects a texture image of a reproduction target from among the plurality of texture images on a basis of bit rates of a plurality of the texture images whose bit rates are different from each other.

13. The reproduction apparatus according to claim 8 , wherein

the quality information is information representative of quality of a 3D image to be generated using texture images corresponding to the two or more depth images and the two or more depth images.

14. The reproduction apparatus according to claim 8 , wherein

combinations of, from among texture images corresponding to the two or more depth images and the two or more depth images, the texture images and the depth images of the two or more depth images that become use candidates upon reproduction are described in the MPD file, and

the acquisition unit acquires the quality information of at least part of the two or more depth images on a basis of the combinations and the correspondence relationship.

15. The reproduction apparatus according to claim 8 , further comprising:

a reproduction unit configured to reproduce a given depth image from among the two or more depth images on a basis of the quality information acquired by the acquisition unit,

wherein the reproduction unit is implemented via at least one processor.

16. A reproduction method, wherein the method includes:

acquiring, on a basis of a Media Presentation Description (MPD) file in which link information that specifies a plurality of tracks included in a quality file is described and configured by assigning the plurality of tracks to respective plurality of quality information regarding quality of two or more depth images, the quality information of at least part of the two or more depth images,

wherein the MPD file includes a plurality of AssociationIDs for the respective plurality of tracks as access information, and

wherein a respective Association ID of the plurality of Association IDs is information to specify a respective depth image of the two or more depth images associated with a respective quality information of the plurality of quality information corresponding to a respective track of the plurality of tracks.

17. The file generation apparatus according to claim 1 , wherein the respective AssociationID is included in a respective sub representation element.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2018
From: KATSUMATA, MITSURU; HIRABAYASHI, MITSUHIRO; HAMADA, TOSHIYA
To: SONY CORPORATION
Reel/Frame 046463/0446 →
Priority Claims (1)
JP JP2016-030860 · Feb 22, 2016 · national
Continuity (1)
Related Publication 20190028744A1 · Jan 24, 2019