IP Library Granted Patent US 8,400,497
Granted Patent B2
US 8,400,497 · App. 12/206,443 · Granted Mar 19, 2013

Method and apparatus for generating stereoscopic file

Inventors: Gun-Ill Lee (Seoul, KR); Jae-Yeon Song (Seoul, KR); Seo-Young Hwang (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,400,497
App. No.
12/206,443
Granted
Mar 19, 2013
Kind
B2
Abstract

A method and apparatus for generating a stereoscopic file defined based on a conventional International Standardization Organization (ISO) based media file format. The apparatus includes an encoder encoding first video data and second video data that are included in three-dimensional (3D) video data; and a file generating unit arranging the encoded first video data and second video data according to the information of a stereoscopic file format including boxes that are selected from boxes included in a conventional International Standardization Organization (ISO) based media file format in order to store and generate the stereoscopic file, and generating the stereoscopic file.

Claims (292)

1. An apparatus for generating a stereoscopic file, the apparatus comprising:

an encoder encoding first video data and second video data that are included in three-dimensional (3D) video data; and

a file generating unit arranging the encoded first video data and second video data according to the information of a stereoscopic file format including boxes that are selected from boxes included in a conventional International Standardization Organization (ISO) based media file format in order to store in a memory and generate the stereoscopic file, and generating the stereoscopic file,

wherein the stereoscopic file comprises a value indicating the structure thereof,

wherein the value indicates one of a first type representing stereoscopic content with one elementary stream and a second type representing stereoscopic content with two elementary streams, and

wherein the stereoscopic file includes an sedi box for stereoscopic camera and display safety information and a svmi box for stereoscopic video media information.

2. The apparatus of claim 1 , wherein the stereoscopic file format has a structure defined by

ftyp

file type and compatibility

moov

container for all the metadata

mvhd

movie header

trak

container for an individual

track or stream

tkhd

track header

mdia

container for media data

information track

mdhd

media header

hdlr

handler, declares the

media(handler)type

minf

media information container

vmhd

video media header

smhd

sound media header

hmhd

Null media header

nmhd

data information box

dinf

data reference box

dref

hint media header

stbl

sample description box

stsd

sample descriptions

stts

(decoding) time-to-sample

stsc

Sample-to-chunk

stsz

samples sizes

stco

chunk offset

mdat

media data container

wherein the ftyp box indicates a file type and compatibility, the moov box includes all metadata relating to media data, the mvhd box indicates a movie header the trak box is a container for each track of stream, the tkhd box is a track header including general information regarding a track, the mdia box is a container for media data information included in a track, the mdhd box indicates a media header, the hdlr box is a handler defining a type of media, the minf box is a container for the media data information, the vmhd box includes video media header information, the smhd box includes sound media header information, the hmhd box includes hint media header information, the nmhd box includes Null media header information, the dinf box is a data information container, the dref box is a data reference box defining sources of media in a track, the stbl box is a sample table box, the stsd box is a sample description box for information, the stts box indicates a decoding type of a sample, the stsc box is a sample-to-chunk box indicating a location where a sample bitstream is stored, the stsz box indicates bitstream sizes of samples, the stco box is a chunk offset box indicating where a sample bitstream is stored, and the mdat box is a container including media data.

3. The apparatus of claim 2 , wherein the stereoscopic file comprises two elementary streams (ESs) each including left view video data and right view video data.

4. The apparatus of claim 2 , wherein the stereoscopic file comprises an elementary stream (ES) in which samples or frames of the left view video data and samples or frames of the right view video data are interleaved in a frame unit and arranged.

5. The apparatus of claim 2 , wherein the stereoscopic file has a structure for stereoscopic content including stereoscopic data.

6. The apparatus of claim 1 , wherein the stereoscopic file format has a structure defined by

ftyp

file type and compatibility

pdin

Progressive download

information

moov

container for all the metadata

mvhd

movie header

trak

container for an individual

track or stream

tkhd

track header

tref

track reference container

edts

edit list container

elst

an edit list

mdia

container for media data

information track

mdhd

media header

hdlr

handler, declares the

media(handler)type

minf

media information container

vmhd

video media header

smhd

sound media header

hmhd

Null media header

nmhd

data information box

dinf

data reference box

dref

hint media header

stbl

sample description box

stsd

sample descriptions

stts

(decoding) time-to-sample

stsc

Sample-to-chunk

stsz

samples sizes

stz2

compact sample sizes

stco

chunk offset, partical

data-offset information

co64

64-bit chunk offset

stss

sync sample table (random

access point)

ipmc

IPMP Control Box

mdat

media data container

meta

metadata

hdlr

handler, declares the

media(handler)type

iloc

item location

iinf

item information

xml

XML container

bxml

binary XML container

scdi

stereoscopic camera and

display information

svmi

stereoscopic video media

information

wherein the ftyp box indicates a file type and compatibility, the pdin box includes information necessary to download a file, the moov box is a container for media data, the mvhd box indicates a movie header, the trak box is a container for each track or stream, the tkhd box is a track header including general information regarding a track, the tref box is a container for indicating a reference track, the edts box is an edit list container, the elst box is a box related to a presentation time line, the mdia box is a container for media data information included in a track, the mdhd box indicates a media header, the hdlr box is a handler defining a type of media, the minf box is a container for the media data information, the vmhd box includes video media header information, the smhd box includes sound media header information, the hmhd box includes hint media header information, the nmhd box includes Null media header information, the dinf box is a data information container, the dref box is a data reference box defining sources of media in a track, the stbl box is a sample table box, the stsd box is a sample description box for information, the stts box indicates a decoding type of a sample, the stsc box is a sample-to-chunk box indicating a location where a sample bitstream is stored, the stsz box indicates bitstream sizes of samples, the stz2 box indicates compact bitstream sizes of samples, the stco box is a chunk offset box indicating where a sample bitstream is stored, the co64 box is a chunk offset box represented by 64-bit, the stss box is a sync sample table box, the ipmc box is a control box related to content protection, the mdat box is a container including media data, the meta box is a container for storing additional metadata, the hdlr box is a handler box defining the type of metadata, the iloc box is a box specifying an item location, the iinf box is a box specifying item information, the xml box is a container for xml, the bxml box is a container for binary xml, the scdi box is a box for stereoscopic camera and display safety information, and the svmi box is a box for stereoscopic video media information.

7. The apparatus of claim 6 , wherein the stereoscopic file has a structure for stereoscopic content defined by assembling stereoscopic data and monoscopic data.

8. A method generating a stereoscopic file, the method comprising:

encoding first video data and second video data that are included in three-dimensional (3D) video data; and

arranging the encoded first video data and second video data according to the information of a stereoscopic file format including boxes that are selected from boxes included in a conventional International Standardization Organization (ISO) based media file format in order to store and generate the stereoscopic file, and generating the stereoscopic file,

wherein the stereoscopic file comprises a value indicating the structure of the stereoscopic file,

wherein the value indicates one of a type representing stereoscopic content with one elementary stream and a second type representing stereoscopic content with two elementary streams, and

wherein the stereoscopic file includes an sedi box for stereoscopic camera and display safety information and a svmi box for stereoscopic video media information.

9. The method of claim 8 , wherein the stereoscopic file format has a structure defined by

ftyp

file type and compatibility

moov

container for all the metadata

mvhd

movie header

trak

container for an individual

track or stream

tkhd

track header

mdia

container for media data

information track

mdhd

media header

hdlr

handler, declares the

media(handler)type

minf

media information container

vmhd

video media header

smhd

sound media header

hmhd

Null media header

nmhd

data information box

dinf

data reference box

dref

hint media header

stbl

sample description box

stsd

sample descriptions

stts

(decoding) time-to-sample

stsc

Sample-to-chunk

stsz

samples sizes

stco

chunk offset

mdat

media data container

wherein the ftyp box indicates a file type and compatibility, the moov box includes all metadata relating to media data, the mvhd box indicates a movie header, the trak box is a container for each track or stream, the tkhd box is a track header including general information regarding a track, the mdia box is a container for media data information included in a track, the mdhd box indicates a media header, the hdlr box is a handler defining a type of media, the minf box is a container for the media data information, the vmhd box includes video media header information, the smhd box includes sound media header information, the hmhd box includes hint media header information, the nmhd box includes Null media header information, the dinf box is a data information container, the dref box is a data reference box defining sources of media in a track, the stbl box is a sample table box, the stsd box is a sample description box for information, the stts box indicates a decoding type of a sample, the stsc box is a sample-to-chunk box indicating a location where a sample bitstream is stored, the stsz box indicates bitstream sizes of samples, the stco box is a chunk offset box indicating where a sample bitstream is stored, and the mdat box is a container including media data.

10. The method of claim 8 , wherein the stereoscopic file comprises two elementary streams (ESs) each including left view video data and right view video data.

11. The method of claim 8 , wherein the stereoscopic file comprises an elementary stream (ES) in which samples or frames of the left view video data and samples or frames of the right view video data are interleaved in a frame unit and arranged.

12. The method of claim 8 , wherein the stereoscopic file format has a structure defined by

ftyp

file type and compatibility

pdin

Progressive download

information

moov

container for all the metadata

mvhd

movie header

trak

container for an individual

track or stream

tkhd

track header

tref

track reference container

edts

edit list container

elst

an edit list

mdia

container for media data

information track

mdhd

media header

hdlr

handler, declares the

media(handler)type

minf

media information container

vmhd

video media header

smhd

sound media header

hmhd

Null media header

nmhd

data information box

dinf

data reference box

dref

hint media header

stbl

sample description box

stsd

sample descriptions

stts

(decoding) time-to-sample

stsc

Sample-to-chunk

stsz

samples sizes

stz2

compact sample sizes

stco

chunk offset, partical

data-offset information

co64

64-bit chunk offset

stss

sync sample table

(random access point)

ipmc

IPMP Control Box

mdat

media data container

meta

metadata

hdlr

handler, declares the

media(handler)type

iloc

item location

iinf

item information

xml

XML container

bxml

binary XML container

scdi

stereoscopic camera and

display information

svmi

stereoscopic video media

information

wherein the ftyp box indicates a file type and compatibility, the pdin box includes information necessary to download a file, the moov box is a container for media data, the mvhd box indicates a movie header, the trak box is a container for each track or stream, the tkhd box is a track header including general information regarding a track, the tref box is a container for indicating a reference track, the edts box is an edit list container, the elst box is a box related to a presentation time line, the mdia box is a container for media data information included in a track, the mdhd box indicates a media header, the hdlr box is a handler defining a type of media, the minf box is a container for the media data information, the vmhd box includes video media header information, the smhd box includes sound media header information, the hmhd box includes hint media header information, the nmhd box includes Null media header information, the dinf box is a data information container, the dref box is a data reference box defining sources of media in a track, the stbl box is a sample table box, the stsd box is a sample description box for information, the stts box indicates a decoding type of a sample, the stsc box is a sample-to-chunk box indicating a location where a sample bitstream is stored, the stsz box indicates bitstream sizes of samples, the stz2 box indicates compact bitstream sizes of samples, the stco box is a chunk offset box indicating where a sample bitstream is stored, the co64 box is a chunk offset box represented by 64-bit, the stss box is a sync sample table box, the ipmc box is a control box related to content protection, the mdat box is a container including media data, the meta box is a container for storing additional metadata, the hdlr box is a handler box defining the type of metadata, the iloc box is a box specifying an item location, the iinf box is a box specifying item information, the xml box is a container for xml, the bxml box is a container for binary xml, the scdi box is used for stereoscopic camera and display safety information, and the svmi box is used for stereoscopic video media information.

13. The method of claim 12 , wherein the stereoscopic file has a structure for stereoscopic content defined by assembling stereoscopic data and monoscopic data.

14. The method of claim 12 , wherein the stereoscopic file has a structure for stereoscopic content including stereoscopic data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2008
From: LEE, GUN-ILL; SONG, JAE-YEON; HWANG, SEO-YOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 021580/0516 →
Priority Claims (2)
KR 2007-0091144 · Sep 7, 2007 · national
KR 2008-0013705 · Feb 14, 2008 · national
Continuity (1)
Related Publication 20090066783A1 · Mar 12, 2009