Methods and apparatus for multi-encoder processing of high resolution content
Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
1. A method for storing and/or transmitting image content, the method comprising:
capturing image content via a plurality of image capture apparatus;
generating a projection from the image content;
splitting up the projection into a plurality of image segments, the plurality of image segments comprising a corresponding plurality of 270° contiguous segments, each of the corresponding plurality of 270° contiguous segment being divisible into a respective plurality of sub-segments;
encoding a first one of the plurality of 270° contiguous segments via a first one of a plurality of encoders, and encoding a second one of the plurality of 270° contiguous segments via a second one of the plurality of encoders, the encoding of the first and second ones of the plurality of 270° contiguous segments comprising generating one or more encoded data containers; and
transmitting the one or more encoded data containers.
2. The method of claim 1 , wherein the capturing of the image content comprises capturing a plurality of fisheye images; and
wherein the generating of the projection comprises stitching the fisheye images into a spherical projection.
3. The method of claim 2 , wherein the generating of the projection comprises re-mapping the spherical projection into a cubic projection.
4. The method of claim 3 , wherein the re-mapping of the spherical projection into the cubic projection comprises using a lossless mathematical transform.
5. The method of claim 3 , wherein the splitting up of the projection into a plurality of image segments comprises:
generating a first image segment from a first portion of the respective plurality of sub-segments, the first portion comprising a first subset of facets of the cubic projection; and
generating a second image segment from a second portion of the respective plurality of sub-segments, the second portion comprising a second subset of facets of the cubic projection.
6. The method of claim 2 , wherein the stitching of the fisheye images into the spherical projection further comprises generating a stitching metadata file.
7. The method of claim 6 , wherein the stitching of the fisheye images into a spherical projection comprises using lossy mathematical algorithm; and
wherein the stitching metadata file comprises recovery information, the recovery information comprising image data associated with the captured plurality of fisheye images.
8. A camera apparatus, comprising:
a plurality of image capture components;
one or more encoding logic;
an image signal processor apparatus; and
a non-transitory computer readable medium comprising one or more instructions which are configured to, when executed by the image signal processor apparatus, cause the camera apparatus to:
cause the plurality of image capture components to capture a plurality of images;
stitch the plurality of images into a spherical projection;
re-map the spherical projection into a cubic projection;
split the cubic projection into two image segments such that each of the two image segments comprises one of at least two contiguous 270° images, each of the at least two contiguous 270° images being derived from a respective one of the plurality of image capture components;
arrange the at least two contiguous 270° images, wherein a single area of discontinuity exists between two of the at least two contiguous 270° images;
encode each of the at least two contiguous 270° images via a corresponding one of the one or more encoding logic into one or more encoded data containers; and
transmit the one or more encoded data containers.
9. The camera apparatus of claim 8 , wherein the plurality of image capture components comprise a first fisheye camera and a second fisheye camera in a Janus-type configuration.
10. The camera apparatus of claim 8 , wherein the one or more encoding logic comprises a first High Efficiency Video Coding (HEVC) codec supporting images not exceeding 4096 pixels in width and 2160 pixels in height.
11. The camera apparatus of claim 8 , wherein the two image segments each comprise a first dimension of at least 4000 pixels and a second dimension of at least 1000 pixels.
12. The camera apparatus of claim 8 , wherein the re-map of the spherical projection into the cubic projection comprises a lossless transform.
13. A post-processing device, comprising:
a plurality of decoding logic;
a user interface configured to select a view angle;
a processor apparatus; and
a non-transitory computer readable medium comprising one or more instructions which are configured to, when executed by the processor apparatus, cause the post-processing device to:
receive at least one encoded data container, the at least one encoded data container comprising a plurality of tracks;
decode the at least one encoded data container into at least a first 270° image segment and a second 270° image segment via respective ones of the plurality of decoding logic;
fast stitch the first and second 270° image segments into a cubic projection, said cubic projection comprising a single boundary within the cubic projection, the single boundary disposed between the first and second 270° image segments; and
re-map the cubic projection into a spherical projection.
14. The post-processing device of claim 13 , wherein the one or more decoding logic comprises a first High Efficiency Video Coding (HEVC) codec supporting images not exceeding 4096 pixels in width and 2160 pixels in height.
15. The post-processing device of claim 13 , wherein the non-transitory computer readable medium further comprises one or more instructions which are configured to, when executed by the processor apparatus, cause the post-processing device to:
receive stitching metadata; and
recover at least one image from the spherical projection based at least on the stitching metadata.
16. The post-processing device of claim 13 , wherein the spherical projection is characterized by a 5376 pixel horizon; and
wherein the non-transitory computer readable medium further comprises one or more instructions which are configured to, when executed by the processor apparatus, cause the post-processing device to:
upscale the spherical projection to a 5760 pixel horizon.
17. The post-processing device of claim 16 , further comprising:
a user interface configured to select a view angle; and
wherein the non-transitory computer readable medium further comprises one or more instructions which when executed by the processor is configured to:
receive the view angle via the user interface; and
generate a 120° panorama from the spherical projection.
18. The post-processing device of claim 16 , wherein the non-transitory computer readable medium further comprises one or more instructions which are configured to, when executed by the processor apparatus, cause the post-processing device to generate a 360° panorama from the spherical projection.
19. The camera apparatus of claim 10 , wherein the cubic projection comprises an equal area cubic (EAC) cubic projection comprising a plurality of facets, each of the plurality of facets comprising a width of at least 1,000 pixels and a height of at least 1,000 pixels.
20. The camera apparatus of claim 19 , wherein the width and the height of each of the plurality of facets each consists of 1,344 pixels.