IP Library › Granted Patent US 9,749,587
Granted Patent B2
US 9,749,587 · App. 15/163,644 · Granted Aug 29, 2017

Method and apparatus for generating combined video stream for multiple images

Inventors: Jeong-yeon Lim (Seoul, KR); Dong-bum Seo (Seoul, KR); Jae-seob Shin (Seoul, KR); Se-hoon Son (Seoul, KR); Hyeong-duck Kim (Suwon-si, KR)
Assignees: SK TELECOM CO., LTD.; PIXTREE, INC.
H04N7/15H04N7/147H04N7/152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,749,587
App. No.
15/163,644
Granted
Aug 29, 2017
Kind
B2
Abstract

An apparatus of generating a combined video stream of multiple images, includes: an image acquiring unit to acquire a plurality of individual video streams transmitted over multiple channels; an image information extracting unit to extract individual image codes and individual header information from each of the plurality of the individual video streams; and a bit stream generating unit to generate combined image codes by inserting individual image codes into corresponding respective positions corresponding to each of the plurality of individual video streams in a predetermined layout of a display picture, generate combined header information corresponding to the combined image codes based on respective individual header information, and generate a combined video stream including the combined image codes and the combined header information.

Claims (49)

1. An apparatus of generating a combined video stream of multiple images, the apparatus comprising:

an image acquiring unit, implemented by one or more processors, configured to acquire a plurality of individual video streams transmitted over multiple channels;

an image information extracting unit, implemented by one or more processors, configured to extract individual image codes and individual header information from each of the plurality of the individual video streams; and

a bit stream generating unit, implemented by one or more processors, configured to

generate a combined image code including the extracted individual image codes arranged as tiles in the combined image code,

generate combined header information corresponding to the combined image codes based on the extracted individual header information, and

generate a combined video stream including the combined image codes and the combined header information, the combined video stream having a predetermined layout of a display picture.

2. The apparatus of claim 1 , further comprising an audio decoding unit, implemented by one or more processors, configured to

receive a first selection information, and

decode an audio stream corresponding to one of the plurality of individual video streams based on the first selection information.

3. The apparatus of claim 1 , wherein the combined header information include an information indicating that the combined video stream includes a plurality of tiles.

4. The apparatus of claim 1 , wherein the individual header information include an information indicating an inability to perform a loop filtering across a boundary of slices.

5. The apparatus of claim 3 , wherein the tile includes one or more slices.

6. The apparatus of claim 1 , wherein

when a predetermined byte string is parsed in respective individual video streams when parsing the respective individual video streams, the predetermined byte string having been parsed is converted to a first byte string for generating the combined video stream, and

when the first byte string is found when scanning the combined video stream, the first byte string having been found is converted to the predetermined byte string.

7. The apparatus of claim 1 , wherein the individual header information includes an information indicating an inability, when encoding a motion vector in unit of prediction, to refer to another motion vector of other picture collocated with a current encoding block in the unit of prediction.

8. The apparatus of claim 1 , wherein the bit stream generating unit is configured to receive a selection information of a user to determine a size of each tile.

9. The apparatus of claim 1 , wherein the bit stream generating unit is configured to

receive a selection information of a user, and

select a screen configuration of the display picture including a plurality of tiles.

10. The apparatus of claim 9 , wherein, when the screen configuration forms no rectangle by selecting the a plurality of tiles, the bit stream generating unit is configured to receive a predetermined specific image information as a video stream corresponding to a tile coincided with a specific position in the display picture to allow the screen configuration to be formed as a rectangle.

11. The apparatus of claim 3 , wherein

a number of samples in a width direction of any one of the tiles is same as the number of samples in a width direction of a tile adjacent vertically thereto, and

the number of samples in a height direction of any one of the tiles is same as the number of samples in a height direction of a tile adjacent horizontally thereto.

12. The apparatus of claim 3 , wherein the combined header information include an information indicating a number of the tiles arranged in a width direction and an information indicating the number of the tiles arranged in a height direction in the predetermined layout.

13. A method performed by an apparatus of generating a combined video stream of multiple images, the apparatus including one or more processors to execute the method comprising:

acquiring a plurality of individual video streams transmitted over multiple channels;

extracting individual image codes and individual header information from each of the plurality of the individual video streams;

generating a combined image code including the extracted individual image codes arranged as tiles in the combined image code;

generating combined header information corresponding to the combined image codes based on the extracted individual header information; and

generating a combined video stream including the combined image codes and the combined header information, the combined video stream having a predetermined layout of a display picture.

14. The method of claim 13 , wherein the combined header information include an information indicating that the combined video stream includes a plurality of tiles.

15. The method of claim 13 , wherein the individual header information include an information indicating an inability to perform a loop filtering across a boundary of slices.

16. The method of claim 13 , wherein

when a predetermined byte string is parsed in respective individual video streams when parsing the respective individual video streams, the predetermined byte string having been parsed is converted to a first byte string for generating the combined video stream, and

when the first byte string is found when scanning the combined video stream, the first byte string having been found is converted to the predetermined byte string.

17. The method of claim 13 , wherein the individual header information include an information indicating an inability, when encoding a motion vector in unit of prediction, to refer to another motion vector of other picture collocated with a current encoding block in the unit of prediction.

18. The method of claim 14 , wherein the combined header information include an information indicating the number of the tiles arranged in a width direction and an information indicating the number of the tiles arranged in a height direction in the predetermined layout.

19. An apparatus of generating a combined video stream of multiple images, the apparatus comprising:

an image acquiring unit, implemented by one or more processors, configured to acquire a plurality of individual video streams transmitted over multiple channels;

an image information extracting unit, implemented by one or more processors, configured to extract individual image codes and individual header information from each of the plurality of the individual video streams; and

a bit stream generating unit, implemented by one or more processors, configured to

generate combined image codes by inserting the extracted individual image codes into corresponding respective positions corresponding to each of the plurality of individual video streams in a predetermined layout of a display picture,

generate combined header information corresponding to the combined image codes based on the extracted individual header information, and

generate a combined video stream including the combined image codes and the combined header information,

wherein

when a predetermined byte string is parsed in respective individual video streams when parsing the respective individual video streams, the predetermined byte string having been parsed is converted to a first byte string for generating the combined video stream, and

when the first byte string is found when scanning the combined video stream, the first byte string having been found is converted to the predetermined byte string.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2016
From: LIM, JEONG-YEON; SEO, DONG-BUM; SHIN, JAE-SEOB; SON, SE-HOON; KIM, HYEONG-DUCK
To: SK TELECOM CO., LTD.; PIXTREE, INC.
Reel/Frame 038806/0432 →
Priority Claims (2)
KR 10-2014-0001447 · Jan 6, 2014 · national
KR 10-2014-0147846 · Oct 29, 2014 · national
Continuity (2)
Continuation PCTKR2015000090 · Jan 6, 2015
Related Publication 20160269684A1 · Sep 15, 2016