IP Library › Patent Application 19026225
Patent Application
App. No. 19/026,225

CONCEPT FOR PICTURE/VIDEO DATA STREAMS ALLOWING EFFICIENT REDUCIBILITY OR EFFICIENT RANDOM ACCESS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/026,225
Abstract

A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

Claims (90)

1 . A non-transitory digital storage medium having stored thereon a video data stream representing a video comprising

a parameter set portion indicating coding parameter settings;

a payload portion into which pictures of the video are coded in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,

wherein the video data stream comprises an information comprising

an indication of a predetermined subarea of the pictures, and

replacement parameters for adjusting the first set of coding parameter settings so as to result in a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,

wherein the second set of coding parameters are selected so that a reduced video data stream modified compared to the video data stream by

removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and

changing location indications in the payload portion so to indicate a location in a manner measured from a circumference of the predetermined subarea instead of the pictures, comprises a reduced payload portion having encoded thereinto subarea-specific pictures showing the predetermined subarea of the pictures in a manner parameterized using the second set of coding parameter settings,

wherein the video data stream and the reduced video data stream are conforming to HEVC, and

wherein the coding parameter settings define one or more of

picture size,

tile structure,

buffer size and timing.

2 . The non-transitory digital storage medium according to claim 1 wherein the parameter set portion is comprised by at least one of SPS NAL units and VPS NAL units and PPS NAL units.

3 . The non-transitory digital storage medium according to claim 1 wherein the indices are comprised in slice headers of slices of the payload portion, each slice having encoded thereinto a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

4 . The non-transitory digital storage medium stream according to claim 1 wherein

a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of

picture size,

tile structure,

buffer size and timing.

5 . An encoder for encoding a video into a video data stream, comprising

a parameter setter configured to determine coding parameter settings and generate a parameter set portion of the video data stream indicating the coding parameter settings;

a coding core configured to encode pictures of the video into a payload portion of the video data stream in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,

wherein the encoder is configured to provide the video data stream with an information comprising

an indication of a predetermined subarea of the pictures, and

replacement parameters for adjusting the first set of coding parameter settings so as to result in a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,

wherein the second set of coding parameters are selected so that a reduced video data stream modified compared to the video data stream by

removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and

changing location indications in the payload portion so to indicate a location in a manner measured from a circumference of the predetermined subarea instead of the pictures, comprises a reduced payload portion having encoded thereinto subarea-specific pictures showing the subarea of the pictures in a manner parameterized using the second set of coding parameter settings,

wherein the video data stream and the reduced video data stream are conforming to HEVC,

wherein the coding parameter settings define one or more of

picture size,

tile structure,

buffer size and timing.

6 . The encoder according to claim 5 wherein the parameter set portion is comprised by one or more of SPS NAL units and VPS NAL units and PPS NAL units.

7 . The encoder according to claim 5 wherein the encoder is configured to insert the indices into slice headers of slices of the payload portion, and to encode into each slice a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

8 . The encoder according to claim 5 wherein

a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of

picture size,

tile structure,

buffer timing.

9 . A device for processing a video data stream so as to be forwarded to a video decoder, the video data stream comprising

a parameter set portion indicating coding parameter settings;

a payload portion into which pictures of the video are coded in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,

wherein the device is configured to

read from the video data stream an information comprising

an indication of a predetermined subarea of the pictures, and

replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,

reduce the video data stream to a reduced video data stream modified by

performing the redirection and/or adjustment so that the second set of coding parameter settings is indexed by the payload portion's indices;

removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and

changing location indications in the payload portion so to indicate a location measured from a circumference of the predetermined subarea instead of the pictures,

so that the reduced video data stream comprises a reduced payload portion which has encoded thereinto subarea-specific pictures showing the predetermined subarea of the pictures in a manner parameterized using the second set of coding parameter settings,

wherein the video data stream and the reduced video data stream are conforming to HEVC,

wherein the coding parameter settings define one or more of

picture size,

tile structure,

buffer size and timing.

10 . The device according to claim 9 wherein the parameter set portion is comprised by one or more of SPS NAL units and VPS NAL units and PPS NAL units.

11 . The device according to claim 9 wherein the device is configured to locate the indices in slice headers of slices of the payload portion, each slice having encoded thereinto a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

12 . The device according to claim 9 wherein

a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of

picture size,

tile structure,

buffer size and timing.

13 . The device according to claim 9 wherein the device is one of

a video decoder capable of decoding the video data stream and the reduced video data stream,

a video decoder a profile level of which suffices for the video decoder to be capable of decoding the reduced video data stream, but the profile level of which is insufficient so that the video decoder is unable to decode the video data stream, and

a network device configured to forward, depending on a control signal, one of the video data stream and the reduced video data stream to a video decoder.

14 . The device according to claim 9 , wherein the video data stream comprises a displacing information which indicates for a set of at least one predetermined subregions of the pictures a displacement of the set of at least one predetermined subregions within a target picture area relative to an undisplaced copying of the set of at least one predetermined subregions into the target picture area, and

the device is configured to modify the displacing information into modified displacing information so that the subarea-specific pictures, copied into the target picture area with having predetermined subregions of the subarea-specific pictures displaced according to the modified displacing information, coincides within the target picture area with the predetermined subarea of the pictures copied into the target picture area with the set of at least one predetermined subregion of the pictures displaced according to the displacing information, and, in reducing the video data stream, replace the displacing information with the modified displacing information, or

the modified displacing information is comprised by the video data stream associated with the predetermined subarea of the pictures and the displacing information is comprised by the video data stream associated with the pictures and the device is configured to, in reducing the video data stream, remove the displacing information and carry over the modified displacing information into the reduced video data stream so as to be associated with the subarea-specific pictures.

15 . A Apparatus for processing a video, the apparatus comprising a processor configured to

receive a data stream into which a picture of a video is coded, and

read, as part of displacing information in the data stream, read, as part the displacing information, from the data stream

a count of predetermined subregions within the picture,

size parameters defining a size of a target picture area, the target picture area representing a cubic projection of the panoramic scene,

for each predetermined subregion of the predetermined subregions of the picture,

a width, a height, a top sample row and a left-most sample column of the respective predetermined subregion in the target region and

a further width, a further height, a further top sample row and a further left-most sample column of the respective predetermined region within the picture, and

wherein the displacing information allows for

deriving the target picture area from the picture by

displacing each of the predetermined subregions of the picture according to the width, the height, the top sample row and the left-most sample column of the respective predetermined subregion of the picture within the target picture and the further width, the further height, the further top sample row and the further left-most sample column of the respective predetermined subregion of the picture within the picture, as read for the respective predetermined subregion, and

filling, according to default filling information comprised in the data stream, a portion of the target picture area where none of the predetermined subregions of the picture is displaced to according to the displacing information.

16 . The apparatus according to claim 15 , wherein the set of at least one subregion of the picture is a subset of a gapless and overlap-free spatial partitioning of the picture into an array of subregions.

17 . The apparatus according to claim 15 , wherein the displacing information comprises

for each predetermined subregion of the set of at least one predetermined subregion of the picture,

information on a rotation and information on a mirroring when mapping the respective predetermined subregion between the target region and the picture.

18 . The apparatus according to claim 15 , wherein the data stream has a sequence of pictures encoded thereinto, wherein the displacing information is valid for the sequence of pictures.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2025
From: SKUPIN, ROBERT; SÁNCHEZ DE LA FUENTE, YAGO; SCHIERL, THOMAS; HELLGE, CORNELIUS; GRUENEBERG, KARSTEN; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 070000/0044 →