IP Library › Granted Patent US 12,262,035
Granted Patent B2
US 12,262,035 · App. 18/665,493 · Granted Mar 25, 2025

Concept for picture/video data streams allowing efficient reducibility or efficient random access

Inventors: Robert Skupin (Berlin, DE); Yago Sánchez De La Fuente (Berlin, DE); Thomas Schierl (Berlin, DE); Cornelius Hellge (Berlin, DE); Karsten Grueneberg (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
H04N19/33H04N19/119H04N19/132H04N19/146H04N19/167H04N19/174H04N19/34H04N19/46H04N19/70H04N19/88
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,035
App. No.
18/665,493
Granted
Mar 25, 2025
Kind
B2
Abstract

A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

Claims (18)

1. A method for encoding into a data stream a picture, the method comprising providing the data stream with a displacing information which indicates for a set of at least one predetermined subregion of the picture a displacement of the set of at least one predetermined subregion within a target picture area relative to an undisplaced copying of the set of at least one predetermined subregion into the target picture area,

wherein the displacing information comprises

a count of the predetermined subregions within the set of at least one predetermined subregions of the picture;

a size parameter defining a size of the target picture area, and

for each predetermined subregion of the set of at least one predetermined subregion of the picture, an indication of

a displacement of the respective predetermined subregion of the picture within an target picture area, and

a scaling of the respective subregion within the target picture area that results in a magnification or demagnification relative to the respective subregion,

so that each of the predetermined subregions of the set of at least one predetermined subregions of the picture within the target picture is displaceable and scalable according to the indication,

wherein the method comprises providing the data stream further with a default filling information which indicates a default filling using which a portion of the target picture area is to be filled which is not covered, according to the displacement of the set of at least one predetermined subregion as indicated by the displacing information, by any of the set of at least one predetermined subregion.

2. A non-transitory digital storage medium storing a data stream having a picture encoded thereinto, the data stream comprising

displacing information which indicates for a set of at least one predetermined subregion of the picture a displacement of the set of at least one predetermined subregion within a target picture area, wherein the displacing information comprises

a count of the predetermined subregions within the set of at least one predetermined subregions of the picture;

size parameters defining a size of the target picture area, and

for each predetermined subregion of the set of at least one predetermined subregion of the picture, an indication of

a displacement of the respective predetermined subregion of the picture within an target picture area, and

a scaling of the respective subregion within the target picture area that results in a magnification or demagnification relative to the respective subregion,

so that each of the predetermined subregions of the set of at least one predetermined subregions of the picture within the target picture is displaceable and scalable according to the indication,

wherein the data stream further comprises a default filling information which indicates a default filling using which a portion of the target picture area is to be filled which is not covered by any of the set of at least one predetermined subregion of the picture displaced according to the displacing information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2024
From: SKUPIN, ROBERT; SÁNCHEZ DE LA FUENTE, YAGO; SCHIERL, THOMAS; HELLGE, CORNELIUS; GRUENEBERG, KARSTEN; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 067437/0015 →
Priority Claims (1)
EP 16154947 · Feb 9, 2016 · regional
Continuity (5)
Continuation 18359202 · Jul 26, 2023
Continuation 17122753 · Dec 15, 2020
Continuation 16118146 · Aug 30, 2018
Continuation PCTEP2017052769 · Feb 8, 2017
Related Publication 20240305798A1 · Sep 12, 2024
References Cited (104)
US 6141034A · Mccutchen · 2000 [cited by applicant]
US 6259826B1 · Pollard et al. · 2001 [cited by applicant]
US 7588314B1 · Nisnevich et al. · 2009 [cited by applicant]
US 10244252B2 · Lim et al. · 2019 [cited by applicant]
US 10958921B2 · Skupin et al. · 2021 [cited by applicant]
US 20030095338A1 · Singh et al. · 2003 [cited by applicant]
US 20040008766A1 · Wang et al. · 2004 [cited by applicant]
US 20040239763A1 · Notea et al. · 2004 [cited by applicant]
US 20050190774A1 · Wiegand · 2005 [cited by applicant]
US 20060115001A1 · Wang et al. · 2006 [cited by applicant]
US 20060239353A1 · De et al. · 2006 [cited by applicant]
US 20060250505A1 · Gennetten et al. · 2006 [cited by applicant]
US 20070041611A1 · Hersch et al. · 2007 [cited by applicant]
US 20070154072A1 · Taraba et al. · 2007 [cited by applicant]
US 20090041130A1 · Yoon et al. · 2009 [cited by applicant]
US 20090074070A1 · Mn et al. · 2009 [cited by applicant]
US 20090290009A1 · Suzuki et al. · 2009 [cited by applicant]
US 20100046803A1 · Tomita · 2010 [cited by applicant]
US 20100128801A1 · Hashimoto · 2010 [cited by applicant]
US 20100169349A1 · Zou et al. · 2010 [cited by applicant]
US 20100253793A1 · Auberger et al. · 2010 [cited by applicant]
US 20120013748A1 · Stanwood et al. · 2012 [cited by applicant]
US 20120033731A1 · Yamamoto et al. · 2012 [cited by applicant]
US 20120195356A1 · Yi et al. · 2012 [cited by applicant]
US 20120265901A1 · Swenson et al. · 2012 [cited by applicant]
US 20130076855A1 · Miyamoto et al. · 2013 [cited by applicant]
US 20130114694A1 · Chen et al. · 2013 [cited by applicant]
US 20130294499A1 · Wang · 2013 [cited by applicant]
US 20130294500A1 · Wang · 2013 [cited by applicant]
US 20130308708A1 · Sugio et al. · 2013 [cited by applicant]
US 20140022240A1 · Lee et al. · 2014 [cited by applicant]
US 20140086328A1 · Chen et al. · 2014 [cited by applicant]
US 20140092964A1 · Ugur et al. · 2014 [cited by applicant]
US 20140301464A1 · Wu et al. · 2014 [cited by applicant]
US 20140301479A1 · Pandit et al. · 2014 [cited by applicant]
US 20140348235A1 · Yamamoto et al. · 2014 [cited by applicant]
US 20140362173A1 · Doepke et al. · 2014 [cited by applicant]
US 20150003513A1 · Hashimoto et al. · 2015 [cited by applicant]
US 20150023405A1 · Joshi et al. · 2015 [cited by applicant]
US 20150103926A1 · Hannuksela · 2015 [cited by applicant]
US 20150110192A1 · Wang et al. · 2015 [cited by applicant]
US 20150156501A1 · Hannuksela · 2015 [cited by applicant]
US 20150189298A1 · Ye et al. · 2015 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150264404A1 · Hannuksela · 2015 [cited by applicant]
US 20150304667A1 · Suehring et al. · 2015 [cited by applicant]
US 20150341552A1 · Chen et al. · 2015 [cited by applicant]
US 20160005435A1 · Campbell et al. · 2016 [cited by applicant]
US 20160100187A1 · Lee et al. · 2016 [cited by applicant]
US 20160100189A1 · Pang et al. · 2016 [cited by applicant]
US 20160105670A1 · Pang et al. · 2016 [cited by applicant]
US 20160337668A1 · Le Leannec et al. · 2016 [cited by applicant]
US 20170118540A1 · Thomas et al. · 2017 [cited by applicant]
US 20170142442A1 · Tsukuba et al. · 2017 [cited by applicant]
US 20170155912A1 · Thomas et al. · 2017 [cited by applicant]
US 20170200255A1 · Lin et al. · 2017 [cited by applicant]
US 20180005343A1 · Rhoads et al. · 2018 [cited by applicant]
US 20180041762A1 · Ikai et al. · 2018 [cited by applicant]
US 20180098091A1 · Wiegand et al. · 2018 [cited by applicant]
US 20180176601A1 · Jeong et al. · 2018 [cited by applicant]
US 20180234697A1 · Jang et al. · 2018 [cited by applicant]
US 20180249192A1 · Denoual et al. · 2018 [cited by applicant]
US 20190014337A1 · Skupin et al. · 2019 [cited by applicant]
US 20190020884A1 · Skupin et al. · 2019 [cited by applicant]
US 20190068985A1 · Yamamoto et al. · 2019 [cited by applicant]
US 20190253734A1 · Lee et al. · 2019 [cited by applicant]
US 20190297326A1 · Reda et al. · 2019 [cited by applicant]
US 20200045329A1 · Hashimoto et al. · 2020 [cited by applicant]
US 20200128252A1 · Fu et al. · 2020 [cited by applicant]
US 20200204829A1 · Stepin et al. · 2020 [cited by applicant]
US 20200221104A1 · Deshpande · 2020 [cited by applicant]
US 20200275129A1 · Deshpande · 2020 [cited by applicant]
US 20210211695A1 · Skupin et al. · 2021 [cited by applicant]
CN 1774934A · 2006 [cited by applicant]
CN 1781316A · 2006 [cited by applicant]
CN 101160975A · 2008 [cited by applicant]
CN 101636761A · 2010 [cited by applicant]
CN 101656822A · 2010 [cited by applicant]
CN 102209241A · 2011 [cited by applicant]
CN 103546737A · 2014 [cited by applicant]
CN 104813660A · 2015 [cited by applicant]
CN 105144720A · 2015 [cited by applicant]
JP H11346370A · 1999 [cited by applicant]
JP 2008005531A · 2008 [cited by applicant]
JP 2011120305A · 2011 [cited by applicant]
JP 5729237B2 · 2015 [cited by applicant]
KR 20180111969A · 2018 [cited by applicant]
KR 20210019137A · 2021 [cited by applicant]
KR 20210019597A · 2021 [cited by applicant]
KR 20210034127A · 2021 [cited by applicant]
TW 201524192A · 2015 [cited by applicant]
WO 2011128366A1 · 2011 [cited by applicant]
WO 2014001573A1 · 2014 [cited by applicant]
WO 2015059194A1 · 2015 [cited by applicant]
Giovanni Ballocca: “Requirements for Frame Compatible Format”, 104. MPEG Meeting; Apr. 24, 2013, Incheon; Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11, No. m29229, XP030057761, Apr. 24, 2013. [cited by applicant]
Auyeung, Cheung, , HLS: Non-significant slice segments with tiles for single layer HEVC extensions, JCTVC-No. 269_r1.docx[online], Jul. 25, 2013, http://phenix.int-evry.fr/jct/doc_end_user/documents/14_Vienna/wg11/JCTVC… [cited by applicant]
Ballocca, Giovanni, et al., “Rectangular Region Frame Packing Arrangement, Joint Collaborative Team on Video Coding”, (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-Q0256_r1, Apr. 3, 2014. [cited by applicant]
Hattori, Sally, et al., “HLS: Extensions to Temporal Motion-Constrained Tile Sets SEI Message”, JCTVC-O0063; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeti… [cited by applicant]
Stockhammer, Thomas, “Dynamic Adaptive Streaming over HTTP—Standards and Design Principles”, In Proceedings of the ACM Multimedia Systems (MMSys11), San Jose, California, USA, pp. 133-143. [cited by applicant]
Tokumo, Yasuaki, et al., “DASH: Signaling Tile Encapsulation Modes”, 108, MPEG meeting, Mar. 31-Apr. 4, 2014, No. M33111, Mar. 26, 2014, ISO/IEC JTC1/SC29/WG11, MPEG2014/NiLU111, 6 pages. [cited by applicant]
Wu, Yongjun, et al., “Motion-constrained tile sets SEI message”, JCTVC-M0235, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC 29/WG 11, 13th Meeting: Incheon, KR, Apr. 18-26, 20… [cited by applicant]
Wu, Yongjun, et al., “Motion-Constrained Title Sets SEI Message”, Document: JCTVC-M0235 (v.1); Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Incheon, K… [cited by applicant]
Auyeung, Cheung, HLS: Non-Significant Slice Segments with Tiles for Single Layer HEVC Extensions, JCTVC-N0269 (version 2), ITU, Jul. 25, 2013, pp. 1-4, JCTVC-N0269_r1.docx. [cited by applicant]
High Efficiency Video Coding, Recommendation ITU-T H.265 (04/15), ITU, Jul. 9, 2015, pp. 244-248, 357-360. [cited by applicant]