IP Library › Granted Patent US 12,375,704
Granted Patent B2
US 12,375,704 · App. 17/488,153 · Granted Jul 29, 2025

Method and apparatus for encapsulating video data into a file

Inventors: Franck Denoual (Saint Domineuc, FR); Naël Ouedraogo (Val d'Anast, FR); Frédéric Maze (Langan, FR); Hervé Ruellan (Rennes, FR); Jean Le Feuvre (Gometz-le-Chatel, FR)
Assignee: Canon Kabushiki Kaisha
H04N19/46H04N19/188H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,704
App. No.
17/488,153
Granted
Jul 29, 2025
Kind
B2
Abstract

A method of encapsulating a bitstream of encoded video data in a media file, the method comprising: obtaining the bitstream comprising a second plurality of operating points, video data in the bitstream being organized into NAL units; the bitstream being filtered from an original bitstream, the original bitstream comprising a first plurality of operating points, the first plurality of operating points comprising at least the second plurality of operating points; obtaining from the bitstream a first NAL unit describing the first plurality of operating points; obtaining form the bitstream a second NAL unit describing the second plurality of operating points; generating the media file comprising the bitstream and comprising at least one metadata structure describing the second plurality of operating points; wherein the at least one metadata structure is generated based on both the first and second NAL units.

Claims (46)

1. A method of encapsulating a bitstream of encoded media data in an ISOBMFF media file, the method comprising:

obtaining the bitstream, media data in the bitstream being organized into NAL units;

obtaining from the bitstream a NAL unit describing a plurality of operating points; and

generating the media file comprising the bitstream and comprising at least one metadata box comprising first information describing the plurality of operating points,

wherein the at least one metadata box further comprises second information for indicating whether some NAL units associated with at least one operating point of the plurality of operating points are missing in the media file, and

wherein, if the second information indicates some NAL units are missing, the at least one metadata box further comprises, for each operating point of the plurality of operating points, third information for indicating at least whether a layer of the operating point is missing or a temporal sublayer of the operating point is missing.

2. The method of claim 1 , wherein the second information indicates whether all the operating points of the plurality of operating points have all their NAL units in the media file.

3. The method of claim 1 , wherein the third information further indicates whether the operating point has all its NAL units in the media file.

4. The method of claim 1 , wherein:

the third information further indicates whether a layer and a temporal sub-layer of the operating point are missing.

5. The method of claim 1 , wherein

the metadata box represents a ‘vopi’ sample group.

6. The method of claim 1 , wherein the metadata box is a ‘opeg’ box.

7. The method of claim 1 , wherein:

the obtaining the bitstream further comprises:

obtaining an original bitstream, video data in the original bitstream being organized into NAL units and comprising an original plurality of operating points;

obtaining from the original bitstream a NAL unit describing a second plurality of operating points, the original plurality of operating points comprising at least the second plurality of operating points; and

obtaining the bitstream by filtering the original bitstream based on the NAL unit describing the second plurality of operating points.

8. The method of claim 7 , wherein:

the NAL unit describing the second plurality of operating points is of an OPI, Operating Point Information, type.

9. The method of claim 7 , wherein:

the NAL unit describing the original plurality of operating points is of a VPS, Video Parameter Set, type.

10. The method of claim 1 , wherein:

the NAL unit describing the plurality of operating points is of a VPS, Video Parameter Set, type.

11. A non-transitory computer-readable storage medium storing instructions of a computer program for implementing a method according to claim 1 .

12. A method of decoding a bitstream of encoded media data in an ISOBMFF media file, the method comprising:

obtaining the bitstream from the media file, media data in the bitstream being organized into NAL units;

obtaining from the bitstream at least one metadata box comprising first information describing a plurality of operating points; and

decoding an operating point in the bitstream,

wherein the at least one metadata box further comprises second information for indicating whether some NAL units associated with at least one operating point of the plurality of operating points are missing in the media file;

wherein, if the second information indicates some NAL units are missing, the at least one metadata box further comprises, for each operating point of the plurality of operating points, third information for indicating at least whether a layer of the operating point is missing or a temporal sublayer of the operating point is missing, and

wherein the decoded operating point is an operating point having all its NAL units in the media file.

13. A non-transitory computer-readable storage medium storing instructions of a computer program for implementing a method according to claim 12 .

14. A device for encapsulating a bitstream of encoded video data in an ISOBMFF media file, the device comprising a processor configured for:

obtaining the bitstream, media data in the bitstream being organized into NAL units;

obtaining from the bitstream a NAL unit describing a plurality of operating points; and

generating the media file comprising the bitstream and comprising at least one metadata box comprising first information describing the plurality of operating points,

wherein the at least one metadata box further comprises second information for indicating whether some NAL units associated with at least one operating point of the plurality of operating points are missing in the media file, and

wherein, if the second information indicates some NAL units are missing, the at least one metadata box further comprises, for each operating point of the plurality of operating points, third information for indicating at least whether a layer of the operating point is missing or a temporal sublayer of the operating point is missing.

15. A device for decoding a bitstream of encoded media data in an ISOBMFF media file, the device comprising a processor configured for:

obtaining the bitstream from the media file, media data in the bitstream being organized into NAL units;

obtaining from the bitstream at least one metadata box comprising first information describing a plurality of operating points; and

decoding an operating point in the bitstream,

wherein the at least one metadata box further comprises second information for indicating whether some NAL units associated with at least one operating point of the plurality of operating points are missing in the media file;

wherein, if the second information indicates some NAL units are missing, the at least one metadata box further comprises, for each operating point of the plurality of operating points, third information for indicating at least whether a layer of the operating point is missing or a temporal sublayer of the operating point is missing, and

wherein the decoded operating point is an operating point having all its NAL units in the media file.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: DENOUAL, FRANCK; OUEDRAOGO, NAËL; MAZE, FRÉDÉRICK; RUELLAN, HERVÉ; LE FEUVRE, JEAN
To: CANON KABUSHIKI KAISHA
Reel/Frame 070975/0113 →
Priority Claims (1)
GB 2015415 · Sep 29, 2020 · national
Continuity (1)
Related Publication 20220166997A1 · May 26, 2022
References Cited (24)
US 12108081B2 · Newman · 2024 [cited by examiner]
US 12244805B2 · Ramasubramonian · 2025 [cited by examiner]
US 20160112724A1 · Hendry · 2016 [cited by applicant]
US 20160373771A1 · Hendry · 2016 [cited by examiner]
US 20200245041A1 · Maze et al. · 2020 [cited by applicant]
US 20220086496A1 · Wang · 2022 [cited by examiner]
US 20220094909A1 · Hannuksela · 2022 [cited by examiner]
CN 101924944A · 2010 [cited by applicant]
CN 104054345A · 2014 [cited by applicant]
CN 104620587A · 2015 [cited by applicant]
CN 104662914A · 2015 [cited by applicant]
CN 104662916A · 2015 [cited by applicant]
CN 106170982A · 2016 [cited by applicant]
CN 106464922A · 2017 [cited by applicant]
CN 107750461A · 2018 [cited by applicant]
EP 3972266A1 · 2022 [cited by applicant]
GB 2535453A · 2016 [cited by applicant]
WO WO2015187978A1 · 2015 [cited by examiner]
ITU-T Telecommunication Standardization Sector Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, Versatile Video Coding H.266, Aug. 2020 (Year: 2020). [cited by examiner]
Technologies under Consideration for NAL File Format, ISO/IEC JTC 1/SC 29/WG 11 Coding of moving pictures and audio, Jul. 12, 2020, 35 pages. [cited by applicant]
Kashyap Kammachi-Sreedhar, et al., (5.2) [4496-15] Carriage of VVC bitstream(s) with multiple layers, International Organisation for Standardisation, Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11 MPEG2020/… [cited by applicant]
Hendry, et al., Comments on Storage of tiled Video in ISO/IEC 14496-15, International Organisation for Standardisation, Coding of Moving Pictures and Audio, ISO/IEC JTC1/SC29/WG11 MPEG2016/M38225r3, May-Jun. 2016, 7 pag… [cited by applicant]
Information Technology—Coding of Audio-Visual Objects—Part 15: Carriage of Network Abstraction Layer (NAL) Unit Structured Video in the ISO Base Media File Format; MPEG Meeting, ISO/IEC/JTC1/SC29/WG11, Jan. 13, 2014, 19… [cited by applicant]
Zhu et al. “Multi layer video coding extensions of HEVC standard” Journal of Nanjing University of Posts and Telecommunications ( Natural Science Edition) vol. 35, No. 3, Jun. 2015. [cited by applicant]