IP Library › Granted Patent US 12,200,318
Granted Patent B2
US 12,200,318 · App. 18/012,587 · Granted Jan 14, 2025

Method and apparatus for encapsulating annotated region in ISOBMFF tracks

Inventors: Franck Denoual (Saint Domineuc, FR); Frédéric Maze (Langan, FR); Hervé Ruellan (Rennes, FR)
Assignee: Canon Kabushiki Kaisha
H04N21/8153G06T7/50G06T7/60G06V10/25H04N21/84G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,318
App. No.
18/012,587
Granted
Jan 14, 2025
Kind
B2
Abstract

A method of generating a media file, the method comprising: generating a first track of media data samples; generating at least one annotated region, the annotated region being associated with a geometry of the annotated region, the annotated region being associated with at least one region annotation describing the annotated region; wherein the annotated region is associated with the first track of media data samples; and generating a media file including the first track and the at least one annotated region, associated geometry and associated region annotation.

Claims (45)

1. A method of generating a media file, the method comprising:

generating a first track of media data samples;

generating a second track of timed metadata, the second track being associated with the first track using a track reference and comprising at least one region geometry stored in a sample,

wherein the at least one region geometry describes a geometry of a region in a media data sample of the first track,

wherein the at least one region geometry is associated with at least one region annotation describing the region in the media data sample of the first track; and

generating a media file including the first track, the second track and associated region annotation.

2. The method of claim 1 , wherein:

the region geometry comprises the location of an anchor point and the shape of the region.

3. The method of claim 1 , wherein:

the region annotations are stored as properties of a group of samples of the second track.

4. The method of claim 1 , wherein the method further comprises:

generating a third track of samples, each sample being a region annotation associated with a region geometry of the second track, the third track being associated with the second track using a track reference.

5. The method of claim 1 , wherein:

region annotations are stored as properties in a property container in a meta data part of the media file.

6. The method of claim 5 , wherein:

the at least one region geometry is associated with the region annotations through group of samples in the second track.

7. The method of claim 5 , wherein:

the association between region annotations and the at least one region geometry is stored in a sample group description entry indicating the index of the region annotation in the property container, the sample group description entry being associated with a group of samples in the second track.

8. The method according to claim 1 , wherein region annotations comprise textual annotations.

9. The method according to claim 1 , wherein region annotations comprise alternative representations of the region.

10. A non-transitory computer-readable storage medium storing instructions of a computer program for implementing a method according to claim 1 .

11. A device for generating a media file, the device comprising a processor configured for:

generating a first track of media data samples;

generating a second track of timed metadata, the second track being associated with the first track using a track reference and comprising at least one region geometry stored in a sample,

wherein the at least one region geometry describes a geometry of a region in a media data sample of the first track,

wherein the at least one region geometry is associated with at least one region annotation describing the region in the media data sample of the first track; and

generating a media file including the first track, the second track and associated region annotation.

12. A method of processing a media file, the method comprising:

obtaining a media file including:

a first track of media data samples; and

a second track of timed metadata, the second track being associated with the first track using a track reference and comprising at least one region geometry stored in a sample,

wherein the at least one region geometry describes a geometry of a region in a media data sample of the first track,

wherein the at least one region geometry is associated with at least one region annotation describing the region in the media data sample of the first track;

obtaining media data samples from the media file;

obtaining a region geometry associated with media data samples, associated geometry and associated region annotations;

processing the obtained media data and information for outputting a video based on the obtained media data and information.

13. A device for processing a media file, the device comprising a processor configured for:

obtaining a media file including:

a first track of media data samples; and

a second track of timed metadata, the second track being associated with the first track using a track reference and comprising at least one region geometry stored in a sample,

wherein the at least one region geometry describes a geometry of a region in a media data sample of the first track,

wherein the at least one region geometry is associated with at least one region annotation describing the region in the media data sample of the first track;

obtaining media data samples from the media file;

obtaining a region geometry associated with media data samples, associated geometry and associated region annotations;

processing the obtained media data and information for outputting a video based on the obtained media data and information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2022
From: DENOUAL, FRANCK; MAZE, FRÉDÉRIC; RUELLAN, HERVÉ
To: CANON KABUSHIKI KAISHA
Reel/Frame 062207/0755 →
Priority Claims (1)
GB 2009673 · Jun 24, 2020 · national
Continuity (1)
Related Publication 20230254549A1 · Aug 10, 2023
References Cited (25)
US 11863767B2 · Bouazizi · 2024 [cited by examiner]
US 20170346873A1 · Denoual et al. · 2017 [cited by applicant]
US 20190208234A1 · Van Brandenburg · 2019 [cited by applicant]
US 20200092530A1 · Wang · 2020 [cited by applicant]
US 20210201855A1 · Kammachi-Sreedhar · 2021 [cited by examiner]
US 20220150296A1 · Hannuksela · 2022 [cited by examiner]
US 20220159352A1 · Maze · 2022 [cited by examiner]
US 20220245190A1 · Maze · 2022 [cited by examiner]
CN 107750462A · 2018 [cited by applicant]
CN 109218755A · 2019 [cited by applicant]
CN 110383846A · 2019 [cited by applicant]
CN 110651482A · 2020 [cited by applicant]
CN 111213384A · 2020 [cited by applicant]
GB 2550912A · 2017 [cited by applicant]
David Singer (editor), Draft 14496-12 FDIS incorporating FDAM4 etc, Information Technology—JPEG 2000 image coding system—Part 12: ISO Base Media File Format, XP30289608. [cited by applicant]
Information technology—Coding of audio-visual objects—Part 12: ISO base media file format, ISO/IEC 14496-12, Dec. 15, 2015, Fifth edition, XP82009954. [cited by applicant]
Information technology—JPEG 2000 image coding system—Part 12: ISO base media file format, ISO/IEC 1544412 Oct. 1, 2005, Second edition, XP2501713. [cited by applicant]
Hervé Ruellan, et al., [HEIF] Region Annotations, International Organisation for Standardisation Coding of Moving Pictures, ISO/IEC/SC29/WG3 MPEG2021/m56024, Jan. 13, 2021, Doc. No. m56024, XP30290942. [cited by applicant]
Hervé Ruellan, et al., (22.3) [HEIF] Region Annotations, International Organisation for Standardisation, Coding of Moving Pictures, ISO/IEC/SC29/WG3 MPEG2021/m54441, Jun. 24, 2020, XP30288824. [cited by applicant]
Hervé Ruellan, et al., [HEIF] Region Annotations, International Organisation for Standardisation, Coding of Moving Pictures, ISO/IEC/SC29/WG3 MPEG2021/m56024, Jan. 6, 2021, Doc. No. m56024, XP30290941. [cited by applicant]
Hervé Ruellan, et al., [HEIF] Region Annotations, International Organisation for Standardisation, Coding of Moving Pictures, ISO/IEC/SC29/WG3 MPEG2021/m55055, Oct. 7, 2020, XP30292570. [cited by applicant]
Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 12: Image File Format—Amendment 2: Support for VVC, EVC slideshows and other improvements, ISO/IEC 23008-12:2017 DAM 2:… [cited by applicant]
Sergey I. Nikolenko, et al., Synthetic Data for Deep Learning, ARVIX.org, Cornell University, Sep. 26, 2019, XP81483153A. [cited by applicant]
Ye-Kui Wang, et al., WD2of ISO/IEC 14496-15 2013/MAD1 Enhanced support of HEVC and MVC+D, International Organisation for Standardisation ISO/IEC JTC1/SC29/WG11 Coding of Moving Pictures and Audio, Jan. 2014, Doc. No. w1… [cited by applicant]
Miska M. Hannuksela et al., Overview of the High Efficiency Image File Format, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-V0072, 22nd meeting, Oct. 15-21, 201… [cited by applicant]