Image metadata for video streams
A method and apparatus comprising computer code for video processing, the method including setting an image format metadata type identifier, wherein the image format metadata type identifier indicates a type of metadata included in a supplemental enhancement information (SEI) message associated with a current image; signaling the image format metadata type identifier in a bitstream; and encoding the current image in the bitstream based on the image format metadata type identifier. The method may also include signaling an image format metadata universal resource identifier flag, wherein the image format metadata universal resource identifier flag indicates whether image information payload associated with the current image is obtained from a payload of the SEI message.
1 . A method of video processing, the method being executed by at least one processor, and the method comprising:
setting an image format metadata type identifier, wherein the image format metadata type identifier indicates a type of metadata included in a supplemental enhancement information (SEI) message associated with a current image;
setting, in the SEI message, an image uri present flag, the image uri present flag indicating whether image information payload associated with the current image is to be obtained via one of a universal resource identifier and from the SEI message;
signaling the image format metadata type identifier in a bitstream and the image uri present flag; and
encoding the current image in the bitstream based on the image format metadata type identifier and the image uri present flag.
2 . The method of claim 1 , wherein the type of metadata included in the SEI message comprises one of:
Exchangeable Image File (EXIF) metadata;
JPEG File Interchange Format (JFIF) metadata from one or more concatenated JFIF segments;
JFIF metadata from one or more JFIF extension markers;
JFIF metadata from one or more JFIF headers; and
Extensible metadata platform (XMP) metadata.
3 . The method of claim 1 , wherein a first value of the image uri present flag indicates that the image information payload associated with the current image is obtained from the payload of the SEI message, and
wherein a second value of the image uri present flag indicates that the image information payload associated with the current image is obtained from a universal resource identifier.
4 . The method of claim 3 , wherein, when the image uri present flag has the second value, the method further comprises signaling a universal resource identifier (URI) string.
5 . The method of claim 1 , wherein the method further comprises:
setting an image format metadata cancel flag, wherein the image format metadata cancel flag indicates that the SEI message associated with the current image cancels a persistence of any previous SEI message.
6 . The method of claim 1 , wherein the method further comprises signaling a payload size that indicates a size of a payload of the SEI message.
7 . An apparatus for video processing, the apparatus comprising
at least one memory storing instructions; and
at least one processor configured to execute the instructions and operate as instructed by the instructions, wherein the instructions program code comprise:
receiving code configured to cause the at least one processor to receive a video bitstream comprising a coded image;
first obtaining code configured to cause the at least one processor to obtain an image format metadata type identifier, wherein the image format metadata type identifier indicates a type of metadata included in a supplemental enhancement information (SEI) message associated with the coded image;
second obtaining code configured to cause the at least one processor to obtain an image uri present flag, the image uri present flag indicating whether image information payload associated with the current image is to be obtained via one of a universal resource identifier and from the SEI message; and
decoding code configured to cause the at least one processor to decode the coded image based on the image format metadata type identifier and the image uri present flag.
8 . The apparatus of claim 7 , the type of metadata included in the SEI message comprises one of:
Exchangeable Image File (EXIF) metadata;
JPEG File Interchange Format (JFIF) metadata from one or more concatenated JFIF segments;
JFIF metadata from one or more JFIF extension markers;
JFIF metadata from one or more JFIF headers; and
Extensible metadata platform (XMP) metadata.
9 . The apparatus of claim 7 , wherein a first value of the image uri present flag indicates that the image information payload associated with the coded image is obtained from the payload of the SEI message, and
wherein a second value of the image uri present flag indicates that the image information payload associated with the coded image is obtained from a universal resource identifier.
10 . The apparatus of claim 9 , wherein, when the image uri present flag has the second value, the program code further comprises third obtaining code configured to cause the at least one processor to obtain a universal resource identifier (URI) string.
11 . The apparatus of claim 7 , wherein the instructions further comprise fourth obtaining code configured to cause the at least one processor to obtain an image format metadata cancel flag, wherein the image format metadata cancel flag indicates that the SEI message associated with the current image cancels a persistence of any previous SEI message.
12 . The apparatus of claim 7 , wherein the instructions further comprise fifth obtaining code configured to cause the at least one processor to obtain a payload size that indicates a size of a payload of the SEI message.
13 . A non-transitory computer readable medium for video processing, storing one or more instructions configured to cause at least one processor to:
perform a conversion between a visual media file and a bitstream of the visual media file according to a format rule,
wherein the bitstream comprises:
an image format metadata type identifier, wherein the image format metadata type identifier indicates a type of metadata included in a supplemental enhancement information (SEI) message associated with a current image; and
an instructions further comprise, wherein the image uri present flag indicates whether image information payload associated with the current image is to be obtained via one of a universal resource identifier and from the SEI message.
14 . The non-transitory computer readable medium of claim 13 , wherein the type of metadata included in the SEI message comprises one of:
Exchangeable Image File (EXIF) metadata;
JPEG File Interchange Format (JFIF) metadata from one or more concatenated JFIF segments;
JFIF metadata from one or more JFIF extension markers;
JFIF metadata from one or more JFIF headers; and
Extensible metadata platform (XMP) metadata.
15 . The non-transitory computer readable medium of claim 13 , wherein a first value of the image uri present flag indicates that the image information payload associated with the current image is obtained from the payload of the SEI message, and
wherein a second value of the image uri present flag indicates that the image information payload associated with the current image is obtained from a universal resource identifier.
16 . The non-transitory computer readable medium of claim 15 , wherein, when the image uri present flag has the second value, the bitstream further comprises signaling a universal resource identifier (URI) string.
17 . The non-transitory computer readable medium of claim 13 , wherein the bitstream further comprises an image format metadata cancel flag, wherein the image format metadata cancel flag indicates that the SEI message associated with the current image cancels a persistence of any previous SEI message.
18 . The non-transitory computer readable medium of claim 13 , wherein the bitstream further comprises a payload size that indicates a size of the payload of the SEI message.