Data processing for immersive media
View Patent ↗In a data processing method for immersive media, metadata of the immersive media is obtained. The metadata includes (i) zoom region information of a zoom region of the immersive media, and (ii) zoom mode information that indicates whether a target zoom mode is enabled for the zoom region. The zoom mode information indicates zoom parameters of the target zoom mode for the zoom region when the target zoom mode is enabled. Zoom processing is performed on the zoom region of the immersive media according to the zoom mode information included in the metadata when the zoom mode information indicates that the target zoom mode is enabled for the zoom region. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also contemplated.
1 . A data processing method for immersive media, the method comprising:
obtaining metadata of the immersive media, the metadata including zoom region information indicating a zoom region of the immersive media and automatic zooming information associated with the zoom region, the automatic zooming information including:
zoom mode information indicating whether an automatic zooming mode is enabled for the zoom region,
a step value indicating a number of automatic zooming steps to be sequentially performed when the automatic zooming mode is enabled,
a respective zoom ratio for each of the automatic zooming steps, and
a respective zoom duration for each of the automatic zooming steps;
obtaining, by processing circuitry, encoded data of the immersive media that corresponds to the zoom mode information when the zoom mode information included in the automatic zooming information indicates that the automatic zooming mode is enabled for the zoom region; and
performing, by the processing circuitry, zoom processing sequentially on the zoom region of the immersive media during playback of the encoded data according to the automatic zooming information included in the metadata when the zoom mode information indicates that the automatic zooming mode is enabled for the zoom region.
2 . The data processing method according to claim 1 , wherein the automatic zooming mode is a director zoom mode corresponding to a rendition of the immersive media specified by a content producer of the immersive media.
3 . The data processing method according to claim 1 , wherein the zoom mode information includes a zoom flag that indicates whether the automatic zooming mode is enabled.
4 . The data processing method according to claim 1 , wherein
when a value of the zoom ratio corresponding to one of the automatic zooming steps is an ineffective value, the zoom ratio indicates that a size of the zoom region of the immersive media after the corresponding automatic zooming step of the zoom processing associated with the zoom ratio is same as a size of the zoom region before the zoom processing is performed, and
when the value of the zoom ratio is an effective value, the zoom ratio indicates that a ratio between the size of the zoom region of the immersive media after the corresponding automatic zooming step of the zoom processing associated with the zoom ratio is based on the value of the zoom ratio.
5 . The data processing method according to claim 1 , wherein the automatic zooming information comprises:
zoom duration units that indicate time units of the corresponding zoom durations for the automatic zooming steps.
6 . The data processing method according to claim 1 , further comprising:
obtaining a zoom description signaling file of the immersive media, the zoom description signaling file including description information of the zoom mode information, wherein
the performing the zoom processing includes performing the zoom processing on the zoom region of the immersive media according to the zoom mode information included in the metadata and the description information of the zoom mode information in the zoom description signaling file.
7 . The data processing method according to claim 6 , wherein
the zoom description signaling file includes at least one of a sphere region zooming descriptor or a two-dimensional (2D) region zooming descriptor,
the sphere region zooming descriptor is encapsulated in a representation hierarchy in a media presentation description file of the immersive media, a quantity of sphere region zooming descriptors in the representation hierarchy being less than or equal to 1, and
the 2D region zooming descriptor is encapsulated in the representation hierarchy in the media presentation description file of the immersive media, a quantity of 2D region zooming descriptors in the representation hierarchy being less than or equal to 1.
8 . The data processing method according to claim 1 , further comprising:
obtaining an encapsulated file of the immersive media, the encapsulated file including the metadata of the immersive media; and
parsing the encapsulated file to obtain the metadata of the immersive media.
9 . A data processing apparatus, comprising:
processing circuitry configured to:
obtain metadata of immersive media, the metadata including zoom region information indicating a zoom region of the immersive media and automatic zooming information associated with the zoom region, the automatic zooming information including;
zoom mode information indicating whether an automatic zooming mode is enabled for the zoom region,
a step value indicating a number of automatic zooming steps to be sequentially performed when the automatic zooming mode is enabled,
a respective zoom ratio for each of the automatic zooming steps, and
a respective zoom duration for each of the automatic zooming steps;
obtain encoded data of the immersive media that corresponds to the zoom mode information when the zoom mode information included in the automatic zooming information indicates that the automatic zooming mode is enabled for the zoom region; and
perform zoom processing sequentially on the zoom region of the immersive media during playback of the encoded data according to the automatic zooming information included in the metadata when the zoom mode information indicates that the automatic zooming mode is enabled for the zoom region.
10 . The data processing apparatus according to claim 9 , wherein the automatic zooming mode is a director zoom mode corresponding to a rendition of the immersive media specified by a content producer of the immersive media.
11 . The data processing apparatus according to claim 9 , wherein the processing circuitry is configured to:
obtain an encapsulated file of the immersive media, the encapsulated file including the metadata of the immersive media; and
parse the encapsulated file to obtain the metadata of the immersive media.
12 . A non-transitory computer readable storage medium, storing instructions which when executed by a processor cause the processor to perform:
obtaining metadata of an immersive media, the metadata including zoom region information indicating a zoom region of the immersive media and automatic zooming information associated with the zoom region, the automatic zooming information including:
zoom mode information indicating whether an automatic zooming mode is enabled for the zoom region,
a step value indicating a number of automatic zooming steps to be sequentially performed when the automatic zooming mode is enabled,
a respective zoom ratio for each of the automatic zooming steps, and
a respective zoom duration for each of the automatic zooming steps;
obtaining, by processing circuitry, encoded data of the immersive media that corresponds to the zoom mode information when the zoom mode information included in the automatic zooming information indicates that the automatic zooming mode is enabled for the zoom region; and
performing zoom processing sequentially on the zoom region of the immersive media during playback of the encoded data according to the automatic zooming information included in the metadata when the zoom mode information indicates that the automatic zooming mode is enabled for the zoom region.
13 . The non-transitory computer readable storage medium according to claim 12 , wherein the automatic zooming mode is a director zoom mode corresponding to a rendition of the immersive media specified by a content producer of the immersive media.
14 . The non-transitory computer readable storage medium according to claim 12 , wherein the zoom mode information includes a zoom flag that indicates whether the automatic zooming mode is enabled.
15 . The non-transitory computer readable storage medium according to claim 12 , wherein
when a value of the zoom ratio corresponding to one of the automatic zooming steps is an ineffective value, the zoom ratio indicates that a size of the zoom region of the immersive media after the corresponding automatic zooming step of the zoom processing associated with the zoom ratio is same as a size of the zoom region before the zoom processing is performed, and
when the value of the zoom ratio is an effective value, the zoom ratio indicates that a ratio between the size of the zoom region of the immersive media after the zoom step of the corresponding zoom processing associated with the zoom ratio is based on the value of the zoom ratio.
16 . The non-transitory computer readable storage medium according to claim 12 , wherein the automatic zooming information comprises:
zoom duration units that indicate time units of the corresponding zoom durations for the automatic zooming steps.
17 . The non-transitory computer readable storage medium according to claim 12 , wherein the instructions further cause the processor to perform:
obtaining a zoom description signaling file of the immersive media, the zoom description signaling file including description information of the zoom mode information, wherein
the performing the zoom processing includes performing the zoom processing on the zoom region of the immersive media according to the zoom mode information included in the metadata and the description information of the zoom mode information in the zoom description signaling file.
18 . The non-transitory computer readable storage medium according to claim 17 , wherein
the zoom description signaling file includes at least one of a sphere region zooming descriptor or a two-dimensional (2D) region zooming descriptor,
the sphere region zooming descriptor is encapsulated in a representation hierarchy in a media presentation description file of the immersive media, a quantity of sphere region zooming descriptors in the representation hierarchy being less than or equal to 1, and
the 2D region zooming descriptor is encapsulated in the representation hierarchy in the media presentation description file of the immersive media, a quantity of 2D region zooming descriptors in the representation hierarchy being less than or equal to 1.
19 . The data processing method according to claim 8 , wherein the obtaining the encoded data of the immersive media includes:
requesting, from a server, a video file of the immersive media at a current resolution version based on the automatic zooming information without requesting all video files of the immersive media of all resolution versions.
20 . The data processing method according to claim 19 , wherein
the automatic zooming information includes zoom duration units that indicate time units of the corresponding zoom durations for the automatic zooming steps, and
the zoom duration units include non-zero values in units of seconds.