Method, apparatus and device for encapsulating media file, and storage medium
View Patent ↗A method for encapsulating a media file includes: acquiring coded bitstreams of panoramic pictures of N viewpoints, N being a positive integer greater than 1; and encapsulating the coded bitstreams in an entity group, and respectively adding, for at least one viewpoint in the N viewpoints, first information to a panoramic picture of the corresponding viewpoint, to obtain a media file of the panoramic pictures of the N viewpoints, the first information indicating switching information during switching from a panoramic picture of a current viewpoint to another panoramic picture of a next viewpoint.
1. A method for encapsulating a media file, applied to a device for encapsulating a file and comprising:
receiving coded bitstreams of panoramic pictures of N viewpoints, N being a positive integer greater than 1; and
encapsulating the coded bitstreams in an entity group, and respectively adding, for at least one viewpoint in the N viewpoints, first information to a panoramic picture of the corresponding viewpoint, to obtain a media file of the panoramic pictures of the N viewpoints, the first information indicating switching information during switching from a panoramic picture of a current viewpoint to another panoramic picture of a next viewpoint,
wherein the switching information comprises at least one of: switching effect information, switching viewpoint information or switching window information;
the switching effect information comprises a switching effect flag, the switching effect flag indicating whether a switching effect exists during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint;
the switching viewpoint information comprises a neighbor viewpoint flag, the neighbor viewpoint flag indicating whether the next viewpoint to be switched from the current viewpoint is a neighbor viewpoint of the current viewpoint or any one of the N viewpoints; and
the switching window information comprises a switching window type, the switching window type being a type of an initial window of the next viewpoint during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
2. The method according to claim 1 , wherein in response to that a value of the switching effect flag is a first value, the switching effect information further comprises switching effect period information, the first value indicating that the switching effect exits during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint; and the switching effect period information comprises a switching effect period flag, the switching effect period flag indicating whether a period of the switching effect is specified during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
3. The method according to claim 2 , wherein in response to that a value of the switching effect period flag is a first flag value, the switching effect period information further comprises a period of the switching effect, the first flag value indicating that the period of the switching effect is specified during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
4. The method according to claim 1 , wherein in response to that a value of the switching effect flag is a second value, the switching effect information further comprises a type of the switching effect, the second value indicating that the switching effect exits during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
5. The method according to claim 4 , wherein the type of the switching effect comprises at least one of a stepping type, a scaling type, a fade-out fade-in type and a fly-in type.
6. The method according to claim 1 , wherein
in response to that a value of the neighbor viewpoint flag is a third value, the next viewpoint to be switched from the current viewpoint is the neighbor viewpoint of the current viewpoint; and
in response to that a value of the neighbor viewpoint flag is a fourth value, the next viewpoint to be switched from the current viewpoint is any one viewpoint in the N viewpoints.
7. The method according to claim 6 , wherein in response to that the value of the neighbor viewpoint flag is the third value, the switching viewpoint information further comprises at least one of a number of target neighbor viewpoints which can be switched from the current viewpoint and viewpoint identifiers of the target neighbor viewpoints.
8. The method according to claim 1 , wherein
in response to that a value of the switching window type is a fifth value, the initial window of the next viewpoint is the same as a user watching window of the current viewpoint; and
in response to that a value of the switching window type is a sixth value, the initial window of the next viewpoint is determined by recommended window property information of the next viewpoint.
9. The method according to claim 1 , wherein the first information corresponding to each of the at least one viewpoint is associated by a first data box.
10. The method according to claim 9 , further comprising:
adding an identifier to at least one viewpoint in the N viewpoints, the identifier of the at least one viewpoint being in the first data box.
11. The method according to claim 1 , further comprising:
adding, for the at least one viewpoint in the N viewpoints, second information to the panoramic picture of the corresponding viewpoint, the second information indicating recommended window property information for the panoramic picture of the current viewpoint.
12. The method according to claim 11 , wherein the recommended window property information of the panoramic picture of the current viewpoint comprises: at least one of a number of recommended sphere regions and information of the recommended sphere regions.
13. A method for de-encapsulating a media file, applied to a device for de-encapsulating a file and comprising:
acquiring a media file of panoramic pictures of N viewpoints, the media file comprising, for at least one viewpoint in the N viewpoints, first information of a panoramic picture of the corresponding viewpoint, and the first information indicating switching information during switching from a panoramic picture of a current viewpoint to a panoramic picture of a next viewpoint; and
switching between the panoramic pictures of different viewpoints according to the first information corresponding to the at least one viewpoint,
wherein the switching information comprises at least one of: switching effect information, switching viewpoint information or switching window information;
the switching effect information comprises a switching effect flag, the switching effect flag indicating whether a switching effect exists during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint;
the switching viewpoint information comprises a neighbor viewpoint flag, the neighbor viewpoint flag indicating whether the next viewpoint to be switched from the current viewpoint is a neighbor viewpoint of the current viewpoint or any one of the N viewpoints; and
the switching window information comprises a switching window type, the switching window type being a type of an initial window of the next viewpoint during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
14. The method according to claim 13 , wherein if a value of the switching effect flag is a second value, the switching effect information further comprises a type of the switching effect, the second value indicating that a switching effect exits during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint; and
the switching the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint according to the first information of the current viewpoint comprises:
switching the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint according to the type of the switching effect.
15. The method according to claim 14 , wherein if a value of the switching effect flag is a first value, the switching effect information further comprises switching effect period information, the first value indicating that the switching effect exits during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint; and the switching effect period information comprises a switching effect period flag, the switching effect period flag indicating whether a period of the switching effect is specified during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
16. The method according to claim 15 , wherein if a value of the switching effect period flag is a first value, the switching effect period information further comprises a period of the switching effect, the first value indicating that the period of the switching effect is specified during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint; and
the switching the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint according to the type of the switching effect comprises:
switching the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint according to the type and period of the switching effect.
17. The method according to claim 13 , wherein the switching between the panoramic pictures of different viewpoints according to the first information corresponding to the at least one viewpoint comprises:
receiving a viewpoint switching operation inputted by a user in response to that the user consumes the panoramic picture of the current viewpoint, the viewpoint switching operation indicating to switch from the current viewpoint to the next viewpoint;
in response to that that the first information comprises the neighbor viewpoint flag, determining the next viewpoint to be switched from the current viewpoint according to the value of the neighbor viewpoint flag;
de-encapsulating and then decoding a panoramic picture item of next viewpoint to obtain a panoramic picture of the next viewpoint; and
switching the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint according to the first information of the current viewpoint.
18. An apparatus for encapsulating a media file, applied to a device for encapsulating a file and comprising:
at least one processor and at least one memory, the at least one memory being configured to store a computer program, and the at least one processor being configured to call and run the computer program stored in the at least one memory and perform:
receiving coded bitstreams of panoramic pictures of N viewpoints, N being a positive integer greater than 1; and
encapsulating the coded bitstreams in an entity group, and respectively adding, for at least one viewpoint in the N viewpoints, first information to a panoramic picture of the corresponding viewpoint, to obtain a media file of the panoramic pictures of the N viewpoints, the first information indicating switching information during switching from a panoramic picture of a current viewpoint to another panoramic picture of a next viewpoint,
wherein the switching information comprises at least one of: switching effect information, switching viewpoint information or switching window information;
the switching effect information comprises a switching effect flag, the switching effect flag indicating whether a switching effect exists during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint;
the switching viewpoint information comprises a neighbor viewpoint flag, the neighbor viewpoint flag indicating whether the next viewpoint to be switched from the current viewpoint is a neighbor viewpoint of the current viewpoint or any one of the N viewpoints; and
the switching window information comprises a switching window type, the switching window type being a type of an initial window of the next viewpoint during switching from the panoramic picture of the current viewpoint to the panoramic picture of the next viewpoint.
19. A non-transitory computer-readable storage medium, storing a computer program, the computer program causing a computer to execute the method for de-encapsulating the media file according to claim 13 .
20. An apparatus for de-encapsulating a media file, comprising:
at least one processor and at least one memory, the at least one memory being configured to store a computer program, and the at least one processor being configured to call and run the computer program stored in the at least one memory and perform the method for de-encapsulating the media file according to claim 13 .