Video processing method and apparatus, terminal device, server, and storage medium
View Patent ↗Aspects of the disclosure can provide a method, a corresponding target video processing package may be automatically obtained through matching according to scene description information, so that an operation of manually making a selection by a user in the related art is omitted. Therefore, matching efficiency of video processing manners may be improved. In addition, a plurality of video processing manners may be obtained through matching at a time, so that the matching efficiency is further improved. In addition, because the target video processing package is dynamically and correspondingly obtained through matching based on the scene description information, the target video processing package obtained through matching can be caused to accord with actual video content as much as possible. Further, accuracy of video processing may be improved, to satisfy an actual requirement of a user as much as possible.
1. A video processing method, comprising:
receiving a captured target video of a user;
obtaining, by a terminal device, scene description information of a target shooting scene, the scene description information including feature description information of a shot object in the target shooting scene of the captured target video;
obtaining, by the terminal device, through matching based on the feature description information of the shot object in the scene description information, a target video processing package that corresponds to the target shooting scene and includes a plurality of content to be added to the target video captured of the target shooting scene, the target video processing package being based on a video processing package that includes the plurality of content added to a processed video uploaded to a server by another user; and
adding, by the terminal device, the plurality of content to the captured target video based on the target video processing package,
wherein the plurality of content included in the obtained target video processing package includes at least one of a visual overlay or audio.
2. The method according to claim 1 , wherein the obtaining through matching further comprises:
performing word vector representation on the scene description information, to obtain a video content feature variable;
inputting the video content feature variable into a pre-established package recommendation model for performing package matching, to obtain at least one recommended video processing package matching the scene description information; and
determining the target video processing package based on the at least one recommended video processing package.
3. The method according to claim 2 , wherein the determining the target video processing package further comprises:
determining the video processing package with a highest usage frequency in the at least one recommended video processing package as the target video processing package; or
determining the video processing package having a maximum similarity with a priority video processing package in the at least one recommended video processing package as the target video processing package, the priority video processing package being a video processing package that is obtained through matching according to user attribute information.
4. The method according to claim 2 , wherein the obtaining through matching further comprises:
determining whether there is a recommended video processing package having a similarity with a priority video processing package greater than or equal to a predetermined similarity in at least one recommended video processing package, the priority video processing package being obtained through matching according to user attribute information;
determining the recommended video processing package as the target video processing package when there is the recommended video processing package having the similarity with the priority video processing package greater than or equal to the predetermined similarity in the at least one recommended video processing package; and
determining the priority video processing package as the target video processing package when there is no recommended video processing package having the similarity with the priority video processing package greater than or equal to the predetermined similarity in the at least one recommended video processing package.
5. The method according to claim 1 , wherein the obtaining through matching further comprises:
inputting the scene description information into a preset set of correspondences between scenes and video processing packages for performing a matching search, to obtain the video processing package having a highest matching degree with the scene description information; and
determining the video processing package having the highest matching degree with the scene description information as the target video processing package.
6. The method according to claim 1 , wherein
the obtaining through matching further comprises:
determining separately target video processing packages before and after the shot object changes when the scene description information indicates that the shot object in the target shooting scene changes; and
the processing the captured target video further comprises:
processing separately the captured target video by using the corresponding target video processing packages before and after the shot object changes.
7. The method according to claim 1 , wherein the target video processing package includes at least the visual overlay and the audio to be added to the target video captured of the target shooting scene.
8. The method according to claim 1 , wherein the obtaining through matching comprises:
obtaining the target video processing package by a video application that is downloaded to and installed on the terminal device, the video application being configured to capture the target video of the user.
9. The method according to claim 8 , wherein the video application is configured to upload the one of the captured target video and the processed captured target video to the server that publishes the processed captured target video and the processed video uploaded to the server by the another user.
10. The method according to claim 1 , wherein the obtaining through matching further comprises:
determining the video processing package of the processed video, generated by the another user, as the target video processing package based on scene description information of the processed video and the scene description information of the target shooting scene.
11. The method according to claim 1 , wherein the obtaining through matching comprises:
obtaining the target video processing package from the server to which the processed video is uploaded by the another user.
12. A terminal device comprising processing circuitry configured to:
receive a captured target video of a user;
obtain scene description information of a target shooting scene, the scene description information including feature description information of a shot object in the target shooting scene of the captured target video;
obtain through matching, based on the feature description information of the shot object in the scene description information, a target video processing package corresponding to the target shooting scene, the target video processing package including a plurality of content to be added to the target video captured of the target shooting scene, the target video processing package being based on a video processing package that includes the plurality of content added to a processed video uploaded to a server by another user; and
add the plurality of content to the captured target video based on the target video processing package,
wherein the plurality of content included in the obtained target video processing package includes at least one of a visual overlay or audio.
13. The terminal device according to claim 12 , wherein the processing circuitry is further configured to:
perform word vector representation on the scene description information to obtain a video content feature variable;
input the video content feature variable into a pre-established package recommendation model for performing package matching to obtain at least one recommended video processing package matching the scene description information; and
determine the target video processing package according to the at least one recommended video processing package.
14. The terminal device according to claim 13 , wherein the processing circuitry is further configured to:
determine the video processing package with a highest usage frequency in the at least one recommended video processing package as the target video processing package; or
determine the video processing package having a maximum similarity with a priority video processing package in the at least one recommended video processing package as the target video processing package, the priority video processing package being a video processing package that is obtained through matching based on user attribute information.
15. The terminal device according to claim 12 , wherein the processing circuitry is further configured to:
determine whether there is a recommended video processing package having a similarity with a priority video processing package greater than or equal to a predetermined similarity in at least one recommended video processing package, the priority video processing package being obtained through matching according to user attribute information;
determine the recommended video processing package as the target video processing package when there is the recommended video processing package having the similarity with the priority video processing package greater than or equal to the predetermined similarity in the at least one recommended video processing package; and
determine the priority video processing package as the target video processing package when there is no recommended video processing package having the similarity with the priority video processing package greater than or equal to the predetermined similarity in the at least one recommended video processing package.
16. The terminal device according to claim 12 , wherein the processing circuitry is further configured to:
input the scene description information into a preset set of correspondences between scenes and video processing packages for performing a matching search to obtain the video processing package having a highest matching degree with the scene description information; and
determine the video processing package having the highest matching degree with the scene description information as the target video processing package.
17. The terminal device according to claim 13 , wherein the processing circuitry is further configured to:
determine separately target video processing packages before and after the shot object changes when the scene description information indicates that the shot object in the target shooting scene changes; and
process separately the captured target video by using the corresponding target video processing packages before and after the shot object changes.
18. The terminal device according to claim 12 , wherein the processing circuitry is further configured to:
obtain a preview video of the target shooting scene, or obtain the target video actually shot in the target shooting scene;
perform image recognition on a video sequence frame of the preview video or a video sequence frame of the target video to obtain key feature information of each frame, the key feature information being feature information of the shot object occupying a largest area and/or visually presented in a foremost location in each frame; and
determine the scene description information according to the key feature information of all frames.
19. A video processing apparatus, comprising:
a memory that is configured to store program instructions; and
a processor that is configured to invoke the program instructions stored in the memory, to perform, according to the program instructions, operations comprised in the method according to claim 1 .
20. A non-transitory storage medium, storing computer-executable instructions, the computer-executable instructions causing a computer to perform:
receiving a captured target video of a user;
obtaining scene description information of a target shooting scene, the scene description information including feature description information of a shot object in the target shooting scene of the captured target video;
obtaining through matching based on the feature description information of the shot object in the scene description information, a target video processing package that corresponds to the target shooting scene and includes a plurality of content to be added to the target video captured of the target shooting scene, the target video processing package being based on a video processing package that includes the plurality of content added to a processed video uploaded to a server by another user; and
adding the plurality of content to the captured target video based on the target video processing package,
wherein the plurality of content included in the obtained target video processing package includes at least one of a visual overlay or audio.