Image processing method, apparatus and system, and storage medium for obtaining real-time video image, selecting target area on image frame, inputting first image of target region into image processing model to obtain target image, and providing first interface for displaying target image on first interface

1 . An image processing method, comprising:

acquiring real-time video images;

selecting a target region on an image frame, at a selected moment, of the real-time video images;

inputting a first image of the target region into an image processing model to obtain a target image; wherein a resolution of the target image is higher than a resolution of the first image; and

providing a first interface and displaying the target image on the first interface;

wherein the inputting the first image of the target region into the image processing model to obtain the target image comprises:

acquiring, in a time axis sequence, a picture of a current frame, corresponding to the selected moment, of the target region of the real-time video images, and pictures of M frames preceding the picture of the current frame and pictures of N frames behind the picture of the current frame, wherein M>N>0, and M and N are integers;

determining a static image and a dynamic image in the first image according to the picture of the current frame, and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame; wherein the static image is an image of an object in the first image whose position remains unchanged relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame; and the dynamic image is an image of an object in the first image whose position changes relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame;

inputting the first image in which the static image and the dynamic image are determined into a matting algorithm model to obtain an independent static image and an independent dynamic image separated from each other;

inputting the independent static image and the independent dynamic image into a super-resolution algorithm model respectively to obtain a target static image and a target dynamic image; and

superimposing the target static image and the target dynamic image to obtain the target image.

2 . The image processing method according to claim 1 , wherein the selecting the target region on the image frame, at the selected moment, of the real-time video images comprises:

receiving a first instruction input by a user; and

selecting the target region on the image frame, at the selected moment, of the real-time video images in response to the first instruction.

3 . The image processing method according to claim 1 , wherein the determining the static image and the dynamic image in the first image according to the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame comprises:

comparing the first image of the picture of the current frame with the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, recognizing an image of an object in the first image whose position remains unchanged relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, and determining the image as the static image; and

comparing the first image of the picture of the current frame with the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, recognizing an image of an object in the first image whose position changes relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, and determining the image as the dynamic image.

4 . The image processing method according to claim 1 , wherein the determining the static image and the dynamic image in the first image according to the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame comprises:

extracting, in a time axis sequence, at an interval of a set time period, one-frame picture from the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame to obtain X frames of pictures; wherein 0<X<M+N+1, and X is an integer; and

comparing the first image of the picture of the current frame with the X frames of pictures, recognizing an image of an object in the first image whose position remains unchanged relative to the X frames of pictures, and determining the image as the static image; and

comparing the first image of the picture of the current frame with the X frames of pictures, recognizing an image of an object in the first image whose position changes relative to the X frames of pictures, and determining the image as the dynamic image.

5 . The image processing method according to claim 1 , wherein the determining the static image and the dynamic image in the first image according to the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame comprises:

receiving a picture of a static object input by a user, wherein the static object is a static object in the first image;

comparing the first image of the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame with the picture of the static object, respectively, and determining, as the dynamic image, an image of an object, in the first image and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, whose position changes relative to the picture of the static object.

6 . The image processing method according to claim 1 , wherein the determining the static image and the dynamic image in the first image according to the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame comprises:

receiving a picture of a static object input by a user, wherein the static object is a static object in the first image;

extracting, in a time axis sequence, at an interval of a set time period, one-frame picture from the picture of the current frame and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame to obtain X frames of pictures; wherein 0<X<M+N+1, and X is an integer;

comparing the first image of the picture of the current frame and the X frames of pictures with the picture of the static object, respectively, and determining, as the dynamic image, an image of an object, in the first image and the X frames of pictures, whose position changes relative to the picture of the static object.

7 . The image processing method according to claim 1 , wherein the method further comprises: inputting the target image into a data zoom model to obtain an amplified target image.

8 . The image processing method according to claim 1 , wherein, in a time axis sequence, one super-resolution processing is performed on the independent static image at an interval of a set time period; and

a super-resolution processing is performed in real time on the independent dynamic image.

9 . The image processing method according to claim 1 , wherein a resolution of the first image is any one of 2k, 4k, and 8k.

10 . The image processing method according to claim 1 , wherein the target region is a partial region or entire region of the image frame, at the selected moment, of the real-time video images.

11 . An image processing apparatus, comprising:

a memory, configured to store one or more computer programs thereon; and

a processor, coupled to the memory, and configured to execute the one or more computer programs to implement the image processing method according to claim 1 .

12 . An image processing system, comprising the image processing apparatus according to claim 11 ;

further comprising: a camera, a content distribution network streaming media server and a display terminal;

the camera acquires real-time video images and transmits the real-time video images to the video image transmission processing apparatus;

the content distribution network streaming media server apparatus receives the real-time video images and transmits the real-time video images to the image processing apparatus;

the image processing apparatus processes the real-time video images to obtain a target image and transmits the target image to the display terminal; and

the display terminal receives and displays the target image.

13 . The image processing system according to claim 12 , wherein the display terminal has a resolution consistent with a resolution of the target image.

14 . A non-transitory computer-readable storage medium, storing a computer program which, when running on a computer, enables the computer to implement the image processing method according to claim 1 .

15 . An image processing method, comprising:

acquiring real-time video images;

selecting a target region on an image frame, at a selected moment, of the real-time video images;

inputting a first image of the target region into an image processing model to obtain a target image; wherein a resolution of the target image is higher than a resolution of the first image; and

providing a first interface and displaying the target image on the first interface;

wherein the inputting the first image of the target region into the image processing model to obtain the target image, comprises:

acquiring, in a time axis sequence, a picture of a current frame, corresponding to the selected moment, of the target region of the real-time video images, and pictures of M frames preceding the picture of the current frame and pictures of N frames behind the picture of the current frame, wherein M>N>0, and M and N are integers;

dividing the first image into a first region and a second region, wherein an image in the first region is a static image, and an image in the second region are a static image and a dynamic image; wherein the static image is an image of an object in the first image whose position remains unchanged relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, and the dynamic image is an image of an object in the first image whose position changes relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame;

determining the static image and dynamic image in the image in the second region according to the picture of the current frame, and pictures of M frames preceding the picture of the current frame and pictures of N frames behind the picture of the current frame;

inputting the first image in which the static image and the dynamic image are determined into a matting algorithm model to obtain an independent static image and an independent dynamic image separated from each other;

inputting the independent static image and the independent dynamic image into a super-resolution algorithm model respectively to obtain a target static image and a target dynamic image;

superimposing the target static image and the target dynamic image to obtain the target image.

16 . The image processing method according to claim 15 , wherein the determining the static image and the dynamic image in the image in the second region according to the picture of the current frame and pictures of M frames preceding the picture of the current frame and pictures of N frames behind the picture of the current frame comprises:

comparing the image in the second region with the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, recognizing an image of an object in the image in the second region whose position remains unchanged relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, and determining the image as the static image;

comparing the image in the second region with the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, recognizing an image of an object in the image in the second region whose position changes relative to the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame, and determining the image as the dynamic image;

or,

extracting, in a time axis sequence, at an interval of a set time period, one-frame picture from the picture of the current frame and pictures of M frames preceding the picture of the current frame and pictures of N frames behind the picture of the current frame to obtain X frames of pictures; wherein 0<X<M+N+1, and X is an integer;

comparing the image in the second region with the X frames of pictures, recognizing an image of an object in the image in the second region whose position remains unchanged relative to the X frames of pictures, and determining the image as the static image;

comparing the image in the second region with the X frames of pictures, recognizing an image of an object in the image in the second region whose position changes relative to the X frames of pictures, and determining the image as the dynamic image;

or,

receiving a picture of a static object input by a user, wherein the static object is a static object in the first image;

comparing the image in the second region and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame with the picture of the static object, respectively, and determining, as the dynamic image, an image of the an object in the image in the second region and the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame whose position changes relative to the picture of the static object;

or,

receiving a picture of a static object input by a user, wherein the static object is a static object in the first image;

extracting, in a time axis sequence, at an interval of a set time period, one-frame picture from the picture of the current frame the pictures of M frames preceding the picture of the current frame and the pictures of N frames behind the picture of the current frame to obtain X frames of pictures; wherein 0<X<M+N+1, and X is an integer; and

comparing the image in the second region and the X frames of pictures with the picture of the static object, respectively, and determining, as the dynamic image, an image of an object, in the image in the second region and the X frames of pictures, whose position changes relative to the picture of the static object.

17 . An image processing apparatus, comprising:

a memory, configured to store one or more computer programs thereon; and

a processor, coupled to the memory, and configured to execute the one or more computer programs to implement the image processing method according to claim 15 .

18 . An image processing system, comprising the image processing apparatus according to claim 17 ;

further comprising: a camera, a content distribution network streaming media server and a display terminal;

the camera acquires real-time video images and transmits the real-time video images to the video image transmission processing apparatus;

the content distribution network streaming media server receives the real-time video images and transmits the real-time video images to the image processing apparatus;

the image processing apparatus processes the real-time video images to obtain a target image and transmits the target image to the display terminal; and

the display terminal receives and displays the target image.

19 . A non-transitory computer-readable storage medium, storing a computer program which, when running on a computer, enables the computer to implement the image processing method according to claim 15 .