Method, apparatus, and device for processing video data and computer storage medium
Provided is a method for processing video data. The method includes: acquiring a second outline of at least one object in an (n+1) th image frame of a to-be-compressed video data group based on a fuzzy algorithm; determining a motion vector of the at least one object according to the second outline and a first outline of the at least one object in an n th image frame of the to-be-compressed video data group; acquiring compressed video data according to the motion vector and a start image frame of to-be-compressed video data; and sending the compressed video data to an apparatus for displaying images.
1 . A method for processing video data, applicable to a field of video compression and wireless communication, and comprising:
acquiring a to-be-compressed video data group;
acquiring, in the to-be-compressed video data group, a motion vector of at least one object in at least two adjacent image frames;
acquiring compressed video data based on a start image frame of the to-be-compressed video data group and the motion vector of the at least one object in the at least two adjacent image frames; and
sending the compressed video data to an apparatus for displaying images,
wherein acquiring, in the to-be-compressed video data group, the motion vector of the at least one object in the at least two adjacent image frames comprises:
acquiring a first outline of the at least one object in an n th image frame of the to-be-compressed video data group, wherein n≥1;
acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm; and
determining the motion vector of the at least one object based on the first outline and the second outline;
wherein acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm comprises:
acquiring a plurality of pixels in a target region in the (n+1) th image frame based on the target region where a first pixel on the first outline is located;
determining a fuzzy membership function and a fuzzy control formula of an inter-frame similarity between the first pixel and the plurality of pixels according to color difference values between the first pixel and the plurality of pixels, wherein the fuzzy membership function is configured to output, based on difference values between each of the plurality of pixels and the first pixel, a probability that a sub-pixel of each of the pixels belongs to a negative set, a zero set, or a positive set, and the fuzzy control formula is configured to determine, according to an output of the fuzzy membership function, a probability that each of the pixels belongs to a matched set and a probability that each of the pixels belongs to an unmatched set;
acquiring a similarity between each of the pixels and the first pixel by defuzzifying the probability that each of the pixels belongs to the matched set and the probability that each of the pixels belongs to the unmatched set;
determining pixels with similarities greater than a first threshold as target pixels; and
acquiring the second outline based on the target pixels.
2 . The method for processing video data according to claim 1 , wherein images of the to-be-compressed video data group comprise a plurality of macroblocks, and the target region is a macroblock where the first pixel is located.
3 . The method for processing video data according to claim 1 , wherein acquiring the to-be-compressed video data group comprises:
acquiring to-be-compressed video data; and
dividing the to-be-compressed video data into a plurality of to-be-compressed video data groups based on a luminance difference value and a chroma difference value, wherein one to-be-compressed video data group comprises a plurality of consecutive image frames.
4 . The method for processing video data according to claim 2 , wherein acquiring the compressed video data based on the start image frame of the to-be-compressed video data group and the motion vector of the at least one object in the at least two adjacent image frames comprises:
acquiring energy of a low-frequency component of each macroblock in the start image frame;
determining energy difference values between energy of a target macroblock in the start image frame and energy of each macroblock other than the target macroblock;
acquiring intra-frame compressed data of the start image frame by performing intra-frame compression on the start image frame based on the energy difference values; and
acquiring the compressed video data based on the intra-frame compressed data and the motion vector of the at least one object in the at least two adjacent image frames.
5 . The method for processing video data according to claim 4 , wherein acquiring the intra-frame compressed data of the start image frame by performing the intra-frame compression on the start image frame based on the energy difference values comprises:
determining macroblocks with an energy difference value between energy of the macroblock and energy of the target macroblock greater than a second threshold as data macroblocks; and
acquiring the intra-frame compressed data based on the target macroblock and the data macroblocks.
6 . The method for processing video data according to claim 1 , wherein prior to acquiring the to-be-compressed video data group, the method further comprises:
acquiring a resolution of the to-be-compressed video data;
determining, based on a preset resolution list, an identifier corresponding to the resolution; and
sending the identifier to the apparatus for displaying images.
7 . An apparatus for processing video data, comprising:
a processor; and
a memory configured to store one or more instructions executable by the processor;
wherein the processor, when loading and executing the one or more instructions, is caused to perform:
acquiring a to-be-compressed video data group;
acquiring, in the to-be-compressed video data group, a motion vector of at least one object in at least two adjacent image frames;
acquiring compressed video data based on a start image frame of the to-be-compressed video data group and the motion vector of the at least one object in the at least two adjacent image frames; and
sending the compressed video data to an apparatus for displaying images,
wherein acquiring, in the to-be-compressed video data group, the motion vector of the at least one object in the at least two adjacent image frames comprises:
acquiring a first outline of the at least one object in an n th image frame of the to-be-compressed video data group, wherein n≥1;
acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm; and
determining the motion vector of the at least one object based on the first outline and the second outline;
wherein acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm comprises:
acquiring a plurality of pixels in a target region in the (n+1) th image frame based on the target region where a first pixel on the first outline is located;
determining a fuzzy membership function and a fuzzy control formula of an inter-frame similarity between the first pixel and the plurality of pixels according to color difference values between the first pixel and the plurality of pixels, wherein the fuzzy membership function is configured to output, based on difference values between each of the plurality of pixels and the first pixel, a probability that a sub-pixel of each pixel belongs to a negative set, a zero set, or a positive set, and the fuzzy control formula is configured to determine, according to an output of the fuzzy membership function, a probability that each of the pixels belongs to a matched set and a probability that each of the pixels belongs to an unmatched set;
acquiring a similarity between each of the pixels and the first pixel by defuzzifying the probability that each of the pixels belongs to the matched set and the probability that each of the pixels belongs to the unmatched set; and
determining pixels with similarities greater than a first threshold as target pixels, wherein the target pixels are pixels, corresponding to the first pixel, in the second outline.
8 . The apparatus for processing video data as defined in claim 7 , wherein the processor, when loading and executing the one or more instructions, is caused to perform:
acquiring to-be-compressed video data; and
dividing the to-be-compressed video data into a plurality of to-be-compressed video data groups based on a luminance difference value and a chroma difference value, wherein one to-be-compressed video data group comprises a plurality of consecutive image frames.
9 . A device for processing video data, comprising a processor and a memory storing at least one instruction, at least one program, a code set, or an instruction set; wherein the at least one instruction, the at least one program, the code set, or the instruction set, when loaded and executed by the processor, causes the processor to perform:
acquiring a to-be-compressed video data group;
acquiring, in the to-be-compressed video data group, a motion vector of at least one object in at least two adjacent image frames;
acquiring compressed video data based on a start image frame of the to-be-compressed video data group and the motion vector of the at least one object in the at least two adjacent image frames; and
sending the compressed video data to an apparatus for displaying images,
wherein acquiring, in the to-be-compressed video data group, the motion vector of the at least one object in the at least two adjacent image frames comprises:
acquiring a first outline of the at least one object in an n th image frame of the to-be-compressed video data group, wherein n≥1;
acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm; and
determining the motion vector of the at least one object based on the first outline and the second outline;
wherein acquiring a second outline of the at least one object by determining, based on a position of the first outline of the n th image frame, and positions and colors of pixels on the first outline, a position of the second outline of the at least one object at a corresponding position in an (n+1) th image frame of the to-be-compressed video data group by a fuzzy algorithm comprises:
acquiring a plurality of pixels in a target region in the (n+1) th image frame based on the target region where a first pixel on the first outline is located;
determining a fuzzy membership function and a fuzzy control formula of an inter-frame similarity between the first pixel and the plurality of pixels according to color difference values between the first pixel and the plurality of pixels, wherein the fuzzy membership function is configured to output, based on difference values between each of the plurality of pixels and the first pixel, a probability that a sub-pixel of each of the pixels belongs to a negative set, a zero set, or a positive set, and the fuzzy control formula is configured to determine, according to an output of the fuzzy membership function, a probability that each of the pixels belongs to a matched set and a probability that each of the pixels belongs to an unmatched set;
acquiring a similarity between each of the pixels and the first pixel by defuzzifying the probability that each of the pixels belongs to the matched set and the probability that each of the pixels belongs to the unmatched set;
determining pixels with similarities greater than a first threshold as target pixels; and
acquiring the second outline based on the target pixels.
10 . A non-transitory computer storage medium storing at least one instruction, at least one program, a code set, or an instruction set therein, wherein the at least one instruction, the at least one program, the code set, or the instruction set, when loaded and executed by a processor, causes the processor to perform the method for processing video data as defined in claim 1 .
11 . The apparatus for processing video data according to claim 7 , wherein images of the to-be-compressed video data group comprise a plurality of macroblocks, and the target region is a macroblock where the first pixel is located.
12 . The apparatus for processing video data according to claim 11 , wherein the processor, when loading and executing the one or more instructions, is caused to perform:
acquiring energy of a low-frequency component of each macroblock in the start image frame;
determining energy difference values between energy of a target macroblock in the start image frame and energy of each macroblock other than the target macroblock;
acquiring intra-frame compressed data of the start image frame by performing intra-frame compression on the start image frame based on the energy difference values; and
acquiring the compressed video data based on the intra-frame compressed data and the motion vector of the at least one object in the at least two adjacent image frames.
13 . The apparatus for processing video data according to claim 12 , wherein the processor, when loading and executing the one or more instructions, is caused to perform:
determining macroblocks with an energy difference value between energy of the macroblock and energy of the target macroblock greater than a second threshold as data macroblocks; and
acquiring the intra-frame compressed data based on the target macroblock and the data macroblocks.
14 . The apparatus for processing video data according to claim 7 , wherein the processor, when loading and executing the one or more instructions, is caused to perform:
acquiring a resolution of the to-be-compressed video data;
determining, based on a preset resolution list, an identifier corresponding to the resolution; and
sending the identifier to the apparatus for displaying images.
15 . The device for processing video data according to claim 9 , wherein images of the to-be-compressed video data group comprise a plurality of macroblocks, and the target region is a macroblock where the first pixel is located.
16 . The device for processing video data according to claim 9 , wherein the at least one instruction, the at least one program, the code set, or the instruction set, when loaded and executed by the processor, causes the processor to perform:
acquiring to-be-compressed video data; and
dividing the to-be-compressed video data into a plurality of to-be-compressed video data groups based on a luminance difference value and a chroma difference value, wherein one to-be-compressed video data group comprises a plurality of consecutive image frames.
17 . The device for processing video data according to claim 15 , wherein the at least one instruction, the at least one program, the code set, or the instruction set, when loaded and executed by the processor, causes the processor to perform:
acquiring energy of a low-frequency component of each macroblock in the start image frame;
determining energy difference values between energy of a target macroblock in the start image frame and energy of each macroblock other than the target macroblock;
acquiring intra-frame compressed data of the start image frame by performing intra-frame compression on the start image frame based on the energy difference values; and
acquiring the compressed video data based on the intra-frame compressed data and the motion vector of the at least one object in the at least two adjacent image frames.