IP Library Granted Patent US 12,688,631
Granted Patent B2
US 12,688,631 · App. 18/567,138 · Granted Jul 21, 2026

Image processing method and apparatus, device, medium and program product

Inventor: Guang Zeng (Beijing, CN)
Assignee: Beijing Zitiao Network Technology Co., Ltd.
G06T11/60G06T11/10G06T2210/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,688,631
App. No.
18/567,138
Granted
Jul 21, 2026
Kind
B2
Abstract

The present disclosure provides an image processing method and apparatus, device, medium and program product. In the image processing method provided by the present disclosure, a deformation instruction sequence to be applied on a target object in a to-be-processed image is obtained, and then deformation offsets are sequentially superimposed on the to-be-processed image texture based on deformation instructions in the deformation instruction sequence to determine a superimposed deformation image texture. Finally, the target object in the to-be-processed image is deformed based on the superimposed deformation image texture to generate a processed image. Since the superimposition of deformation effect offset is performed on a lower-resolution picture, the overhead is smaller; when multiple effects are superimposed on the mobile side, smooth operation can still be guaranteed. In addition, since only a single interpolation operation is performed, these is less loss of the picture quality.

Claims (59)

1 . An image processing method, comprising:

obtaining a deformation instruction sequence to be applied on an object in an image, the deformation instruction sequence comprising a plurality of deformation instructions which are sequentially inputted;

sequentially superimposing a deformation offset corresponding to each deformation instruction in the deformation instruction sequence on an image texture to determine a superimposed deformation image texture that embodies an accumulated deformation offset of the deformation instruction sequence, wherein the image texture is an image texture corresponding to the image, and a resolution of the image texture is smaller than that of the image; and

deforming the object in the image according to the superimposed deformation image texture to generate a processed image;

wherein deforming the object in the image based on the superimposed deformation image texture to generate the processed image comprises:

performing, according to a position of a superimposed deformation key point, a position adjustment to a position of a corresponding original key point to cause the adjusted position of the original key point to overlap the position of the superimposed deformation key point, the position of the superimposed deformation key point being a position of a key point on the object in the superimposed deformation image texture, the position of the original key point being a position of a key point on the object in the image texture, the processed image being an image generated after the position adjustment.

2 . The image processing method of claim 1 , wherein sequentially superimposing the deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture comprises:

step 1: superimposing a first deformation offset on the image texture based on a first deformation instruction in the deformation instruction sequence to determine a first deformation image texture;

step 2: superimposing a second deformation offset on the first deformation image texture based on a second deformation instruction in the deformation instruction sequence to determine a second deformation image texture, the second deformation instruction being a subsequent instruction of the first deformation instruction; and

iteratively performing steps 1 to 2 from the first deformation instruction in the deformation instruction sequence, until deformation offsets corresponding to all deformation instructions in the deformation instruction sequence are superimposed to determine the superimposed deformation image texture.

3 . The image processing method of claim 2 , wherein the object comprises a first object and a second object, the first deformation instruction is used for deforming the first object, and the second deformation instruction is used for deforming the second object.

4 . The image processing method of claim 2 , wherein before iteratively superimposing the first deformation offset or the second deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture, the image processing method further comprises:

obtaining an initial key point set of the object in the image, the initial key point set being used as initial position information of the image texture before the first deformation offset or the second deformation offset is superimposed.

5 . The image processing method of claim 4 , wherein in case that the first deformation instruction is a head instruction in the deformation instruction sequence, superimposing the first deformation offset on the image texture based on the first deformation instruction in the deformation instruction sequence to determine the first deformation image texture comprises:

in response to the first deformation instruction, moving a position of at least one key point in the initial key point set to generate an adjusted key point set, the first deformation instruction being applied on the at least one key point to cause the at least one key point to be offset;

generating a mesh based on the adjusted key point set, vertex information of the mesh comprising initial position information of each key point in the initial key point set and adjusted position information of each key point in the adjusted key point set;

obtaining a difference value between the adjusted position information and the initial position information as a first deformation offset of each key point; and

superimposing the first deformation offset on the image texture to determine the first deformation image texture.

6 . The image processing method of claim 5 , wherein the first deformation offset corresponding to each mesh vertex of the mesh is stored in two 8-bit precision numbers, the two 8-bit precision numbers being used for storing an integer part and a fractional part of the first deformation offset respectively.

7 . An electronic device, comprising:

a processor; and

a memory, configured for storing a computer program;

wherein the processor is configured for performing an image processing method comprising:

obtaining a deformation instruction sequence to be applied on an object in an image, the deformation instruction sequence comprising a plurality of deformation instructions which are sequentially inputted;

sequentially superimposing a deformation offset corresponding to each deformation instruction in the deformation instruction sequence on an image texture to determine a superimposed deformation image texture that embodies an accumulated deformation offset of the deformation instruction sequence, wherein the image texture is an image texture corresponding to the image, and a resolution of the image texture is smaller than that of the image; and

deforming the object in the image according to the superimposed deformation image texture to generate a processed image;

wherein deforming the object in the image based on the superimposed deformation image texture to generate the processed image comprises:

performing, according to a position of a superimposed deformation key point, a position adjustment to a position of a corresponding original key point to cause the adjusted position of the original key point to overlap the position of the superimposed deformation key point, the position of the superimposed deformation key point being a position of a key point on the object in the superimposed deformation image texture, the position of the original key point being a position of a key point on the object in the image texture, the processed image being an image generated after the position adjustment.

8 . The electronic device of claim 7 , wherein sequentially superimposing the deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture comprises:

step 1: superimposing a first deformation offset on the image texture based on a first deformation instruction in the deformation instruction sequence to determine a first deformation image texture;

step 2: superimposing a second deformation offset on the first deformation image texture based on a second deformation instruction in the deformation instruction sequence to determine a second deformation image texture, the second deformation instruction being a subsequent instruction of the first deformation instruction; and

iteratively performing steps 1 to 2 from the first deformation instruction in the deformation instruction sequence, until deformation offsets corresponding to all deformation instructions in the deformation instruction sequence are superimposed to determine the superimposed deformation image texture.

9 . The electronic device of claim 8 , wherein the object comprises a first object and a second object, the first deformation instruction is used for deforming the first object, and the second deformation instruction is used for deforming the second object.

10 . The electronic device of claim 8 , wherein before iteratively superimposing the first deformation offset or the second deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture, the image processing method further comprises:

obtaining an initial key point set of the object in the image, the initial key point set being used as initial position information of the image texture before the first deformation offset or the second deformation offset is superimposed.

11 . The electronic device of claim 10 , wherein in case that the first deformation instruction is a head instruction in the deformation instruction sequence, superimposing the first deformation offset on the image texture based on the first deformation instruction in the deformation instruction sequence to determine the first deformation image texture comprises:

in response to the first deformation instruction, moving a position of at least one key point in the initial key point set to generate an adjusted key point set, the first deformation instruction being applied on the at least one key point to cause the at least one key point to be offset;

generating a mesh based on the adjusted key point set, vertex information of the mesh comprising initial position information of each key point in the initial key point set and adjusted position information of each key point in the adjusted key point set;

obtaining a difference value between the adjusted position information and the initial position information as a first deformation offset of each key point; and

superimposing the first deformation offset on the image texture to determine the first deformation image texture.

12 . The electronic device of claim 11 , wherein the first deformation offset corresponding to each mesh vertex of the mesh is stored in two 8-bit precision numbers, the two 8-bit precision numbers being used for storing an integer part and a fractional part of the first deformation offset respectively.

13 . A computer program product being stored on a non-transitory computer storage medium comprising computer instructions which, when executed by a processor, cause the processor to perform an image processing method comprising:

obtaining a deformation instruction sequence to be applied on an object in an image, the deformation instruction sequence comprising a plurality of deformation instructions which are sequentially inputted;

sequentially superimposing a deformation offset corresponding to each deformation instruction in the deformation instruction sequence on an image texture to determine a superimposed deformation image texture that embodies an accumulated deformation offset of the deformation instruction sequence, wherein the image texture is an image texture corresponding to the image, and a resolution of the image texture is smaller than that of the image; and

deforming the object in the image according to the superimposed deformation image texture to generate a processed image;

wherein deforming the object in the image based on the superimposed deformation image texture to generate the processed image comprises:

performing, according to a position of a superimposed deformation key point, a position adjustment to a position of a corresponding original key point to cause the adjusted position of the original key point to overlap the position of the superimposed deformation key point, the position of the superimposed deformation key point being a position of a key point on the object in the superimposed deformation image texture, the position of the original key point being a position of a key point on the object in the image texture, the processed image being an image generated after the position adjustment.

14 . The computer program product of claim 13 , wherein sequentially superimposing the deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture comprises:

step 1: superimposing a first deformation offset on the image texture based on a first deformation instruction in the deformation instruction sequence to determine a first deformation image texture;

step 2: superimposing a second deformation offset on the first deformation image texture based on a second deformation instruction in the deformation instruction sequence to determine a second deformation image texture, the second deformation instruction being a subsequent instruction of the first deformation instruction; and

iteratively performing steps 1 to 2 from the first deformation instruction in the deformation instruction sequence, until deformation offsets corresponding to all deformation instructions in the deformation instruction sequence are superimposed to determine the superimposed deformation image texture.

15 . The computer program product of claim 14 , wherein the object comprises a first object and a second object, the first deformation instruction is used for deforming the first object, and the second deformation instruction is used for deforming the second object.

16 . The computer program product of claim 14 , wherein before iteratively superimposing the first deformation offset or the second deformation offset corresponding to each deformation instruction in the deformation instruction sequence on the image texture to determine the superimposed deformation image texture, the image processing method further comprises:

obtaining an initial key point set of the object in the image, the initial key point set being used as initial position information of the image texture before the first deformation offset or the second deformation offset is superimposed.

17 . The computer program product of claim 16 , wherein in case that the first deformation instruction is a head instruction in the deformation instruction sequence, superimposing the first deformation offset on the image texture based on the first deformation instruction in the deformation instruction sequence to determine the first deformation image texture comprises:

in response to the first deformation instruction, moving a position of at least one key point in the initial key point set to generate an adjusted key point set, the first deformation instruction being applied on the at least one key point to cause the at least one key point to be offset;

generating a mesh based on the adjusted key point set, vertex information of the mesh comprising initial position information of each key point in the initial key point set and adjusted position information of each key point in the adjusted key point set;

obtaining a difference value between the adjusted position information and the initial position information as a first deformation offset of each key point; and

superimposing the first deformation offset on the image texture to determine the first deformation image texture.