IP Library › Granted Patent US 11,538,207
Granted Patent B2
US 11,538,207 · App. 17/073,769 · Granted Dec 27, 2022

Image processing method and apparatus, image device, and storage medium

Inventors: Tong Li (Beijing, CN); Wentao Liu (Beijing, CN); Chen Qian (Beijing, CN)
Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
G06T11/60G06T7/0014G06T7/246G06T7/73G06T7/74G06T13/40G06V40/10G06V40/176G06T2200/04G06T2207/30196G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,538,207
App. No.
17/073,769
Granted
Dec 27, 2022
Kind
B2
Abstract

An image processing method and apparatus, a device, and a storage medium are provided. The image processing method includes: obtaining key points of a reference region of an object in an image; determining the orientation of the reference region according to the key points of the reference region; and performing deformation processing on a region to be adjusted of the object based on the orientation of the reference region, where the region to be adjusted is the same as or different from the reference region.

Claims (72)

1. An image processing method, comprising:

obtaining key points of a reference region of an object in an image;

determining an orientation of the reference region according to the key points of the reference region; and

performing deformation processing on a region to be adjusted of the object based on the orientation of the reference region, wherein the region to be adjusted is the same as or different from the reference region,

wherein determining the orientation of the reference region according to the key points of the reference region comprises:

obtaining at least three key points in the reference region, wherein the at least three key points are not on a same straight line;

determining a target vector based on the at least three key points; and

taking a direction of the target vector as the orientation of the reference region.

2. The method according to claim 1 , wherein the at least three key points comprise a first key point, a second key point, and a third key point, and the first key point and the third key point are symmetrical about the second key point;

determining the target vector based on the at least three key points comprises:

constructing a first vector based on the first key point and the second key point;

constructing a second vector based on the third key point and the second key point; and

determining the target vector based on the first vector and the second vector.

3. The method according to claim 1 , wherein performing the deformation processing on the region to be adjusted of the object based on the orientation of the reference region comprises:

determining an orientation of the region to be adjusted based on the orientation of the reference region; and

performing the deformation processing on the region to be adjusted of the object based on the orientation of the region to be adjusted.

4. The method according to claim 3 , wherein determining the orientation of the region to be adjusted based on the orientation of the reference region comprises:

in response to the region to be adjusted being a region of a first type, determining that the orientation of the region to be adjusted is opposite to the orientation of the reference region, wherein the region of the first type comprises: a hip region; and

in response to the region to be adjusted being a region of a second type, determining that the orientation of the region to be adjusted is the same as the orientation of the reference region, wherein the region of the second type comprises at least one of: a face region, a shoulder region, or a crotch region.

5. The method according to claim 1 , wherein performing the deformation processing on the region to be adjusted of the object based on the orientation of the reference region comprises:

performing the deformation processing on the region to be adjusted according to the target vector, a first reference vector, and a second reference vector, wherein a direction of the first reference vector is perpendicular to a photographing direction of the image, and the direction of the first reference vector is opposite to a direction of the second reference vector.

6. The method according to claim 5 , wherein the region to be adjusted comprises a first sub-region and a second sub-region, and the first sub-region and the second sub-region are symmetrical about a center line of the region to be adjusted;

performing the deformation processing on the region to be adjusted according to the target vector, the first reference vector, and the second reference vector comprises:

in response to the direction of the target vector being different from the direction of the first reference vector and the direction of the target vector being different from the direction of the second reference vector, adjusting an area of the first sub-region and an area of the second sub-region according to a first included angle between the target vector and the first reference vector and a second included angle between the target vector and the second reference vector.

7. The method according to claim 6 , wherein in response to the direction of the target vector being different from the direction of the first reference vector and the direction of the target vector being different from the direction of the second reference vector, adjusting the area of the first sub-region and the area of the second sub-region according to the first included angle between the target vector and the first reference vector and the second included angle between the target vector and the second reference vector comprises:

determining a first area adjustment amount of the first sub-region and a second area adjustment amount of the second sub-region according to the first included angle and the second included angle; and

adjusting the area of the first sub-region according to the first area adjustment amount and adjusting the area of the second sub-region according to the second area adjustment amount.

8. The method according to claim 7 , wherein determining the first area adjustment amount of the first sub-region and the second area adjustment amount of the second sub-region according to the first included angle and the second included angle comprises:

in response to the first included angle being greater than the second included angle and the area of the first sub-region being greater than the area of the second sub-region, taking a ratio of the first area adjustment amount to the second area adjustment amount as a first ratio, and taking a ratio of the first included angle to the second included angle as a second ratio; and

determining the first area adjustment amount and the second area adjustment amount according to the second ratio so that the first ratio is positively correlated with the second ratio;

in response to the first included angle being equal to the second included angle, determining that the first area adjustment amount is equal to the second area adjustment amount.

9. An image processing device, comprising:

a processor; and

a memory for storing instructions executable by the processor, wherein when the instructions are executed by the processor, the processor is configured to:

obtain key points of a reference region of an object in an image;

determine an orientation of the reference region according to the key points of the reference region; and

perform deformation processing on a region to be adjusted of the object based on the orientation of the reference region, wherein the region to be adjusted is the same as or different from the reference region,

wherein the processor is specifically configured to:

obtain at least three key points in the reference region, wherein the at least three key points are not on a same straight line;

determine a target vector based on the at least three key points; and

take a direction of the target vector as the orientation of the reference region.

10. The device according to claim 9 , wherein the at least three key points comprise a first key point, a second key point, and a third key point, and the first key point and the third key point are symmetrical about the second key point;

the processor is specifically configured to:

construct a first vector based on the first key point and the second key point;

construct a second vector based on the third key point and the second key point; and

determine the target vector based on the first vector and the second vector.

11. The device according to claim 9 , wherein the processor is specifically configured to:

determine an orientation of the region to be adjusted based on the orientation of the reference region; and

perform the deformation processing on the region to be adjusted of the object based on the orientation of the region to be adjusted.

12. The device according to claim 11 , wherein the processor is specifically configured to:

in response to the region to be adjusted being a region of a first type, determine that the orientation of the region to be adjusted is opposite to the orientation of the reference region, wherein the region of the first type comprises: a hip region; and

in response to the region to be adjusted being a region of a second type, determine that the orientation of the region to be adjusted is the same as the orientation of the reference region, wherein the region of the second type comprises at least one of: a face region, a shoulder region, or a crotch region.

13. The device according to claim 9 , wherein the processor is specifically configured to:

perform the deformation processing on the region to be adjusted according to the target vector, a first reference vector, and a second reference vector, wherein a direction of the first reference vector is perpendicular to a photographing direction of the image, and the direction of the first reference vector is opposite to a direction of the second reference vector.

14. The device according to claim 13 , wherein the region to be adjusted comprises a first sub-region and a second sub-region, and the first sub-region and the second sub-region are symmetrical about a center line of the region to be adjusted;

the processor is specifically configured to:

in response to the direction of the target vector being different from the direction of the first reference vector and the direction of the target vector being different from the direction of the second reference vector, adjust an area of the first sub-region and an area of the second sub-region according to a first included angle between the target vector and the first reference vector and a second included angle between the target vector and the second reference vector.

15. The device according to claim 14 , wherein the processor is specifically configured to:

determine a first area adjustment amount of the first sub-region and a second area adjustment amount of the second sub-region according to the first included angle and the second included angle; and

adjust the area of the first sub-region according to the first area adjustment amount and adjust the area of the second sub-region according to the second area adjustment amount.

16. The device according to claim 15 , wherein the processor is specifically configured to:

in response to the first included angle being greater than the second included angle and the area of the first sub-region being greater than the area of the second sub-region, take a ratio of the first area adjustment amount to the second area adjustment amount as a first ratio, and take a ratio of the first included angle to the second included angle as a second ratio; and

determine the first area adjustment amount and the second area adjustment amount according to the second ratio so that the first ratio is positively correlated with the second ratio;

in response to the first included angle being equal to the second included angle, determine that the first area adjustment amount is equal to the second area adjustment amount.

17. A non-transitory computer storage medium, wherein the non-transitory computer storage medium stores computer executable instructions, and execution of the computer executable instructions by a processor causes the processor to perform:

obtaining key points of a reference region of an object in an image;

determining an orientation of the reference region according to the key points of the reference region; and

performing deformation processing on a region to be adjusted of the object based on the orientation of the reference region, wherein the region to be adjusted is the same as or different from the reference region,

wherein determining the orientation of the reference region according to the key points of the reference region comprises:

obtaining at least three key points in the reference region, wherein the at least three key points are not on a same straight line;

determining a target vector based on the at least three key points; and

taking a direction of the target vector as the orientation of the reference region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2020
From: LI, TONG; LIU, WENTAO; QIAN, CHEN
To: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 054750/0524 →
Priority Claims (2)
CN 201910191918.1 · Mar 14, 2019 · national
CN 201910193649.2 · Mar 14, 2019 · national
Continuity (2)
Continuation PCTCN2019130970 · Dec 31, 2019
Related Publication 20210035344A1 · Feb 4, 2021
Cited By (1)
US 12,573,080