IP Library › Granted Patent US 10,818,021
Granted Patent B2
US 10,818,021 · App. 16/158,263 · Granted Oct 27, 2020

Image processing method, apparatus, and storage medium

Inventors: Bin Wang (Hangzhou, CN); Jingming Yu (Beijing, CN); Xiaoduan Feng (Hangzhou, CN); Pan Pan (Beijing, CN); Rong Jin (Sammamish, WA)
Assignee: ALIBABA GROUP HOLDING LIMITED
G06T7/40G06F16/5862G06T7/70G06T15/04G06T17/05G06T19/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,818,021
App. No.
16/158,263
Granted
Oct 27, 2020
Kind
B2
Abstract

The present disclosure discloses an image processing method, apparatus, and a non-transitory computer readable medium. The method can includes: acquiring a three-dimensional (3D) model and original texture images of an object, wherein the original texture images are acquired by an imaging device; determining a mapping relationship between the 3D model and the original texture images of the object; determining, among the original texture images, a subset of texture images associated with a first perspective of the imaging device; splicing the subset of texture images into a spliced texture image corresponding to the first perspective; and mapping the spliced texture image to the 3D model according to the mapping relationship.

Claims (68)

1. An image processing method, comprising:

acquiring a three-dimensional (3D) model and original texture images of an object, wherein the original texture images are acquired by an imaging device;

determining a mapping relationship between the 3D model and the original texture images of the object;

determining, among the original texture images, a subset of texture images associated with a first perspective of the imaging device;

splicing the subset of texture images into a spliced texture image corresponding to the first perspective; and

mapping the spliced texture image to the 3D model according to the mapping relationship.

2. The image processing method according to claim 1 , wherein determining, among the original texture images, the subset of texture images associated with the first perspective of the imaging device further comprises:

acquiring a polygonal patch of the 3D model as a patch to be processed;

obtaining a normal vector of the patch to be processed;

in response to an included angle between an incident ray of the imaging device and the normal vector of the patch to be processed meeting a threshold condition, determining the included angle as the first perspective.

3. The image processing method according to claim 1 , wherein splicing the subset of texture images into a spliced texture image corresponding to the first perspective further comprises:

determining an overlapping region of the texture images in the subset as a splicing region of the subset; and

texture-blending the splicing region to obtain the spliced texture image corresponding to the first perspective.

4. The image processing method according to claim 3 , wherein texture-blending the splicing region to obtain the spliced texture image corresponding to the first perspective further comprises:

determining a sharpness function of the images in the subset;

determining an integrity function of the images in the subset based on a relationship between integrity of the images in the subset and an area of the splicing region; and

texture-blending the splicing region based on the sharpness function and the integrity function.

5. The image processing method according to claim 1 , further comprising:

generating a spliced texture image of a second perspective of the imaging device; and

generating a texture model of the 3D model based on the spliced texture images of the first perspective and the second perspective.

6. The image processing method according to claim 5 , further comprising:

performing light equalization processing on the texture model.

7. An image processing apparatus, comprising:

a memory storing a set of instructions; and

at least one processor configured to execute the set of instructions to cause the image processing apparatus to:

acquire a three-dimensional (3D) model and original texture images of an object, wherein the original texture images are acquired by an imaging device;

determine a mapping relationship between the 3D model and the original texture images of the object;

determine, among the original texture images, a subset of texture images associated with a first perspective of the imaging device;

splice the subset of texture images into a spliced texture image corresponding to the first perspective; and

map the spliced texture image to the 3D model according to the mapping relationship.

8. The image processing apparatus according to claim 7 , wherein the at least one processor is further configured to execute the set of instructions to cause the image processing apparatus to:

acquire a polygonal patch of the 3D model as a patch to be processed;

obtain a normal vector of the patch to be processed;

in response to an included angle between an incident ray of the imaging device and the normal vector of the patch to be processed meeting a threshold condition, determine the included angle as the first perspective.

9. The image processing apparatus according to claim 7 , wherein the at least one processor is further configured to execute the set of instructions to cause the image processing apparatus to:

determine an overlapping region of the texture images in the subset as a splicing region of the subset; and

texture-blend the splicing region to obtain the spliced texture image corresponding to the first perspective.

10. The image processing apparatus according to claim 9 , wherein the at least one processor is further configured to execute the set of instructions to cause the image processing apparatus to:

determine a sharpness function of the images in the subset;

determine an integrity function of the images in the subset based on a relationship between integrity of the images in the subset and an area of the splicing region; and

texture-blend the splicing region based on the sharpness function and the integrity function.

11. The data processing apparatus according to claim 7 , wherein the at least one processor is further configured to execute the set of instructions to cause the image processing apparatus to:

generate a spliced texture image of a second perspective of the imaging device; and

generate a texture model of the 3D model based on the spliced texture images of the first perspective and the second perspective.

12. The data processing apparatus according to claim 11 , wherein the at least one processor is further configured to execute the set of instructions to cause the image processing apparatus to:

perform light equalization processing on the texture model.

13. A non-transitory computer readable medium that stores a set of instructions that is executable by at least one processor of a computer system to cause the computer system to perform an image processing method, the method comprising:

acquiring a three-dimensional (3D) model and original texture images of an object, wherein the original texture images are acquired by an imaging device;

determining a mapping relationship between the 3D model and the original texture images of the object;

determining, among the original texture images, a subset of texture images associated with a first perspective of the imaging device;

splicing the subset of texture images into a spliced texture image corresponding to the first perspective; and

mapping the spliced texture image to the 3D model according to the mapping relationship.

14. The non-transitory computer readable medium according to claim 13 , wherein determining, among the original texture images, the subset of texture images associated with the first perspective of the imaging device further comprises:

acquiring a polygonal patch of the 3D model as a patch to be processed;

obtaining a normal vector of the patch to be processed;

in response to an included angle between an incident ray of the imaging device and the normal vector of the patch to be processed meeting a threshold condition, determining the included angle as the first perspective.

15. The non-transitory computer readable medium according to claim 13 , wherein splicing the subset of texture images into a spliced texture image corresponding to the first perspective further comprises:

determining an overlapping region of the texture images in the subset as a splicing region of the subset; and

texture-blending the splicing region to obtain the spliced texture image corresponding to the first perspective.

16. The non-transitory computer readable medium according to claim 15 , wherein texture-blending the splicing region to obtain the spliced texture image corresponding to the first perspective further comprises:

determining a sharpness function of the images in the subset;

determining an integrity function of the images in the subset based on a relationship between integrity of the images in the subset and an area of the splicing region; and

texture-blending the splicing region based on the sharpness function and the integrity function.

17. The non-transitory computer readable medium according to claim 13 , wherein the set of instructions is further executable by the at least one processor of the computer system to cause the computer system to:

generate a spliced texture image of a second perspective of the imaging device; and

generate a texture model of the 3D model based on the spliced texture images of the first perspective and the second perspective.

18. The non-transitory computer readable medium according to claim 17 , wherein the set of instructions is further executable by the at least one processor of the computer system to cause the computer system to:

perform light equalization processing on the texture model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: WANG, BIN; YU, JINGMING; FENG, XIAODUAN; PAN, PAN; JIN, RONG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 053094/0135 →
Priority Claims (1)
CO 2017 1 0942829 · Oct 11, 2017 · national
Continuity (1)
Related Publication 20190108646A1 · Apr 11, 2019