IP Library Granted Patent US 12,299,802
Granted Patent B2
US 12,299,802 · App. 18/000,244 · Granted May 13, 2025

Image processing method, apparatus and electronic device

Inventors: Can Wang (Beijing, CN); Jiali Pan (Beijing, CN)
Assignee: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
G06T15/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,802
App. No.
18/000,244
Granted
May 13, 2025
Kind
B2
Abstract

The present disclosure provides an image processing method, an apparatus and an electronic device. The method includes: determining N texture images corresponding to a first image, and a correspondence between the N texture images and N model faces of a three-dimensional model, where N is an integer greater than 1; determining, according to the correspondence and an offset coefficient, a mapping region corresponding to each model face in the N texture images, where the mapping region is at least partial region of a texture image; mapping regions in the N texture images to the three-dimensional model to obtain a three-dimensional image corresponding to the first image. A display effect of the three-dimensional image is improved and flexibility of three-dimensional image acquisition is improved.

Claims (71)

1. An image processing method, comprising:

determining N texture images corresponding to a first image, and a correspondence between the N texture images and N model faces of a three-dimensional model, wherein N is an integer greater than 1;

determining, in the N texture images, a mapping region corresponding to each of the N model faces according to the correspondence and an offset coefficient, wherein the mapping region is an at least partial region of a texture image; and

mapping mapping regions in the N texture images to the three-dimensional model to obtain a three-dimensional image corresponding to the first image.

2. The method according to claim 1 , wherein the at least partial region is a middle region of the texture image; determining, in the N texture images, the mapping region corresponding to the each of the N model faces according to the correspondence and the offset coefficient comprises:

combining the N texture images into a region of L rows and K columns according to the correspondence to obtain a sampling region, wherein a product of L and K is N, and L and K are positive integers; and

determining the mapping region corresponding to the each of the N model faces according to the sampling region and the offset coefficient.

3. The method according to claim 2 , wherein for any one of the N model faces, determining the mapping region corresponding to the each of the N model faces according to the sampling region and the offset coefficient comprises:

determining a first position of the texture image corresponding to the any one of the N model faces in the sampling region;

acquiring vertex texture coordinates of the any one of the N model faces;

determining vertex sampling coordinates in the sampling region according to the vertex texture coordinates, the offset coefficient and the first position; and

determining the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates and the first position.

4. The method according to claim 3 , wherein the vertex texture coordinates comprise vertex texture abscissas and vertex texture ordinates; determining the vertex sampling coordinates in the sampling region according to the vertex texture coordinates, the offset coefficient and the first position comprises:

determining abscissas of the vertex sampling coordinates according to the vertex texture abscissas, the first position, a number of columns of the sampling region and the offset coefficient;

determining ordinates of the vertex sampling coordinates according to the vertex texture ordinates, the first position, the number of columns of the sampling region, a number of rows of the sampling region and the offset coefficient; and

obtaining the vertex sampling coordinates according to the abscissas of the vertex sampling coordinates and the ordinates of the vertex sampling coordinates.

5. The method according to claim 3 , wherein a number of rows of the sampling region is 2; determining the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates and the first position comprises:

upon determining that the first position is located in a first row of the sampling region, determining the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates; and

upon determining that the first position is located in a second row of the sampling region, performing flipping processing of a preset angle on the vertex sampling coordinates to obtain target vertex sampling coordinates, and determining the mapping region corresponding to the any one of the N model faces according to the target vertex sampling coordinates.

6. The method according to claim 5 , wherein determining the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates comprises:

determining a first region corresponding to the vertex sampling coordinates in the sampling region; and

determining the first region as the mapping region corresponding to the any one of the N model faces.

7. The method according to claim 5 , wherein determining the mapping region corresponding to the any one of the N model faces according to the target vertex sampling coordinates comprises:

determining a second region corresponding to the target vertex sampling coordinates in the sampling region; and

determining the second region as the mapping region corresponding to the any one of the N model faces.

8. The method according to claim 1 , before determining, in the N texture images, the mapping region corresponding to the each of the N model faces according to the correspondence and the offset coefficient, further comprising:

acquiring a preset region size of edges of the N texture images; and

determining the offset coefficient according to the preset region size.

9. The method according to claim 2 , before determining, in the N texture images, the mapping region corresponding to the each of the N model faces according to the correspondence and the offset coefficient, further comprising:

acquiring a preset region size of edges of the N texture images; and

determining the offset coefficient according to the preset region size.

10. The method according to claim 8 , wherein determining the offset coefficient according to the preset region size comprises:

acquiring a first preset relationship, wherein the first preset relationship comprises at least one region size and a coefficient corresponding to each region size; and

determining the offset coefficient according to the preset region size and the first preset relationship.

11. An image processing apparatus, comprising a memory and a processor;

the memory stores computer execution instructions;

the processor executes the computer execution instruction stored in the memory, so that the processor is configured to:

determine N texture images corresponding to a first image, and a correspondence between the N texture images and N model faces of a three-dimensional model, wherein N is an integer greater than 1;

determine, in the N texture images, a mapping region corresponding to each of the N model faces according to the correspondence and an offset coefficient, wherein the mapping region is an at least partial region of a texture image; and

map mapping regions in the N texture images to the three-dimensional model to obtain a three-dimensional image corresponding to the first image.

12. The apparatus according to claim 11 , wherein the at least partial region is a middle region of the texture image; the processor is configured to:

combine the N texture images into a region of L rows and K columns according to the correspondence to obtain a sampling region, wherein a product of L and K is N, and L and K are positive integers; and

determine the mapping region corresponding to the each of the N model faces according to the sampling region and the offset coefficient.

13. The apparatus according to claim 12 , wherein for any one of the N model faces, the processor is configured to:

determine a first position of the texture image corresponding to the any one of the N model faces in the sampling region;

acquire vertex texture coordinates of the any one of the N model faces;

determine vertex sampling coordinates in the sampling region according to the vertex texture coordinates, the offset coefficient and the first position; and

determine the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates and the first position.

14. The apparatus according to claim 13 , wherein the vertex texture coordinates comprise vertex texture abscissas and vertex texture ordinates; the processor is configured to:

determine abscissas of the vertex sampling coordinates according to the vertex texture abscissas, the first position, a number of columns of the sampling region and the offset coefficient;

determine ordinates of the vertex sampling coordinates according to the vertex texture ordinates, the first position, the number of columns of the sampling region, a number of rows of the sampling region and the offset coefficient; and

obtain the vertex sampling coordinates according to the abscissas of the vertex sampling coordinates and the ordinates of the vertex sampling coordinates.

15. The apparatus according to claim 13 , wherein a number of rows of the sampling region is 2; the processor is configured to:

upon determining that the first position is located in a first row of the sampling region, determine the mapping region corresponding to the any one of the N model faces according to the vertex sampling coordinates; and

upon determining that the first position is located in a second row of the sampling region, perform flipping processing of a preset angle on the vertex sampling coordinates to obtain target vertex sampling coordinates, and determine the mapping region corresponding to the any one of the N model faces according to the target vertex sampling coordinates.

16. The apparatus according to claim 15 , wherein the processor is configured to:

determine a first region corresponding to the vertex sampling coordinates in the sampling region; and

determine the first region as the mapping region corresponding to the any one of the N model faces.

17. The apparatus according to claim 15 , wherein the processor is configured to:

determine a second region corresponding to the target vertex sampling coordinates in the sampling region; and

determine the second region as the mapping region corresponding to the any one of the N model faces.

18. The apparatus according to claim 11 , wherein the processor is further configured to:

acquire a preset region size of edges of the N texture images; and

determine the offset coefficient according to the preset region size.

19. The apparatus according to claim 18 , wherein the processor is configured to:

acquire a first preset relationship, wherein the first preset relationship comprises at least one region size and a coefficient corresponding to each region size; and

determine the offset coefficient according to the preset region size and the first preset relationship.

20. A non-transitory computer-readable storage medium having computer execution instructions stored therein, wherein when the computer execution instructions are executed by a processer, the following operations are implemented:

determining N texture images corresponding to a first image, and a correspondence between the N texture images and N model faces of a three-dimensional model, wherein N is an integer greater than 1;

determining, in the N texture images, a mapping region corresponding to each of the N model faces according to the correspondence and an offset coefficient, wherein the mapping region is an at least partial region of a texture image; and

mapping mapping regions in the N texture images to the three-dimensional model to obtain a three-dimensional image corresponding to the first image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2023
From: PAN, JIALI
To: HANGZHOU OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 065185/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2023
From: WANG, CAN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 065185/0785 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2023
From: HANGZHOU OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 065185/0886 →
Priority Claims (1)
CN 202210262157.6 · Mar 16, 2022 · national
Continuity (1)
Related Publication 20240212256A1 · Jun 27, 2024
References Cited (31)
US 10043233B1 · Beri et al. · 2018 [cited by applicant]
US 11273074B1 · Homer · 2022 [cited by examiner]
US 20130173300A1 · Hyde · 2013 [cited by examiner]
US 20130201187A1 · Tong · 2013 [cited by examiner]
US 20130242110A1 · Terre · 2013 [cited by examiner]
US 20150187126A1 · Magder et al. · 2015 [cited by applicant]
US 20160086299A1 · Sharma et al. · 2016 [cited by applicant]
US 20170039755A1 · Heggelund et al. · 2017 [cited by applicant]
US 20170109568A1 · Escalier · 2017 [cited by examiner]
US 20180174352A1 · Kang · 2018 [cited by applicant]
US 20200202619A1 · Sheng · 2020 [cited by applicant]
US 20220075453A1 · Huang · 2022 [cited by examiner]
US 20220076044A1 · Peters · 2022 [cited by examiner]
US 20220076117A1 · Amon · 2022 [cited by examiner]
CN 102682477A · 2012 [cited by applicant]
CN 106683165A · 2017 [cited by applicant]
CN 109427087A · 2019 [cited by applicant]
CN 106127681B · 2019 [cited by applicant]
CN 111369659A · 2020 [cited by applicant]
CN 114140568A · 2022 [cited by applicant]
CN 114596399A · 2022 [cited by applicant]
JP 2009003708A · 2009 [cited by applicant]
JP 2018200504A · 2018 [cited by applicant]
JP 2019192299A · 2019 [cited by applicant]
European Patent Office, Extended European Search Report Issued in Application No. 22808577.5, Jan. 2, 2024, 8 pages. [cited by applicant]
Purnomo, B. et al., “Seamless Texture Atlases,” Proceedings of the Second Eurographics Symposium on Geometry Processing, Jul. 8, 2004, Nice, France, 10 pages. [cited by applicant]
“CubeMap Sampling Process” Computer Graphics, available as early as Jun. 17, 2021, 14 pages. [cited by applicant]
ISA China National Intellectual Property Administration, International Search Report and Written Opinion Issued in Application No. PCT/CN2022/123543, Nov. 28, 2022, WIPO, 12 pages. [cited by applicant]
Communication pursuant to Article 94(3) EPC for European Application No. 22808577.5, mailed Oct. 28, 2024, 6 pages. [cited by applicant]
China National Intellectual Property Administration, Office Action and Search Report Issued in Application No. 202210262157.6, Feb. 27, 2025, 17 pages. [cited by applicant]
Mao, Y. et al., “Efficient Retrieval of 3D Models Based on Depth Weighted Normal Map,” Journal of Computer-Aided Design & Computer Graphics, vol. 17, No. 2, Feb. 20, 2005, 6 pages. English abstract. [cited by applicant]