IP Library › Granted Patent US 11,503,207
Granted Patent B2
US 11,503,207 · App. 16/843,467 · Granted Nov 15, 2022

Display control method, display control device and computer-readable storage medium

Inventors: Ruyue Geng (Beijing, CN); Wei Nie (Beijing, CN); Tongwei Zhou (Beijing, CN)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
H04N5/23229G06F1/1605G06T7/44G06T11/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,503,207
App. No.
16/843,467
Granted
Nov 15, 2022
Kind
B2
Abstract

A display control method includes: image texture data of a first display area are extracted; a pixel mapping is performed on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects; and the image texture data of the first display area are updated to the pixel-mapped image texture data for displaying.

Claims (74)

1. A display method, applied to a terminal comprising a first display area and a second display area with different pixel densities, the display method comprising:

extracting image texture data of the first display area;

performing a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects; and

updating the image texture data of the first display area to the pixel-mapped image texture data for displaying;

wherein the extracting image texture data of the first display area comprises:

compositing layers in the first display area to generate a composited layer, and extracting the image texture data of the first display area based on the composited layer.

2. The display method of claim 1 , wherein the performing a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects comprises:

mapping a pixel value of a pixel point corresponding to the image texture data in the first display area to an average value of pixel values of a set number of pixel points in the second display area.

3. The display method of claim 2 , wherein the set number of pixel points are obtained according to at least one of a pixel distribution of the first display area or a pixel distribution of the second display area.

4. The display method of claim 1 , wherein a pixel density of the first display area is lower than a pixel density of the second display area.

5. The display method of claim 4 , wherein the first display area is an area of setting a camera under panel (CUP); and

the second display area is a display area adjacent to the area of setting the CUP.

6. The display method of claim 1 , wherein the image texture data of the first display area is extracted in a graphics processing unit (GPU);

wherein the performing a pixel mapping on the image texture data comprises:

copying the image texture data extracted in the GPU into a central processing unit (CPU) through a memory, and performing the pixel mapping on the image texture data in the CPU;

wherein the updating the image texture data of the first display area to the pixel-mapped image texture data comprises:

copying the image texture data pixel-mapped in the CPU into the GPU through the memory; and

updating the image texture data of the first display area to the pixel-mapped image texture data in the GPU.

7. The display method of claim 1 , wherein the performing a pixel mapping on the image texture data comprises:

performing the pixel mapping on the extracted image texture data in a shared memory;

wherein the updating the image texture data of the first display area to the pixel-mapped image texture data comprises:

acquiring the pixel-mapped image texture data from the shared memory, and updating the image texture data of the first display area to the pixel-mapped image texture data.

8. The display method of claim 1 , wherein prior to the extracting the image texture data of the first display area, the method further comprising:

confirming that a starting control processing the display areas to have consistent visual display effects is activated.

9. A mobile terminal implementing the method of claim 1 , comprising:

a display panel having the first display area and the second display area, wherein a pixel density of the first display area is lower than a pixel density of the second display area;

a camera under panel (CUP) at the first display area;

a graphic processing unit (GPU); and

a central processing unit (CPU);

wherein the mobile terminal is configured to control activation of the display method and deactivation of the display method;

wherein the deactivation is performed in a gaming scenario wherein frame rate requirement is high; and

upon the activation, the GPU is configured to:

composite all layers displayed in the first display area;

extract the image texture data of the first display area based on the composited layers; and

copy the image texture data extracted in the GPU into a shared memory;

a central processing unit (CPU) through a memory;

the CPU is configured to:

perform the pixel mapping on the image texture data;

wherein the pixel mapping is performed by using a preset pixel mapping policy to realize the consistent visual display effects for the first display area with higher pixel density and the second display area with lower pixel density.

10. A display device, applied to a terminal comprising a first display area and a second display area with different pixel densities, the display device comprising:

a processor; and

memory for storing instructions executable by the processor;

wherein the processor is configured to:

extract image texture data of the first display area;

perform a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects; and

update the image texture data of the first display area to the pixel-mapped image texture data for displaying;

wherein the processor is configured, when extracting image texture data of the first display area, to:

composite layers in the first display area to generate a composited layer, and extract the image texture data of the first display area based on the composited layer.

11. The display device of claim 10 , wherein the processor is configured, when performing a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects, to:

map a pixel value of a pixel point corresponding to the image texture data in the first display area to an average value of pixel values of a set number of pixel points in the second display area.

12. The display device of claim 11 , wherein the set number of pixel points are obtained according to at least one of a pixel distribution of the first display area or a pixel distribution of the second display area.

13. The display device of claim 10 , wherein a pixel density of the first display area is lower than a pixel density of the second display area.

14. The display device of claim 13 , wherein the first display area is an area of setting a camera under panel (CUP); and

the second display area is a display area adjacent to the area of setting the CUP.

15. The display device of claim 10 , wherein the processor is configured to extract the image texture data of the first display area in a graphics processing unit (GPU);

wherein the processor is configured, when performing a pixel mapping on the image texture data, to:

copy the image texture data extracted in the GPU into a central processing unit (CPU) through a memory, and perform the pixel mapping on the image texture data in the CPU;

wherein the processor is configured, when updating the image texture data of the first display area to the pixel-mapped image texture data, to:

copy the image texture data pixel-mapped in the CPU into the GPU through the memory; and

update the image texture data of the first display area to the pixel-mapped image texture data in the GPU.

16. The display device of claim 10 , wherein the processor is configured, when performing a pixel mapping on the image texture data, to:

perform the pixel mapping on the extracted image texture data in a shared memory;

wherein the processor is configured, when updating the image texture data of the first display area to the pixel-mapped image texture data, to:

acquire the pixel-mapped image texture data from the shared memory, and update the image texture data of the first display area to the pixel-mapped image texture data.

17. The display device of claim 10 , wherein the processor is further configured to:

confirm, prior to the extracting the image texture data of the first display area, that a starting control processing the display areas to have consistent visual display effects is activated.

18. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a mobile terminal, causes the mobile terminal to perform a display method applied to a terminal comprising a first display area and a second display area with different pixel densities, the display method comprising:

extracting image texture data of the first display area;

performing a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects; and

updating the image texture data of the first display area to the pixel-mapped image texture data for displaying;

wherein the extracting image texture data of the first display area comprises:

compositing layers in the first display area to generate a composited layer, and extracting the image texture data of the first display area based on the composited layer.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the performing a pixel mapping on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects comprises:

mapping a pixel value of a pixel point corresponding to the image texture data in the first display area to an average value of pixel values of a set number of pixel points in the second display area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2020
From: GENG, RUYUE; NIE, WEI; ZHOU, TONGWEI
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 052347/0174 →
Priority Claims (1)
CN 201911207699.8 · Nov 29, 2019 · national
Continuity (1)
Related Publication 20210168282A1 · Jun 3, 2021