Granted Patent B2

US 12,394,176 · App. 18/023,266 · Granted Aug 19, 2025

Inventors: Xiaowei Luo (Shanghai, CN); Jiali Shen (Shanghai, CN); Guangyao Li (Shanghai, CN); Qingqing Zhao (Pudong New Area Shanghai, CN); Fuhuei Lin (Shanghai, CN); Xiaofeng Peng (Shanghai, CN)

Assignee: SPREADTRUM COMMUNICATIONS (SHANGHAI) CO., LTD.

G06V10/60G06T5/92G09G3/006H04N19/186H04N19/44H04N19/59G06T2207/20208

Abstract

Claims (61)

1. A method for optimizing display processing of an HDR video, comprising:

acquiring video element stream data;

decoding the video element stream data to acquire image frame data of each image frame and metadata, wherein the metadata comprises gamut information and brightness information;

in an m-th iteration of display processing of the HDR video, performing HDR processing on image frame data of each image frame with a display processing algorithm for the HDR video according to a characteristic parameter of a target display panel and the metadata, to acquire HDR-processed image frame data in the m-th iteration; and

optimizing the display processing algorithm for the HDR video for usage in an (m+1)-th iteration based on a playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel; and completing optimization of the display processing algorithm for the HDR video in the HDR processing once the playback result of the HDR-processed image frame data, acquired in an (m+i)-th iteration, on the target display panel meets a predetermined condition, wherein m≥1, i≥0, and m and i each represent an integer.

2. The method for optimizing display processing of an HDR video according to claim 1 , wherein the performing HDR processing on image frame data of each image frame with a display processing algorithm for the HDR video according to a characteristic parameter of a target display panel and the metadata, to acquire HDR-processed image frame data in the m-th iteration comprises:

performing the HDR processing on an n-th image frame in the video element stream data by:

modifying a brightness of image frame data of the n-th image frame according to the characteristic parameter of the target display panel and brightness information of the n-th image frame; and

performing gamut mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and gamut information of the n-th image frame,

where 0<n≤N, N represents total number of image frames in the video element stream data, and n and N each represent a positive integer.

3. The method for optimizing display processing of an HDR video according to claim 2 , wherein the metadata further comprises a curve parameter of tone mapping.

4. The method for optimizing display processing of an HDR video according to claim 3 , wherein the performing the HDR processing on the image frame data of the n-th image frame comprises:

performing tone mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and the curve parameter of the tone mapping of the n-th image frame.

5. The method for optimizing display processing of an HDR video according to claim 1 , further comprising:

storing the HDR-processed image frame data acquired in the m-th iteration, and the metadata.

6. The method for optimizing display processing of an HDR video according to claim 5 , wherein the storing the HDR-processed image frame data acquired in the m-th iteration, and the metadata, comprises any one of:

compressing the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire compressed HDR-processed image frame data, and storing the metadata and the compressed HDR-processed image frame data; and

down-sampling the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire down-sampled image frame data, and storing the metadata and the down-sampled image frame data.

7. The method for optimizing display processing of an HDR video according to claim 5 , wherein the optimizing the display processing algorithm for the HDR video for usage in an (m+1)-th iteration based on a playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel comprises:

in a case that there is a defect in the playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel, optimizing the display processing algorithm for the HDR video for usage in the (m+1)-th iteration according to the defect, the metadata and the HDR-processed image frame data, acquired in the m-th iteration, wherein the defect comprises at least one of: an inter-frame brightness flicker, a local overexposure of image, undersaturation of image, and oversaturation of image.

8. A non-transitory storage medium, storing a computer program, wherein

the computer program, when being executed by a processor, implements:

acquiring video element stream data;

decoding the video element stream data to acquire image frame data of each image frame and metadata, wherein the metadata comprises gamut information and brightness information;

in an m-th iteration of display processing of the HDR video, performing HDR processing on image frame data of each image frame with a display processing algorithm for the HDR video according to a characteristic parameter of a target display panel and the metadata, to acquire HDR-processed image frame data in the m-th iteration; and

optimizing the display processing algorithm for the HDR video for usage in an (m+1)-th iteration based on a playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel; and completing optimization of the display processing algorithm for the HDR video in the HDR processing once the playback result of the HDR-processed image frame data, acquired in an (m+i)-th iteration, on the target display panel meets a predetermined condition, wherein m≥1, i≥0, and m and i each represent an integer.

9. A terminal comprising a memory and a processor, wherein

the memory is configured to store a computer program executable by the processor; and

the processor is configured to, when executing the computer program:

acquire video element stream data;

decode the video element stream data to acquire image frame data of each image frame and metadata, wherein the metadata comprises gamut information and brightness information;

in an m-th iteration of display processing of the HDR video, perform HDR processing on image frame data of each image frame with a display processing algorithm for the HDR video according to a characteristic parameter of a target display panel and the metadata, to acquire HDR-processed image frame data in the m-th iteration; and

optimize the display processing algorithm for the HDR video for usage in an (m+1)-th iteration based on a playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel; and complete optimization of the display processing algorithm for the HDR video in the HDR processing once the playback result of the HDR-processed image frame data, acquired in an (m+i)-th iteration, on the target display panel meets a predetermined condition, wherein m≥1, i≥0, and m and i each represent an integer.

10. The device according to claim 9 , wherein the processor is further configured to:

perform the HDR processing on an n-th image frame in the video element stream data by:

modifying a brightness of image frame data of the n-th image frame according to the characteristic parameter of the target display panel and brightness information of the n-th image frame; and

performing gamut mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and gamut information of the n-th image frame,

where 0<n≤N, N represents total number of image frames in the video element stream data, and n and N each represent a positive integer.

11. The device according to claim 10 , wherein the metadata further comprises a curve parameter of tone mapping.

12. The device according to claim 11 , wherein the processor is further configured to:

perform tone mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and the curve parameter of the tone mapping of the n-th image frame.

13. The device according to claim 9 , wherein the processor is further configured to:

store the HDR-processed image frame data acquired in the m-th iteration, and the metadata.

14. The device according to claim 13 , wherein the processor is further configured to:

compress the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire compressed HDR-processed image frame data, and store the metadata and the compressed HDR-processed image frame data; or

down-sample the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire down-sampled image frame data, and store the metadata and the down-sampled image frame data.

15. The device according to claim 13 , wherein the processor is further configured to:

in a case that there is a defect in the playback result of the HDR-processed image frame data, acquired in the m-th iteration, on the target display panel, optimize the display processing algorithm for the HDR video for usage in the (m+1)-th iteration according to the defect, the metadata and the HDR-processed image frame data, acquired in the m-th iteration, wherein the defect comprises at least one of: an inter-frame brightness flicker, a local overexposure of image, undersaturation of image, and oversaturation of image.

16. The storage medium according to claim 8 , wherein the computer program further causes the processor to:

perform the HDR processing on an n-th image frame in the video element stream data by:

modifying a brightness of image frame data of the n-th image frame according to the characteristic parameter of the target display panel and brightness information of the n-th image frame; and

performing gamut mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and gamut information of the n-th image frame,

where 0<n≤N, N represents total number of image frames in the video element stream data, and n and N each represent a positive integer.

17. The storage medium according to claim 16 , wherein the metadata further comprises a curve parameter of tone mapping.

18. The storage medium according to claim 17 , wherein the computer program further causes the processor to:

perform tone mapping on the image frame data of the n-th image frame according to the characteristic parameter of the target display panel and the curve parameter of the tone mapping of the n-th image frame.

19. The storage medium according to claim 8 , wherein the computer program further causes the processor to:

store the HDR-processed image frame data acquired in the m-th iteration, and the metadata.

20. The storage medium according to claim 19 , wherein the computer program further causes the processor to:

compress the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire compressed HDR-processed image frame data, and store the metadata and the compressed HDR-processed image frame data; or

down-sample the HDR-processed image frame data of each image frame acquired in the m-th iteration, to acquire down-sampled image frame data, and store the metadata and the down-sampled image frame data.

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (41)