IP Library › Granted Patent US 10,007,412
Granted Patent B2
US 10,007,412 · App. 14/993,944 · Granted Jun 26, 2018

Tone mastering system with creative intent metadata

Inventors: Li Tao (Mountain View, CA); Yeong-Taeg Kim (Mountain View, CA)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/04845H04N9/68
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,007,412
App. No.
14/993,944
Granted
Jun 26, 2018
Kind
B2
Abstract

A method, apparatus, and non-transitory computer readable medium for video tone mapping. The method includes receiving the video and metadata at least partially representative of a global tone mapping function. The method further includes determining the global tone mapping function based at least on the metadata and a characteristic of the display and generating a tone mapped video by applying the global tone mapping function to the video and using the peak luminance value of the display in the application of the global tone mapping function.

Claims (37)

1. A method for tone mapping of a video for a display, the method comprising:

receiving the video and metadata, wherein the metadata is at least partially representative of a global tone mapping function;

determining the global tone mapping function based at least on the metadata and an identified characteristic of the display; and

generating, by at least one processor, a tone mapped video by applying the determined global tone mapping function to the video, based on an identified peak luminance value characteristic of the display in application of the global tone mapping function, and by processing individual pixels of a frame for the video, wherein a transition weighing factor is used to mix the individual pixels between the global tone mapping function and a local mapping function.

2. The method of claim 1 , wherein the metadata is further representative of local tone mapping functions, and wherein generating the tone mapped video further comprises applying a local tone mapping function to the video.

3. The method of claim 2 , wherein the global tone mapping function and the local tone mapping functions correspond to an explicit Bezier curve.

4. The method of claim 2 , wherein the local tone mapping functions are applied using an elliptical shape that is parameterized by one of:

a location on a frame of the video that the elliptical shape is centered, a focus distance, an angle of rotation of the elliptical shape, a first range distance and a second range distance, or

a location on the frame that the elliptical shape is centered, an angle of rotation of the elliptical shape, a first major axis distance and a second major distance, and a first minor axis distance and second minor axis distance on a minor axis.

5. The method of claim 4 , wherein the metadata further includes a transition weighting function used to monotonically diminish an effect of the local tone mapping functions between the first range distance and the second range distance.

6. The method of claim 2 , wherein the global tone mapping function and the local tone mapping functions are applied in series or in parallel.

7. The method of claim 1 , wherein the metadata includes a peak luminance value of the video and the characteristic of the display includes a peak luminance value of the display.

8. An apparatus comprising:

a memory; and

at least one processor operably connected to the memory, the at least one processor configured to:

receive a video and metadata, wherein the metadata is at least partially representative of a global tone mapping function;

determine the global tone mapping function based at least on the metadata and an identified characteristic of a display; and

generate a tone mapped video by applying the determined global tone mapping function to the video, based on an identified peak luminance value characteristic of the display in application of the global tone mapping function, and by processing individual pixels of a frame for the video, wherein a transition weighing factor is used to mix the individual pixels between the global tone mapping function and a local mapping function.

9. The apparatus of claim 8 , wherein the metadata is further representative of local tone mapping functions, and wherein to generate the tone mapped video further comprises applying a local tone mapping function to the video.

10. The apparatus of claim 9 , wherein the global tone mapping function and the local tone mapping functions correspond to an explicit Bezier curve.

11. The apparatus of claim 9 , the local tone mapping functions are applied using an elliptical shape that is parameterized by one of:

a location on a frame of the video that the elliptical shape is centered, a focus distance, an angle of rotation of the elliptical shape, a first range distance and a second range distance, or

a location on the frame that the elliptical shape is centered, an angle of rotation of the elliptical shape, a first major axis distance and a second major distance, and a first minor axis distance and second minor axis distance on a minor axis.

12. The apparatus of claim 11 , wherein the metadata further includes a transition weighting function used to monotonically diminish an effect of the local tone mapping functions between the first range distance and the second range distance.

13. The apparatus of claim 9 , wherein the global tone mapping function and the local tone mapping functions are applied in series or in parallel.

14. The apparatus of claim 8 , wherein the metadata includes a peak luminance value of the video and the characteristic of the display includes a peak luminance value of the display.

15. A non-transitory computer readable medium comprising program code, that when executed by at least one processor, causes the at least one processor to:

receive a video and metadata, wherein the metadata is at least partially representative of a global tone mapping function;

determine the global tone mapping function based at least on the metadata and an identified characteristic of a display; and

generate a tone mapped video by applying the determined global tone mapping function to the video, based on an identified peak luminance value characteristic of the display in application of the global tone mapping function, and by processing individual pixels of a frame for the video, wherein a transition weighing factor is used to mix the individual pixels between the global tone mapping function and a local mapping function.

16. The non-transitory computer readable medium of claim 15 , wherein the metadata is further representative of local tone mapping functions, and wherein generating the tone mapped video further comprises applying a local tone mapping function to the video.

17. The non-transitory computer readable medium of claim 16 , wherein the global tone mapping function and the local tone mapping functions correspond to an explicit Bezier curve.

18. The non-transitory computer readable medium of claim 15 , wherein the metadata includes a peak luminance value of the video and the characteristic of the display includes a peak luminance value of the display.

19. A method for tone mapping of a video for a display, the method comprising:

receiving the video and metadata, wherein the metadata is at least partially representative of a global tone mapping function;

determining the global tone mapping function based at least on the metadata and a characteristic of the display; and

generating, by at least one processor, a tone mapped video by applying the global tone mapping function to the video and using a peak luminance value characteristic of the display in application of the global tone mapping function, wherein the global tone mapping function corresponds to an explicit Bezier curve.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: TAO, LI; KIM, YEONG-TAEG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 037469/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: TAO, LI; KIM, YEONG-TAEG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 037469/0483 →
Continuity (2)
Provisional Application 62184065 · Jun 24, 2015
Related Publication 20160381335A1 · Dec 29, 2016
Cited By (3)
US 12,249,054 US 12,363,270 US 12,608,783