Representing and reconstructing high dynamic range images

1. A system for reconstructing and displaying a higher dynamic range image, the system comprising:

an image processor comprising image processing hardware, software stored on a non transitory computer readable medium and executable by a data processor, or a combination thereof, configured to:

generate a scaling image comprising information relating to high spatial frequency components of a full resolution, lower dynamic range (FRLDR) representation of an image;

generate an upsampled image from a lower resolution, higher dynamic range (LRHDR) representation of the image, the LRHDR representation having a lower resolution and a higher dynamic range than the FRLDR representation; and,

combine the scaling image and the upsampled image to obtain a reconstructed higher dynamic range image; and,

an image-displaying device configured to display the reconstructed higher dynamic range image.

2. A system according to claim 1 wherein the FRLDR representation is created from an original full resolution, high dynamic range representation of the image using a tone mapping operation and wherein the image processor is configured to perform an inverse tone mapping operation.

3. A system according to claim 1 wherein the image processor is configured to:

downsample the FRLDR representation to obtain a downsampled image having a resolution sufficiently low to comprise only spatial frequency components below a desired spatial frequency level;

upsample the downsampled image to obtain a resampled image; and

combine the resampled image and the FRLDR representation to generate the scaling image.

4. A system according to claim 3 wherein the image processor is configured to divide each pixel value of the FRLDR representation by a corresponding pixel value of the resampled image.

5. A system according to claim 3 wherein an average of pixel values in the scaling image is 1.

6. A system according to claim 1 wherein the image processor is configured to multiply each pixel value of the scaling image with a corresponding pixel value of the upsampled image.

7. A system according to claim 1 wherein the image processor is configured to apply a convolution filter to the FRLDR representation.

8. A system according to claim 1 wherein the image processor is configured to convert a color space of the FRLDR representation into a color space of the LRHDR representation.

9. A system according to claim 1 wherein the image processor is configured to:

determine an impulse response function from the FRLDR representation and the LRHDR representation;

extract high spatial frequency components of the FRLDR representation; and

multiply each pixel value of the extracted high spatial frequency components by a corresponding value of the impulse response function to generate the scaling image.

10. A system according to claim 9 wherein the image processor is configured to apply a quantization threshold to the high spatial frequency components.

11. A system according to claim 10 wherein the image processor is configured to:

extract high spatial frequency components of the LRHDR representation to obtain a high frequency band of the LRHDR representation;

reduce a resolution of the FRLDR representation to obtain a reduced resolution low dynamic range image;

extract high spatial frequency components of the reduced resolution low dynamic range image to obtain a high frequency band of the reduced resolution low dynamic range image; and

process the high frequency band of the LRHDR representation and the high frequency band of the reduced resolution low dynamic range image to determine the impulse response function.

12. A system according to claim 11 wherein the image processor is configured to:

select a group of pixels from within a spatial region of the high frequency band of the LRHDR representation and selecting a corresponding group of pixels from within the spatial region of the high frequency band of the reduced resolution low dynamic range image;

sort the group of pixels and the corresponding group of pixels by pixel value to obtain a pair of sorted arrays defining a regional impulse response function corresponding to the spatial region; and,

combine one or more regional impulse response functions to obtain the impulse response function.

13. A system according to claim 12 wherein the image processor is configured to select and sort groups of pixels for a plurality of spatial regions.

14. A system according to claim 12 wherein the image processor is configured to:

select a plurality of pairs of pixel values from the pair of sorted arrays, each pair of pixel values comprising pixel values having a common index within the pair of sorted arrays; and,

interpolate between the plurality of pairs of pixel values.

15. A system according to claim 12 wherein the image processor is configured to:

determine a regional impulse response function value for each of a plurality of regions that include the pixel; and,

computing a weighted combination of the regional impulse response function values.

16. A system according to claim 15 wherein the image processor is configured to weight the regional impulse response function values based on distances of the pixel from central points in the regions to which the regional impulse response function values correspond.

17. A system according to claim 14 wherein the image processor is configured to extrapolate the regional impulse response function past at least one of the smallest and largest ones of the pairs of pixel values.

18. A system according to claim 1 wherein the image-displaying device comprises a computer display.

19. A system according to claim 1 wherein the image-displaying device comprises a television.

20. A system according to claim 1 wherein the image-displaying device comprises a projector.

21. A system for reconstructing a higher dynamic range image, the system comprising:

an image processor comprising image processing hardware, software stored on a non transitory computer readable medium and executable by a data processor, or a combination thereof, configured to:

generate a scaling image comprising information relating to high spatial frequency components of a full resolution, lower dynamic range (FRLDR) representation of an image;

generate an upsampled image from a lower resolution, higher dynamic range (LRHDR) representation of the image, the LRHDR representation having a lower resolution and a higher dynamic range than the FRLDR representation; and,

combine the scaling image and the upsampled image to obtain a reconstructed higher dynamic range image; and,

an output configured to provide the reconstructed higher dynamic range image to an image-displaying device.

22. A system according to claim 21 wherein the FRLDR representation is created from an original full resolution, high dynamic range representation of the image using a tone mapping operation and wherein the image processor is configured to perform an inverse tone mapping operation.

23. A system according to claim 21 wherein the image processor is configured to:

downsample the FRLDR representation to obtain a downsampled image having a resolution sufficiently low to comprise only spatial frequency components below a desired spatial frequency level;

upsample the downsampled image to obtain a resampled image; and

combine the resampled image and the FRLDR representation to generate the scaling image.

24. A system according to claim 23 wherein the image processor is configured to divide each pixel value of the FRLDR representation by a corresponding pixel value of the resampled image.

25. A system according to claim 23 wherein an average of pixel values in the scaling image is 1.

26. A system according to claim 21 wherein the image processor is configured to multiply each pixel value of the scaling image with a corresponding pixel value of the upsampled image.

27. A system according to claim 21 wherein the image processor is configured to apply a convolution filter to the FRLDR representation.

28. A system according to claim 21 wherein the image processor is configured to convert a color space of the FRLDR representation into a color space of the LRHDR representation.

29. A system according to claim 21 wherein the image processor is configured to:

determine an impulse response function from the FRLDR representation and the LRHDR representation;

extract high spatial frequency components of the FRLDR representation; and

multiply each pixel value of the extracted high spatial frequency components by a corresponding value of the impulse response function to generate the scaling image.

30. A system according to claim 29 wherein the image processor is configured to apply a quantization threshold to the high spatial frequency components.

31. A system according to claim 30 wherein the image processor is configured to:

extract high spatial frequency components of the LRHDR representation to obtain a high frequency band of the LRHDR representation;

reduce a resolution of the FRLDR representation to obtain a reduced resolution low dynamic range image;

extract high spatial frequency components of the reduced resolution low dynamic range image to obtain a high frequency band of the reduced resolution low dynamic range image; and

process the high frequency band of the LRHDR representation and the high frequency band of the reduced resolution low dynamic range image to determine the impulse response function.

32. A system according to claim 31 wherein the image processor is configured to:

select a group of pixels from within a spatial region of the high frequency band of the LRHDR representation and selecting a corresponding group of pixels from within the spatial region of the high frequency band of the reduced resolution low dynamic range image;

sort the group of pixels and the corresponding group of pixels by pixel value to obtain a pair of sorted arrays defining a regional impulse response function corresponding to the spatial region; and,

combine one or more regional impulse response functions to obtain the impulse response function.

33. A system according to claim 32 wherein the image processor is configured to select and sort groups of pixels for a plurality of spatial regions.

34. A system according to claim 32 wherein the image processor is configured to:

select a plurality of pairs of pixel values from the pair of sorted arrays, each pair of pixel values comprising pixel values having a common index within the pair of sorted arrays; and,

interpolate between the plurality of pairs of pixel values.

35. A system according to claim 32 wherein the image processor is configured to:

determine a regional impulse response function value for each of a plurality of regions that include the pixel; and,

computing a weighted combination of the regional impulse response function values.

36. A system according to claim 35 wherein the image processor is configured to weight the regional impulse response function values based on distances of the pixel from central points in the regions to which the regional impulse response function values correspond.

37. A system according to claim 34 wherein the image processor is configured to extrapolate the regional impulse response function past at least one of the smallest and largest ones of the pairs of pixel values.

38. A system according to claim 21 wherein the system is integrated with a DVD player.

39. A system according to claim 21 wherein the system is integrated with a video player.