IP Library › Granted Patent US 10,032,300
Granted Patent B2
US 10,032,300 · App. 15/494,979 · Granted Jul 24, 2018

Image processing apparatus and image processing method

Inventors: Masayuki Aiba (Kanagawa, JP); Hiroaki Eto (Kanagawa, JP)
Assignee: Sony Corporation
G06T11/60G06T5/007G06T2207/20208G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,032,300
App. No.
15/494,979
Granted
Jul 24, 2018
Kind
B2
Abstract

To display images by suitably superimposing a graphics image on a high-dynamic-range image in an easily visible manner. GOEA dynamic range converter ( 311 ) converts a SDR graphics image to an HDR graphics image based on metadata. An image combiner ( 312 ) combines the graphics image of which the dynamic range has been converted to HDR with HDR content. A dynamic range converter ( 313 ) performs display mapping on the HDR content combined with the graphics image based on metadata.

Claims (76)

1. An image processing apparatus comprising:

a metadata acquiring unit that acquires metadata of image data; and

a processor that processes a graphics image to be superimposed on the image data based on the metadata,

wherein

the metadata acquiring unit acquires a reference white luminance indicating a luminance value of white serving as a reference of the image data as the metadata, and

the processor adjusts a luminance of the graphics image based on the reference white luminance.

2. The image processing apparatus according to claim 1 , wherein

the processor compares the reference white luminance with a reference luminance of a display that displays the image data and adjusts the luminance of the graphics image based on the larger luminance information.

3. The image processing apparatus according to claim 1 , wherein

the processor adjusts the luminance of the graphics image based on the reference luminance of the display when the metadata acquiring unit is unable to acquire the reference white luminance of the image data.

4. The image processing apparatus according to claim 1 , wherein

the processor compares the reference white luminance with a reference luminance of a dynamic range of a predetermined luminance and adjusts the luminance of the graphics image based on the larger luminance information.

5. The image processing apparatus according to claim 4 , wherein

the processor adjusts the luminance of the graphics image based on the reference luminance of the dynamic range of the predetermined luminance when the metadata acquiring unit is unable to acquire the reference white luminance of the image data.

6. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the graphics image processed by the processor with the image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data,

wherein

the metadata acquiring unit acquires at least one of information on the reference white luminance indicating the luminance value of white serving as the reference of the image data or information on a target luminance indicating a luminance value of a main or target object of the image data as the metadata, and

the dynamic range converter adjusts the dynamic range of the luminance of the image data so as to maintain the reference white luminance or the target luminance.

7. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the graphics image processed by the processor with the image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the image data and information on the reference white luminance indicating the luminance value of white serving as the reference of the image data as the metadata, and

when the peak luminance of the image data is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the image data and the reference white luminance while maintaining the luminance value equal to or lower than the reference white luminance.

8. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the graphics image processed by the processor with the image data; and

a dynamic range converter that adjusts a dynamic range of the luminance of the image data combined with the graphics image so as to match a display that displays the image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the image data and information on a target luminance indicating a luminance value of a main or target object of the image data as the metadata, and

when the peak luminance of the image data is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the image data and the target luminance while maintaining the luminance value equal to or lower than the target luminance.

9. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the graphics image processed by the processor with the image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the image data, information on the reference white luminance indicating the luminance value of white serving as the reference of the image data, and information on a target luminance indicating a luminance value of a main or target object of the image data the metadata, and

when the reference white luminance is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the image data and the target luminance while maintaining the luminance value equal to or lower than the peak luminance.

10. An image processing method comprising:

acquiring metadata of image data;

processing a graphics image to be superimposed on the image data based on the metadata;

acquiring a reference white luminance indicating a luminance value of white serving as a reference of the image data as the metadata; and

adjusting a luminance of the graphics image based on the reference white luminance.

11. The image processing method according to claim 10 , further comprising:

comparing the reference white luminance with a reference luminance of a display that displays the image data and adjusting the luminance of the graphics image based on the larger luminance information.

12. The image processing method according to claim 10 , further comprising:

adjusting the luminance of the graphics image based on the reference luminance of the display when the reference white luminance of the image data is unable to be acquired.

13. The image processing method according to claim 10 , further comprising:

comparing the reference white luminance with a reference luminance of a dynamic range of a predetermined luminance and adjusting the luminance of the graphics image based on the larger luminance information.

14. The image processing method according to claim 13 , further comprising:

adjusting the luminance of the graphics image based on the reference luminance of the dynamic range of the predetermined luminance when the reference white luminance of the image data is unable to be acquired.

15. The image processing method according to claim 10 , further comprising:

combining the graphics image with the image data;

adjusting a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data;

acquiring at least one of information on the reference white luminance indicating the luminance value of white serving as the reference of the image data or information on a target luminance indicating a luminance value of a main or target object of the image data as the metadata; and

adjusting the dynamic range of the luminance of the image data so as to maintain the reference white luminance or the target luminance.

16. The image processing method according to claim 10 , further comprising:

combining the graphics image with the image data;

adjusting a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data;

acquiring information on a peak luminance of the image data and information on the reference white luminance indicating the luminance value of white serving as the reference of the image data as the metadata; and

when the peak luminance of the image data is larger than a peak luminance of the display, compressing the peak luminance of the image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the image data and the reference white luminance while maintaining the luminance value equal to or lower than the reference white luminance.

17. The image processing method according to claim 10 , further comprising:

combining the graphics image with the image data;

adjusting a dynamic range of the luminance of the image data combined with the graphics image so as to match a display that displays the image data;

acquiring information on a peak luminance of the image data and information on a target luminance indicating a luminance value of a main or target object of the image data as the metadata; and

when the peak luminance of the image data is larger than a peak luminance of the display, compressing the peak luminance of the image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the image data and the target luminance while maintaining the luminance value equal to or lower than the target luminance.

18. The image processing method according to claim 10 , further comprising:

combining the graphics image with the image data;

adjusting a dynamic range of luminance of the image data combined with the graphics image so as to match a display that displays the image data;

acquiring information on a peak luminance of the image data, information on the reference white luminance indicating the luminance value of white serving as the reference of the image data, and information on a target luminance indicating a luminance value of a main or target object of the image data the metadata; and

when the reference white luminance is larger than a peak luminance of the display, compressing the peak luminance of the image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the image data and the target luminance while maintaining the luminance value equal to or lower than the peak luminance.

19. A non-transitory storage medium on which is recorded a program executable by a computer, the program comprising:

acquiring metadata of image data;

processing a graphics image to be superimposed on the image data based on the metadata;

acquiring a reference white luminance indicating a luminance value of white serving as a reference of the image data as the metadata; and

adjusting a luminance of the graphics image based on the reference white luminance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2017
From: AIBA, MASAYUKI; ETO, HIROAKI
To: SONY CORPORATION
Reel/Frame 042333/0606 →
Priority Claims (1)
JP 2014-185588 · Sep 11, 2014 · national
Continuity (3)
Continuation 15278624 · Sep 28, 2016
Continuation 14771258
Related Publication 20170228908A1 · Aug 10, 2017