IP Library › Granted Patent US 10,402,681
Granted Patent B2
US 10,402,681 · App. 16/010,998 · Granted Sep 3, 2019

Image processing apparatus and image processing method

Inventors: Masayuki Aiba (Kanagawa, JP); Hiroaki Eto (Kanagawa, JP)
Assignee: Sony Corporation
G06K9/6202G06K9/4661G06T5/009G06T15/503G09G5/00G09G5/10G09G5/14G09G5/377G06T2207/20212G09G2320/0233G09G2320/0271G09G2320/062G09G2320/066G09G2320/08G09G2340/02G09G2340/0428G09G2340/10G09G2360/16G09G2370/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,402,681
App. No.
16/010,998
Granted
Sep 3, 2019
Kind
B2
Abstract

To display images by suitably superimposing a graphics image on a high-dynamic-range image in an easily visible manner. GOEA dynamic range converter ( 311 ) converts a SDR graphics image to an HDR graphics image based on metadata. An image combiner ( 312 ) combines the graphics image of which the dynamic range has been converted to HDR with HDR content. A dynamic range converter ( 313 ) performs display mapping on the HDR content combined with the graphics image based on metadata.

Claims (76)

1. An image processing apparatus comprising:

a metadata acquiring unit that acquires metadata of first image data; and

a processor that processes a second image to be superimposed on the first image data based on the metadata,

wherein

the metadata acquiring unit acquires a reference white luminance indicating a luminance value of white serving as a reference of the first image data as the metadata, and

the processor adjusts a luminance of the second image based on the reference white luminance.

2. The image processing apparatus according to claim 1 , wherein

the processor compares the reference white luminance with a reference luminance of a display that displays the first image data and adjusts the luminance of the second image based on the larger luminance information.

3. The image processing apparatus according to claim 1 , wherein

the processor adjusts the luminance of the second image based on the reference luminance of the display when the metadata acquiring unit is unable to acquire the reference white luminance of the first image data.

4. The image processing apparatus according to claim 1 , wherein

the processor compares the reference white luminance with a reference luminance of a dynamic range of a predetermined luminance and adjusts the luminance of the second image based on the larger luminance information.

5. The image processing apparatus according to claim 4 , wherein

the processor adjusts the luminance of the second image based on the reference luminance of the dynamic range of the predetermined luminance when the metadata acquiring unit is unable to acquire the reference white luminance of the first image data.

6. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the second image processed by the processor with the first image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data,

wherein

the metadata acquiring unit acquires at least one of information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data or information on a target luminance indicating a luminance value of a main or target object of the first image data as the metadata, and

the dynamic range converter adjusts the dynamic range of the luminance of the first image data so as to maintain the reference white luminance or the target luminance.

7. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the second image processed by the processor with the first image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the first image data and information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data as the metadata, and

when the peak luminance of the first image data is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the first image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the first image data and the reference white luminance while maintaining the luminance value equal to or lower than the reference white luminance.

8. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the second image processed by the processor with the first image data; and

a dynamic range converter that adjusts a dynamic range of the luminance of the first image data combined with the second image so as to match a display that displays the first image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the first image data and information on a target luminance indicating a luminance value of a main or target object of the first image data as the metadata, and

when the peak luminance of the first image data is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the first image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the first image data and the target luminance while maintaining the luminance value equal to or lower than the target luminance.

9. The image processing apparatus according to claim 1 , further comprising:

a combiner that combines the second image processed by the processor with the first image data; and

a dynamic range converter that adjusts a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data,

wherein

the metadata acquiring unit acquires information on a peak luminance of the first image data, information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data, and information on a target luminance indicating a luminance value of a main or target object of the first image data the metadata, and

when the reference white luminance is larger than a peak luminance of the display, the dynamic range converter compresses the peak luminance of the first image data up to the peak luminance of the display and compresses a luminance value between the peak luminance of the first image data and the target luminance while maintaining the luminance value equal to or lower than the peak luminance.

10. An image processing method comprising:

acquiring metadata of first image data;

processing a second image to be superimposed on the first image data based on the metadata;

acquiring a reference white luminance indicating a luminance value of white serving as a reference of the first image data as the metadata; and

adjusting a luminance of the second image based on the reference white luminance.

11. The image processing method according to claim 10 , further comprising:

comparing the reference white luminance with a reference luminance of a display that displays the first image data and adjusting the luminance of the second image based on the larger luminance information.

12. The image processing method according to claim 10 , further comprising:

adjusting the luminance of the second image based on the reference luminance of the display when the reference white luminance of the first image data is unable to be acquired.

13. The image processing method according to claim 10 , further comprising:

comparing the reference white luminance with a reference luminance of a dynamic range of a predetermined luminance and adjusting the luminance of the second image based on the larger luminance information.

14. The image processing method according to claim 13 , further comprising:

adjusting the luminance of the second image based on the reference luminance of the dynamic range of the predetermined luminance when the reference white luminance of the first image data is unable to be acquired.

15. The image processing method according to claim 10 , further comprising:

combining the second image with the first image data;

adjusting a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data;

acquiring at least one of information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data or information on a target luminance indicating a luminance value of a main or target object of the first image data as the metadata; and

adjusting the dynamic range of the luminance of the first image data so as to maintain the reference white luminance or the target luminance.

16. The image processing method according to claim 10 , further comprising:

combining the second image with the first image data;

adjusting a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data;

acquiring information on a peak luminance of the first image data and information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data as the metadata; and

when the peak luminance of the first image data is larger than a peak luminance of the display, compressing the peak luminance of the first image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the first image data and the reference white luminance while maintaining the luminance value equal to or lower than the reference white luminance.

17. The image processing method according to claim 10 , further comprising:

combining the second image with the first image data;

adjusting a dynamic range of the luminance of the first image data combined with the second image so as to match a display that displays the first image data;

acquiring information on a peak luminance of the first image data and information on a target luminance indicating a luminance value of a main or target object of the first image data as the metadata; and

when the peak luminance of the first image data is larger than a peak luminance of the display, compressing the peak luminance of the first image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the first image data and the target luminance while maintaining the luminance value equal to or lower than the target luminance.

18. The image processing method according to claim 10 , further comprising:

combining the second image with the first image data;

adjusting a dynamic range of luminance of the first image data combined with the second image so as to match a display that displays the first image data;

acquiring information on a peak luminance of the first image data, information on the reference white luminance indicating the luminance value of white serving as the reference of the first image data, and information on a target luminance indicating a luminance value of a main or target object of the first image data the metadata; and

when the reference white luminance is larger than a peak luminance of the display, compressing the peak luminance of the first image data up to the peak luminance of the display and compressing a luminance value between the peak luminance of the first image data and the target luminance while maintaining the luminance value equal to or lower than the peak luminance.

19. A non-transitory storage medium on which is recorded a program executable by a computer, the program comprising:

acquiring metadata of first image data;

processing a second image to be superimposed on the first image data based on the metadata;

acquiring a reference white luminance indicating a luminance value of white serving as a reference of the first image data as the metadata; and

adjusting a luminance of the second image based on the reference white luminance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2018
From: AIBA, MASAYUKI; ETO, HIROAKI
To: SONY CORPORATION
Reel/Frame 047245/0644 →
Priority Claims (1)
JP 2014-185588 · Sep 11, 2014 · national
Continuity (4)
Continuation 15494979 · Apr 24, 2017
Continuation 15278624 · Sep 28, 2016
Continuation 14771258
Related Publication 20180300921A1 · Oct 18, 2018