IP Library › Granted Patent US 10,623,633
Granted Patent B2
US 10,623,633 · App. 15/558,413 · Granted Apr 14, 2020

Image synthesis device and image synthesis method

Inventor: Yoshiteru Tanaka (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04N5/23229G06K9/00234G06K9/4661H04N5/2351H04N5/23219H04N5/23293H04N5/243H04N5/272H04N9/68H04N9/77
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,623,633
App. No.
15/558,413
Granted
Apr 14, 2020
Kind
B2
Abstract

An image synthesis device includes imaging unit ( 110 ) that photographs video, displayer ( 150 ) that displays the photographed video, and makeup image superimposing unit ( 140 ) that changes brightness of a makeup image superimposed with a face of the video on a pixel basis and superimposes the makeup image of which the brightness is changed on the face of the video, every time skin brightness of the face included in the video changes. Even if the brightness that illuminates the face changes, it is possible to synthesize the makeup image with an image familiar to the skin in real time.

Claims (41)

1. An image synthesis device comprising:

a camera that photographs a video of a face;

a displayer that displays the photographed video; and

a calculator that

changes brightness of a makeup image to be superimposed with the face included in the video when a change of skin brightness of the face included in the video is calculated,

superimposes the makeup image of which the brightness is changed on the face included in the video,

calculates skin brightness of a target pixel in a region of the face included in the video by averaging brightness of surrounding pixels having hue close to the target pixel,

calculates brightness of the makeup image according to a ratio of the calculated skin brightness of the target pixel with respect to skin brightness to be a reference, in a case where the calculated skin brightness has changed from a previously calculated skin brightness,

calculates saturation of the makeup image according to a ratio of the calculated brightness of the makeup image with respect to the brightness of the makeup image to be a reference, and

calculates the saturation by half of a change rate in brightness.

2. The image synthesis device of claim 1 ,

wherein the calculator changes the change rate in brightness of the brightness of the makeup image in accordance with reflection intensity of the face caused by a property of makeup on the face.

3. An image synthesis method comprising:

photographing, via a camera, video of a face;

displaying, via a displayer, the photographed video;

changing, via a calculator, brightness of a makeup image to be superimposed with the face included in the video when a change of skin brightness of the face included in the video is calculated;

superimposing, via the calculator, the makeup image of which brightness is changed on the face included in the video;

calculating, via the calculator, skin brightness of a target pixel in a region of the face included in the video by averaging brightness of surrounding pixels having hue close to the target pixel;

calculating, via the calculator, brightness of the makeup image according to a ratio of the calculated skin brightness of the target pixel with respect to skin brightness to be a reference, in a case where the calculated skin brightness has changed from a previously calculated skin brightness;

calculating, via the calculator, saturation of the makeup image according to a ratio of the calculated brightness of the makeup image with respect to the brightness of the makeup image to be a reference; and

calculating, via the calculator, the saturation by half of a change rate in brightness.

4. The image synthesis method of claim 3 , further comprising,

calculating, via the calculator, reflection intensity of the face in accordance with the skin brightness of the face included in the video, wherein

the brightness of the makeup image superimposed on the face included in the video is changed in accordance with the calculated reflection intensity.

5. The image synthesis method of claim 3 , further comprising,

cutting out, via the calculator, a still image from the video on which the makeup image is superimposed at a timing where an imaging button on the camera is pressed.

6. The image synthesis method of claim 3 , wherein

the camera is disposed on a same side as the displayer displaying the video.

7. An image synthesis method comprising:

photographing, via a camera, video of a face;

displaying, via a displayer, the photographed video on which a makeup image is superimposed;

calculating, via a calculator, skin brightness of the face included in the video;

changing brightness and saturation of the makeup image in a case where the calculated skin brightness has changed from a previously calculated skin brightness; and

superimposing the makeup image on the photographed video by using the changed brightness and saturation of the makeup image, wherein

a change rate of saturation of the makeup image is smaller than a change rate of brightness of the makeup image.

8. The image synthesis method of claim 7 , further comprising,

calculating, via the calculator, reflection intensity of the face in accordance with the skin brightness of the face included in the video, wherein

the brightness of the makeup image superimposed on the face included in the video is changed in accordance with the calculated reflection intensity.

9. The image synthesis method of claim 7 , further comprising,

cutting out, by the calculator, a still image from the video on which the makeup image is superimposed at a timing where an imaging button of the camera is pressed.

10. The image synthesis method of claim 7 , wherein the camera is disposed on a same side as the displayer displaying the video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2017
From: TANAKA, YOSHITERU
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 044196/0265 →
Priority Claims (1)
JP 2015-064293 · Mar 26, 2015 · national
Continuity (1)
Related Publication 20180077347A1 · Mar 15, 2018
Cited By (1)
US 12,282,986