Granted Patent B2

US 12,407,917 · App. 18/105,331 · Granted Sep 2, 2025

Inventors: Daeyoung Hyun (Suwon-si, KR); Changhoon Kim (Suwon-si, KR); Byeongyong Ahn (Suwon-si, KR); Seulki Jang (Suwon-si, KR)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

H04N23/632H04N23/611H04N23/74

Abstract

Claims (71)

1. An electronic device comprising:

a camera;

memory storing computer-executable instructions; and

at least one processor electrically connected to the camera and comprising processing circuitry,

wherein the instructions cause, when being executed by the at least one processor, the electronic device to:

execute the camera;

detect at least one object, based on image data obtained through the camera in a first light source environment comprising a first light source;

analyze color properties of the at least one detected object;

determine a first effect, based on the analyzed color properties of the at least one detected object, wherein the first effect comprises a first light source effect corresponding to the first light source;

apply a second light source effect comprising a relighting effect corresponding to a second light source different from the first light source to the at least one object, wherein the second light source comprises a virtual light source having properties different from the first light source; and

apply the first effect to a background, excluding the at least one object.

2. The electronic device of claim 1 , wherein the at least one processor is configured to remove an effect of the first light source from the at least one object and apply the second light source effect different from the first light source to the at least one object.

3. The electronic device of claim 1 , wherein the at least one processor is configured to apply the second light source effect to the at least one object in response to a size of a face of the at least one object being greater than or equal to a first size and in response to an angle of the face of the object being less than or equal to a first angle in yaw, roll, and pitch directions.

4. The electronic device of claim 1 , wherein the at least one processor is configured to:

obtain a photographing input of a user;

obtain at least a first image and a second image in response to the photographing input;

apply the first light source effect to the first image;

apply the second light source effect to the at least one object of the second image;

apply the first effect to the background of the second image; and

display the first image and the second image on a display.

5. The electronic device of claim 1 , wherein the at least one processor is configured to compare a second color value of the second light source effect with a first color value of the first effect and, based on the comparison, in case that a difference between the second color value and the first color value is equal to or less than a first value, change a brightness value of at least one of the second light source effect and the first effect.

6. The electronic device of claim 1 , wherein the at least one processor is configured to, in response to detection of a brightness value of the image data:

apply a contour light effect to the at least one object in response to the brightness value being less than a first brightness value; and

in response to the brightness value being greater than or equal to the first brightness value, change and apply the brightness value as a light source effect.

7. The electronic device of claim 1 , wherein the at least one processor is configured to:

analyze properties of the first light source by analyzing image data obtained through the camera;

determine a direction and an intensity of the first light source, based on the analysis; and

determine the second light source effect, based on the direction and intensity of the first light source.

8. The electronic device of claim 1 , wherein the at least one processor is configured to apply a gradation effect to the background, based on a direction of at least one of the first light source and the second light source.

9. The electronic device of claim 8 , wherein the at least one processor is configured to apply a frame effect to an outer portion of the image data, based on at least one of a size and a position of an area related to the at least one object.

10. The electronic device of claim 1 , wherein the at least one processor is configured to separate the object and the background through upper body segmentation.

11. A method of operating an electronic device, the method comprising:

executing a camera;

detecting at least one object, based on image data obtained through the camera in a first light source environment;

analyzing color properties of the at least one detected object;

determining a first effect, based on the analyzed color properties of the at least one detected object, wherein the first effect comprises a first light source effect corresponding to the first light source;

applying a second light source effect comprising a relighting effect corresponding to a second light source different from the first light source to the at least one object, wherein the second light source comprises a virtual light source having properties different from the first light source; and

applying the first effect to a background, excluding the at least one object.

12. The method of claim 11 , further comprising:

removing an effect of the first light source from the at least one object; and

applying the second light source effect different from the first light source to the at least one object.

13. The method of claim 11 , further comprising applying the second light source effect to the at least one object in response to a size of a face of the at least one object being greater than or equal to a first size and in response to an angle of the face of the object being less than or equal to a first angle in yaw, roll, and pitch directions.

14. The method of claim 11 , further comprising:

obtaining a photographing input of a user;

obtaining at least a first image and a second image in response to the photographing input;

applying the first light source effect to the first image;

applying the second light source effect to the at least one object of the second image;

applying the first effect to the background of the second image; and

displaying the first image and the second image on a display.

15. The method of claim 11 , further comprising:

comparing a second color value of the second light source effect with a first color value of the first effect; and

based on the comparison, in response to a difference between the second color value and the first color value being equal to or less than a first value, changing a brightness value of at least one of the second light source effect and the first effect.

16. An electronic device comprising:

a camera;

memory storing computer-executable instructions; and

at least one processor electrically connected to the camera and comprising processing circuitry,

wherein the instructions cause, when being executed by the at least one processor, the electronic device to:

execute the camera,

detect at least one object based on image data obtained through the camera in a first light source environment comprising a first light source,

analyze properties of the at least one detected object,

determine at least one light source effect based on the analyzed properties of the at least one detected object,

apply, to the at least one detected object, a first light source effect corresponding to a second light source different from the first light source, wherein the second light source comprises a virtual light source having properties different from the first light source,

apply, to a background excluding the at least one detected object, a second light source effect which is different from the first light source effect.

17. The electronic device of claim 16 ,

wherein the at least one processor is configured to separate the at least one detected object and the background through upper body segmentation.

18. The electronic device of claim 16 ,

wherein the at least one processor is configured to determine the second light source effect based on at least one of the properties of the at least one detected object or the first light source effect.

19. The electronic device of claim 16 ,

wherein the second light source is different from the first light source in at least one of intensity or direction.

20. The electronic device of claim 16 ,

wherein the at least one processor is configured to increase a brightness value of an area corresponding to the at least one detected object, and decrease a brightness value of an area corresponding to the background.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (30)