Composite image generation based on image segmentation

1 . A method comprising:

receiving, using a first graphical user interface (GUI), a first user input indicative of a zoom level for a scene;

obtaining, based on the first user input, first image data of the scene, wherein the first image data is associated with a first zoom level corresponding to the zoom level for the scene, and wherein the first image data includes at least a foreground portion and a background portion;

receiving, using a second GUI, a second user input indicative of an adjustment to increase or decrease a zoom level of the foreground portion relative to the background portion included in the first image data, wherein the adjustment corresponds to a second zoom level greater than the first zoom level or a second zoom level less than the first zoom level;

obtaining a second image data of the scene based on the adjustment and using the second zoom level, the second image data including at least an adjusted foreground portion associated with the second zoom level;

generating a segmented foreground portion associated with the second zoom level based on segmenting the adjusted foreground portion from the second image data of the scene; and

generating a composite image based on combining the segmented foreground portion from the second image data of the scene with at least a portion of the first image data of the scene.

2 . The method of claim 1 , further comprising:

outputting a first frame corresponding to the composite image;

receiving a command to capture an image frame corresponding to the composite image, wherein the first frame is outputted prior to receiving the command to capture the image frame; and

outputting a captured frame corresponding to the composite image, based on receiving the command to capture the image frame.

3 . The method of claim 2 , wherein:

the first frame is a preview frame corresponding to the composite image;

the captured frame is the composite image; and

the captured frame is different from the first frame.

4 . The method of claim 1 , wherein:

the first image data comprises first image data obtained using a first camera having a first focal length; and

the second image data comprises second image data obtained using a second camera having a second focal length.

5 . The method of claim 4 , wherein generating the composite image includes:

outputting, using an image capture user interface (UI), a first frame corresponding to the composite image, wherein the first frame includes a portion of the first image data composited with a portion of the second image data; and

receiving an input to capture a frame, wherein the input is received subsequent to outputting the first frame and comprises a user input to the image capture UI.

6 . The method of claim 1 , further comprising:

outputting a preview of the composite image; and

receiving a third user input indicative of an adjustment to increase or decrease one or more of the first zoom level or the second zoom level based on the preview of the composite image.

7 . The method of claim 1 , wherein the second image data is obtained based on the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion relative to the background portion.

8 . The method of claim 1 , wherein receiving the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion relative to the background portion comprises:

receiving a user input indicative of a selected foreground portion from one or more foreground portions included in the first image data of the scene; and

receiving a user input indicative of the adjustment to increase or decrease the zoom level of the selected foreground portion relative to the background portion.

9 . The method of claim 1 , wherein:

the first user input is indicative of an adjustment to increase or decrease a zoom level of the background portion.

10 . A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

receive, using a first graphical user interface (GUI), a first user input indicative of a zoom level for a scene;

obtain, based on the first user input, first image data of the scene, wherein the first image data is associated with a first zoom level corresponding to the zoom level for the scene, and wherein the first image data includes at least a foreground portion and a background portion;

receive, using a second GUI, a second user input indicative of an adjustment to increase or decrease a zoom level of the foreground portion relative to the background portion included in the first image data, wherein the adjustment corresponds to a second zoom level greater than the first zoom level or a second zoom level less than the first zoom level;

obtain a second image data of the scene based on the adjustment and using the second zoom level, the second image data including at least an adjusted foreground portion associated with the second zoom level;

generate a segmented foreground portion associated with the second zoom level based on segmenting the adjusted foreground portion from the second image data of the scene; and

generate a composite image based on combining the segmented foreground portion from the second image data of the scene with at least a portion of the first image data of the scene.

11 . An apparatus for processing image data, comprising:

at least one memory; and

at least one processor coupled to the at least one memory, the at least one processor configured to:

receive, using a first graphical user interface (GUI), a first user input indicative of a zoom level for a scene;

obtain, based on the first user input, first image data of the scene, wherein the first image data is associated with a first zoom level corresponding to the zoom level for the scene, and wherein the first image data includes at least a foreground portion and a background portion;

receive, using a second GUI, a second user input indicative of an adjustment to increase or decrease a zoom level of the foreground portion relative to the background portion included in the first image data, wherein the adjustment corresponds to a second zoom level greater than the first zoom level or a second zoom level less than the first zoom level;

obtain a second image data of the scene based on the adjustment and using the second zoom level, the second image data including at least an adjusted foreground portion associated with the second zoom level;

generate a segmented foreground portion associated with the second zoom level based on segmenting the adjusted foreground portion from the second image data of the scene; and

generate a composite image based on combining the segmented foreground portion from the second image data of the scene with at least a portion of the first image data of the scene.

12 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

receive a command to capture an image frame corresponding to the composite image.

13 . The apparatus of claim 12 , wherein, to generate the composite image, the at least one processor is configured to:

output a first frame corresponding to the composite image, wherein the first frame is output prior to receiving the command to capture the image frame corresponding to the composite image.

14 . The apparatus of claim 13 , wherein, to generate the composite image, the at least one processor is further configured to:

output a captured frame corresponding to the composite image, wherein the captured frame is output based on receiving the command to capture the image frame.

15 . The apparatus of claim 14 , wherein the first frame is a preview frame corresponding to the composite image, and wherein the captured frame is the composite image.

16 . The apparatus of claim 14 , wherein the captured frame is different from the first frame.

17 . The apparatus of claim 11 , wherein, to generate the composite image, the at least one processor is configured to:

output a first frame corresponding to a composite image; and

receive an input to capture a frame, wherein the input is received subsequent to the output of the first frame.

18 . The apparatus of claim 17 , wherein:

the first image data comprises first image data obtained using a first camera having a first focal length; and

the second image data comprises second image data obtained using a second camera having a second focal length.

19 . The apparatus of claim 18 , wherein the first image data and the second image data are obtained prior to receiving an input to capture a frame.

20 . The apparatus of claim 19 , wherein the first image data is associated with a preview frame obtained using the first camera, and wherein the second image data is associated with a preview frame obtained using the second camera.

21 . The apparatus of claim 18 , wherein, to output the first frame, the at least one processor is configured to:

display, using an image capture user interface (UI), a portion of the first image data composited with a portion of the second image data.

22 . The apparatus of claim 21 , wherein the input to capture a frame is a command to capture the composite image and comprises a user input to the image capture UI.

23 . The apparatus of claim 22 , wherein the user input corresponds to a shutter button of the image capture UI.

24 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

output a preview of the composite image; and

receive the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion based on the preview of the composite image.

25 . The apparatus of claim 24 , wherein the at least one processor is further configured to:

receive a third user input indicative of an adjustment to increase or decrease one or more of the first zoom level or the second zoom level based on the preview of the composite image.

26 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

display the composite image in a preview, wherein the preview includes the composite image and at least the second GUI associated with receiving the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion.

27 . The apparatus of claim 26 , wherein the preview comprises the first second GUI overlaid on the composite image.

28 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

remove, from the first image data and based on segmentation information of the foreground portion in the first image data, pixels corresponding to the foreground portion; and

generate, using an image completion engine, an inpainted first image data, wherein each removed pixel of the pixels corresponding to the foreground portion in the first image data is replaced with a corresponding inpainted pixel.

29 . The apparatus of claim 11 , wherein the second image data is obtained based on the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion relative to the background portion.

30 . The apparatus of claim 11 , wherein, to receive the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion relative to the background portion, the at least one processor is configured to:

receive a user input indicative of a selected foreground portion from one or more foreground portions included in the first image data of the scene; and

receive a user input indicative of the adjustment to increase or decrease the zoom level of the selected foreground portion relative to the background portion.

31 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

receive a third user input indicative of an additional adjustment to increase or decrease a zoom level of the background portion relative to the foreground portion included in the first image data;

obtain a third image data of the scene based on the additional adjustment and using a third zoom level corresponding to the additional adjustment, the third image data including at least an adjusted background portion associated with the third zoom level;

generate a segmented background portion based on segmenting the adjusted background portion from the third image data of the scene; and

generate the composite image based on combining the segmented foreground portion from the second image data of the scene with the segmented background portion from the third image data of the scene and a portion of the first image data of the scene.

32 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

receive an additional user input indicative of an adjustment to a position of the foreground portion; and

generate the composite image further based on translating the segmented foreground portion based on the additional user input, wherein the segmented foreground portion is translated relative to the portion of the first image data of the scene.

33 . The apparatus of claim 11 , wherein, to obtain the second image data of the scene, the at least one processor is configured to:

scale the first image data to obtain a scaled first image data, wherein the scaled first image data is associated with the second zoom level, and wherein the scaled first image data includes a scaled foreground portion corresponding to the foreground portion.

34 . The apparatus of claim 11 , wherein the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion is received in a slider GUI element of the second GUI.

35 . The apparatus of claim 34 , wherein the second user input moving the slider GUI element in a first direction is indicative of an increase to the zoom level and wherein the second user input moving the slider GUI element in a second direction is indicative of a decrease to the zoom level.

36 . The apparatus of claim 35 , wherein the second GUI includes a plurality of discrete step adjustments, each discrete step adjustment of the plurality of discrete step adjustments corresponding to a configured increase or decrease to the zoom level.

37 . The apparatus of claim 11 , wherein

the first user input is indicative of an adjustment to increase or decrease a zoom level of the background portion.

38 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

determine, based on the first user input, an adjustment to increase or decrease a zoom level of the background portion relative to the foreground portion included in the first image data;

automatically determine a corresponding adjustment to increase or decrease the zoom level of the foreground portion, wherein the corresponding adjustment is automatically determined relative to the first user input indicative of the adjustment to increase or decrease the zoom level of the background portion; and

generate the composite image based on the adjustment to increase or decrease the zoom level of the background portion and the automatically determined corresponding adjustment to increase or decrease the zoom level of the foreground portion.

39 . The apparatus of claim 11 , wherein the at least one processor is further configured to:

automatically determine a corresponding adjustment to increase or decrease a zoom level of the background portion relative to the foreground portion included in the first image data, based on receiving the second user input indicative of the adjustment to increase or decrease the zoom level of the foreground portion; and

generate the composite image based on the adjustment to increase or decrease the zoom level of the foreground portion and the automatically determined corresponding adjustment to increase or decrease the zoom level of the background portion.