Interactive image generation
A content generation platform is generally described herein. More specifically, interactive image generation and techniques and features thereof are disclosed herein. One or more sets of images of a scene are captured in an imaging studio. The captured one or more sets of images of the scene are processed using one or more machine learning based networks to generate an interactive image of the scene comprising a plurality of interactive features. One or more of the plurality of interactive features of the generated interactive image may be modified or edited according to user preferences.
1. A method, comprising:
activating one or more cameras to sequentially capture a set of images of a prescribed view of a scene in an imaging studio; and
selectively activating different lighting panels in the imaging studio when sequentially capturing images comprising the set so that images comprising the set comprise different lighting effects;
wherein the set of images is used to at least in part generate an interactive image of the scene comprising a plurality of interactive features modifiable by an end user according to user preferences and wherein the interactive image comprises a two-dimensional image with at least partial three-dimensional capabilities including one or more options for modifying lighting.
2. The method of claim 1 , wherein images comprising the set comprise different shadow effects.
3. The method of claim 1 , wherein the interactive image of the scene comprises one or more options for modifying shadow effects.
4. The method of claim 1 , wherein the one or more cameras are stationary while sequentially capturing the set of images.
5. The method of claim 1 , wherein the one or more cameras comprise a pair of stereo cameras.
6. The method of claim 1 , wherein lighting information is extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
7. The method of claim 6 , wherein lighting extracted from the set of images is blended or mixed to generate virtual lighting with respect to the interactive image.
8. The method of claim 1 , wherein shadows are extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
9. The method of claim 8 , wherein shadows extracted from the set of images are blended or mixed to generate virtual shadows with respect to the interactive image.
10. The method of claim 1 , wherein one or more machine learning based networks facilitate providing virtual lighting and shadow effects with respect to the interactive image.
11. The method of claim 1 , wherein modifying lighting in the interactive image results in a dynamically provided output image with consistent lighting.
12. The method of claim 1 , wherein modifying shadows in the interactive image results in a dynamically provided output image with consistent shadows.
13. The method of claim 1 , wherein modifying a background or an environment of the interactive image results in a dynamically provided output image that appears naturally composed with consistent lighting and shadows.
14. The method of claim 1 , wherein one or more options for modifying lighting comprise a relighting feature with respect to the interactive image.
15. The method of claim 1 , wherein one or more options for modifying lighting comprise a relighting model with respect to the interactive image.
16. The method of claim 1 , wherein one or more options for modifying lighting comprise one or more options for: modifying lights, modifying light positions, and modifying light intensities.
17. The method of claim 1 , wherein one or more options for modifying lighting are provided with respect to a user application for manipulating or modifying the generated interactive image.
18. The method of claim 1 , wherein the imaging studio comprises a known and controlled physical imaging environment.
19. A system, comprising:
a processor configured to:
activate one or more cameras to sequentially capture a set of images of a prescribed view of a scene in an imaging studio; and
selectively activate different lighting panels in the imaging studio when sequentially capturing images comprising the set so that images comprising the set comprise different lighting effects; and
a memory coupled to the processor and configured to provide the processor with instructions;
wherein the set of images is used to at least in part generate an interactive image of the scene comprising a plurality of interactive features modifiable by an end user according to user preferences and wherein the interactive image comprises a two-dimensional image with at least partial three-dimensional capabilities including one or more options for modifying lighting.
20. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
activating one or more cameras to sequentially capture a set of images of a prescribed view of a scene in an imaging studio; and
selectively activating different lighting panels in the imaging studio when sequentially capturing images comprising the set so that images comprising the set comprise different lighting effects;
wherein the set of images is used to at least in part generate an interactive image of the scene comprising a plurality of interactive features modifiable by an end user according to user preferences and wherein the interactive image comprises a two-dimensional image with at least partial three-dimensional capabilities including one or more options for modifying lighting.
21. The system of claim 19 , wherein images comprising the set comprise different shadow effects.
22. The system of claim 19 , wherein the interactive image of the scene comprises one or more options for modifying shadow effects.
23. The system of claim 19 , wherein the one or more cameras are stationary while sequentially capturing the set of images.
24. The system of claim 19 , wherein the one or more cameras comprise a pair of stereo cameras.
25. The system of claim 19 , wherein lighting information is extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
26. The system of claim 25 , wherein lighting extracted from the set of images is blended or mixed to generate virtual lighting with respect to the interactive image.
27. The system of claim 19 , wherein shadows are extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
28. The system of claim 27 , wherein shadows extracted from the set of images are blended or mixed to generate virtual shadows with respect to the interactive image.
29. The system of claim 19 , wherein one or more machine learning based networks facilitate providing virtual lighting and shadow effects with respect to the interactive image.
30. The system of claim 19 , wherein modifying lighting in the interactive image results in a dynamically provided output image with consistent lighting.
31. The system of claim 19 , wherein modifying shadows in the interactive image results in a dynamically provided output image with consistent shadows.
32. The system of claim 19 , wherein modifying a background or an environment of the interactive image results in a dynamically provided output image that appears naturally composed with consistent lighting and shadows.
33. The system of claim 19 , wherein one or more options for modifying lighting comprise a relighting feature with respect to the interactive image.
34. The system of claim 19 , wherein one or more options for modifying lighting comprise a relighting model with respect to the interactive image.
35. The system of claim 19 , wherein one or more options for modifying lighting comprise one or more options for: modifying lights, modifying light positions, and modifying light intensities.
36. The system of claim 19 , wherein one or more options for modifying lighting are provided with respect to a user application for manipulating or modifying the generated interactive image.
37. The system of claim 19 , wherein the imaging studio comprises a known and controlled physical imaging environment.
38. The computer program product of claim 20 , wherein images comprising the set comprise different shadow effects.
39. The computer program product of claim 20 , wherein the interactive image of the scene comprises one or more options for modifying shadow effects.
40. The computer program product of claim 20 , wherein the one or more cameras are stationary while sequentially capturing the set of images.
41. The computer program product of claim 20 , wherein the one or more cameras comprise a pair of stereo cameras.
42. The computer program product of claim 20 , wherein lighting information is extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
43. The computer program product of claim 42 , wherein lighting extracted from the set of images is blended or mixed to generate virtual lighting with respect to the interactive image.
44. The computer program product of claim 20 , wherein shadows are extracted from the set of images using one or more machine learning based networks trained at least in part on training images constrained to a prescribed scene type to which the scene belongs.
45. The computer program product of claim 44 , wherein shadows extracted from the set of images are blended or mixed to generate virtual shadows with respect to the interactive image.
46. The computer program product of claim 20 , wherein one or more machine learning based networks facilitate providing virtual lighting and shadow effects with respect to the interactive image.
47. The computer program product of claim 20 , wherein modifying lighting in the interactive image results in a dynamically provided output image with consistent lighting.
48. The computer program product of claim 20 , wherein modifying shadows in the interactive image results in a dynamically provided output image with consistent shadows.
49. The computer program product of claim 20 , wherein modifying a background or an environment of the interactive image results in a dynamically provided output image that appears naturally composed with consistent lighting and shadows.
50. The computer program product of claim 20 , wherein one or more options for modifying lighting comprise a relighting feature with respect to the interactive image.
51. The computer program product of claim 20 , wherein one or more options for modifying lighting comprise a relighting model with respect to the interactive image.
52. The computer program product of claim 20 , wherein one or more options for modifying lighting comprise one or more options for: modifying lights, modifying light positions, and modifying light intensities.
53. The computer program product of claim 20 , wherein one or more options for modifying lighting are provided with respect to a user application for manipulating or modifying the generated interactive image.
54. The computer program product of claim 20 , wherein the imaging studio comprises a known and controlled physical imaging environment.