Capture and apply light information for augmented reality
View Patent ↗Systems and methods herein enable adding changing light in a live camera view, an image or a video using a light source that is virtual and that includes an associated lighting profile. The system includes receiving image data of the live camera view. The system determines a first lighting profile associated with the representation of the object. Position information associated with the object is also determined with respect to the camera. The system receives a second lighting profile associated with the light source. The second lighting profile provides at least intensity values and direction information for light projected from the light source. The system determines and applies changes to the first lighting profile to affect a light surrounding the representation of the object using the second lighting profile. The system displays the image data with the changes to the first lighting profile.
1. A system comprising:
a processor;
a screen;
a camera; and
memory including instructions that, when executed by the processor, cause the processor to:
receive image data of a live camera view from the camera, the image data including light information associated with a representation of an object;
apply the light information to determine a first lighting profile associated with the representation of the object;
determine position information associated with the object with respect to the camera;
receive a second lighting profile associated with a light source, the second lighting profile providing at least intensity values and direction information for light projected from the light source, the second lighting profile being previously captured and stored in a database;
determine changes to the first lighting profile to affect a light surrounding the representation of the object using the second lighting profile, wherein the changes affect the light surrounding the representation of the object by changing a portion of the image data that relates to areas surrounding the representation of the object; and
displaying an augmented reality view of the image data on the screen, the augmented reality view including the changes to the first lighting profile.
2. The system of claim 1 , wherein the memory including instructions that, when executed by the processor, further cause the system to:
applying the changes in the augmented reality view based at least in part on applying, to the light surrounding the representation of the object, a lighting, a shading and a glint change.
3. The system of claim 1 , wherein the memory including instructions that, when executed by the processor, further cause the system to:
determine a light type of the light source, the light type being one of a point light source or a non-point light source; and
including the changes in the augmented reality view based at least in part on the light type being the point light source that is different than an alternate changes rendered based on the light type being the non-point light source.
4. The system of claim 1 , wherein the memory including instructions that, when executed by the processor, further cause the system to:
analyzing the light projected from the light source to determine an intensity model, the intensity model including information for the intensity values and the direction information of light paths projected from the light source as relative values that are relative to the camera.
5. A computer-implemented method, comprising:
determining a first lighting profile associated with a representation of an object and position information for the object relative to a reference point;
receiving a second lighting profile for a light source, the second lighting profile providing at least intensity values and direction information for light projected from the light source;
determining changes to the first lighting profile to affect a light surrounding the representation of the object based in part on the second lighting profile; and
displaying an augmented reality view of the representation of the object that includes the changes to the first lighting profile.
6. The computer-implemented method of claim 5 , wherein the first lighting profile is received from a live camera view of the object, and wherein the second lighting profile is received from one or more stored versions of the light source captured in different ambient lighting environments.
7. The computer-implemented method of claim 5 , further comprising:
providing the augmented reality view of the representation of the object and the representation of the object for comparative display.
8. The computer-implemented method of claim 5 , further comprising:
capturing image data using an image capture element at the reference point, the image data including one of video data or an image.
9. The computer-implemented method of claim 5 , wherein the changes include at least one of lighting, shading, and glint changes.
10. The computer-implemented method of claim 5 , wherein the light source is selected from a plurality of light sources, individual light sources of the plurality of light sources comprising different third lighting profiles that will differently change the first lighting profile than the second lighting profile.
11. The computer-implemented method of claim 5 , wherein the image is part of an augmented reality view from the image capture element.
12. The computer-implemented method of claim 5 , wherein the providing of the augmented reality view of the representation of the object is for display as part of an electronic marketplace application.
13. The computer-implemented method of claim 5 , wherein the first lighting profile and the second lighting profile include information for at least one of: directions of light, colors of light, intensities of light, sources of light, and luminous flux of light.
14. The computer-implemented method of claim 5 , wherein the determining of the first lighting profile is from the object at a time of capture of the representation of the object, and wherein the receiving of the second lighting profile is from a database comprising information for the light source.
15. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to:
determine a first lighting profile for a representation of an object and position information for the object relative to an image capture element;
receive a second lighting profile for a light source, the second lighting profile providing at least intensity values and direction information for light projected from the light source;
determine changes to the first lighting profile to affect a light surrounding the representation of the object based in part on the second lighting profile; and
display an augmented reality view of the representation of the object that includes the changes to the first lighting profile.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the first lighting profile is based at least in part on first ambient lighting environment surrounding the object at a time of capture of the representation of the object, and wherein the second lighting profile is based at least in part on (a) one or more stored images of the light source captured in second ambient lighting environments and (b) one or more object positions relative to the image capture element for the object.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions when executed further cause the processor to:
save the representation of the object as an original version and the augmented reality view of the representation of the object as an augmented version; and
display the original version and the augmented version, either concurrently or separately.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions when executed further cause the processor to: provide the augmented reality view of the representation of the object and the representation of the object for comparative display.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the changes to the first lighting profile include at least one of lighting, shading, and glint changes.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the augmented reality view of the representation of the object is provided for display as part of an electronic marketplace application.