Systems and methods for accurate and efficient scene illumination from different perspectives
A sensor sphere may measure light and/or other properties of an environment from a multitude of angles and/or perspectives. A rendering system may obtain measurements that the sensor sphere generates as a result of measuring light in the environment from a common position and the multitude of angles and/or perspectives. The rendering system may receive image(s) that capture the environment from a first perspective, may determine a first set of the measurements that measure the lighting from the first perspective, may determine a second set of the measurements that measure the lighting from a different second perspective, may illuminate the environment from the second perspective by adjusting the lighting of the environment according to a difference between the second set of measurements and the first set of measurements, and may render the environment from the second perspective with the adjusted lighting.
1. A device comprising:
a spherical housing;
a plurality of sensors distributed across the spherical housing with each sensor of the plurality of sensors oriented at a different angle or direction, each particular sensor of the plurality of sensors generating one or more values that measure lighting in a three-dimensional (“3D”) environment from the different angle or direction of that particular sensor in response to activation of that particular sensor;
a plurality of tubes extending over the plurality of sensors, wherein each tube of the plurality of tubes comprises a hollowed covering that extends over a different sensor of the plurality of sensors in the angle or direction of that sensor; and
one or more processors configured to:
receive the one or more values generated by each sensor of the plurality of sensors;
tag the one or more values from each sensor with an identifier that indicates the different angle or direction of the sensor generating the one or more values; and
produce a direct mapping of the lighting that was used to illuminate the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
2. The device of claim 1 , wherein each tube is adapted to focus light in the angle or direction of a sensor onto that sensor.
3. The device of claim 1 further comprising:
an orientation sensor that detects one or more of a rotation, tilt, or orientation of the device.
4. The device of claim 3 , wherein the one or more processors are further configured to:
determine the identifier that is tagged to the one or more values from a particular sensor based on a default angle or direction of the particular sensor adjusted according to one or more of the rotation, tilt, or orientation of the device detected using the orientation sensor.
5. The device of claim 3 , wherein the orientation sensor comprises one of a compass, accelerometer, or inertial sensor.
6. The device of claim 1 , wherein each sensor of the plurality of sensors comprises a Charge-Coupled Device (“CCD”), Complementary Metal-Oxide-Semiconductor (“CMOS”), photodiode, or photosite.
7. The device of claim 1 , wherein the one or more values generated by a particular sensor comprise one or more measurements of luminance, color, reflectivity, contrast, hue, and saturation.
8. The device of claim 1 , wherein the one or more processors are further configured to:
receive different sets of values as different sets of the plurality of sensors rotate in front of a light source;
determine variance in the different sets of values from the different sets of sensors; and
calibrate the plurality of sensors based on the determined variance.
9. The device of claim 1 , wherein the one or more processors are further configured to:
detect a number of light sources and a position of each light source in the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
10. The device of claim 9 further comprising:
a plurality of visual indicators distributed about the spherical housing; and
wherein the one or more processors are further configured to:
activate a particular visual indicator of the plurality of visual indicators directed towards the position of a previously detected light source, wherein activating the particular visual indicator comprises visually marking the position of the previously detected light source in the 3D environment.
11. The device of claim 1 , wherein producing the direct mapping of the lighting comprises:
determining different properties of the lighting reaching different points in the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
12. The device of claim 1 , wherein producing the direct mapping of the lighting comprises:
generating a 360-degree capture of the lighting illuminating the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
13. A method comprising:
measuring light in a three-dimensional (“3D”) environment from a plurality of different angles or directions using a plurality of sensors that are distributed across a spherical device;
detecting one or more of a rotation, tilt, or orientation of the spherical device;
generating one or more values by each sensor of the plurality of sensors for the light measured by that sensor;
tagging the one or more values from each sensor with an identifier that indicates the different angle or direction of the sensor generating the one or more values, wherein tagging the one or more values comprises determining the identifier that is tagged to the one or more values from a particular sensor based on a default angle or direction of the particular sensor adjusted according to one or more of the rotation, tilt, or orientation of the spherical device; and
producing a direct mapping of the light that was used to illuminate the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
14. The method of claim 13 further comprising:
receiving different sets of values as different sets of the plurality of sensors rotate in front of a light source;
determining variance in the different sets of values from the different sets of sensors; and
calibrating the plurality of sensors based on the determined variance.
15. The method of claim 13 further comprising:
detecting a number of light sources and a position of each light source in the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
16. The method of claim 13 , wherein producing the direct mapping of the light comprises:
determining different properties of the light reaching different points in the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
17. The method of claim 13 , wherein producing the direct mapping of the light comprises:
generating a 360-degree capture of the light illuminating the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
18. A device comprising:
a spherical housing;
a plurality of sensors distributed across the spherical housing with each sensor of the plurality of sensors oriented at a different angle or direction, each particular sensor of the plurality of sensors generating one or more values that measure lighting in a three-dimensional (“3D”) environment from the different angle or direction of that particular sensor in response to activation of that particular sensor;
an orientation sensor that detects one or more of a rotation, tilt, or orientation of the device; and
one or more processors configured to:
receive the one or more values generated by each sensor of the plurality of sensors;
tag the one or more values from each sensor with an identifier that indicates the different angle or direction of the sensor generating the one or more values; and
produce a direct mapping of the lighting that was used to illuminate the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier.
19. A device comprising:
a spherical housing;
a plurality of sensors distributed across the spherical housing with each sensor of the plurality of sensors oriented at a different angle or direction, each particular sensor of the plurality of sensors generating one or more values that measure lighting in a three-dimensional (“3D”) environment from the different angle or direction of that particular sensor in response to activation of that particular sensor;
a plurality of visual indicators distributed about the spherical housing; and
one or more processors configured to:
receive the one or more values generated by each sensor of the plurality of sensors;
tag the one or more values from each sensor with an identifier that indicates the different angle or direction of the sensor generating the one or more values;
produce a direct mapping of the lighting that was used to illuminate the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier, wherein producing the direct mapping comprises detecting one or more of a number of light sources and a position of each light source in the 3D environment; and
activate a particular visual indicator of the plurality of visual indicators directed towards the position of a detected light source, wherein activating the particular visual indicator comprises visually marking the position of the detected light source in the 3D environment.
20. A method comprising:
measuring light in a three-dimensional (“3D”) environment from a plurality of different angles or directions using a plurality of sensors that are distributed across a spherical device;
generating one or more values by each sensor of the plurality of sensors for the light measured by that sensor;
tagging the one or more values from each sensor with an identifier that indicates the different angle or direction of the sensor generating the one or more values;
producing a direct mapping of the light that was used to illuminate the 3D environment based on the one or more values from the plurality of sensors tagged with the identifier;
receiving different sets of values as different sets of the plurality of sensors rotate in front of a light source;
determining variance in the different sets of values from the different sets of sensors; and
calibrating the plurality of sensors based on the determined variance.