Image compensation using image enhancement effects
There are provided systems and methods for performing image compensation using image enhancement effects. In one implementation, such a system includes a computing platform having a hardware processor and a memory storing an image compensation software code. The hardware processor is configured to execute the image compensation software code to receive image data corresponding to an event being viewed by a viewer in a venue, the image data obtained by a wearable augmented reality (AR) device worn by the viewer, and to detect a deficiency in an image included in the image data. The hardware processor is further configured to execute the image compensation software code to generate one or more image enhancement effect(s) for compensating for the deficiency in the image and to output the image enhancement effect(s) for rendering on a display of the wearable AR device while the viewer is viewing the event.
1. A system comprising:
a computing platform including a hardware processor and a memory storing an image compensation software code;
wherein the hardware processor is configured to execute the image compensation software code to:
receive a first image data corresponding to an event being viewed by a viewer in a venue, the first image data obtained by a wearable augmented reality (AR) device worn by the viewer;
compare the first image data with a second image data including at least one structural feature of a model of the venue;
detect a portion of the event is degraded or obstructed for viewing by the viewer, based on comparing the first image data with the second image data including the at least one structural feature of the model of the venue;
generate an AR image based on the portion of the event that is degraded or obstructed for viewing by the viewer; and
output the AR image for rendering on a display of the wearable AR device while the viewer is viewing the event.
2. The system of claim 1 , wherein, to detect the portion of the event that is degraded or obstructed for viewing by the viewer, the hardware processor is further configured to execute the image compensation software code to:
select a random set of first pixels from the first image data;
perform a correspondence process between the random set of first pixels and second pixels from the second image data; and
determine outliers of the correspondence process to detect the portion of the event that is degraded or obstructed for viewing by the viewer.
3. The system of claim 2 , wherein the hardware processor is further configured to execute the image compensation software code to:
generate, based on the correspondence process, a per-pixel lookup table matching the second pixels of the second image data to the first pixels in the first image data; and
determine, using the per-pixel lookup table, one or more pixels present in the second image data but missing from the first image data;
wherein the AR image is generated based on the one or more pixels.
4. The system of claim 1 , wherein the hardware processor is further configured to execute the image compensation software code to receive the first image data and to output the AR image in real-time with respect to a presentation of the event.
5. The system of claim 1 , wherein the event is a pre-recorded event.
6. The system of claim 1 , wherein the event is a live event and the first image data is a live image obtained during the live event.
7. The system of claim 1 , wherein the system is integrated with the wearable AR device, and wherein the hardware processor is further configured to execute the image compensation software code to render the AR image on the display.
8. The system of claim 1 , wherein the wearable AR device comprises AR glasses, AR goggles, or an AR headset.
9. The system of claim 1 , wherein the model of the venue is a three-dimensional (3D) model obtained from a venue model library.
10. The system of claim 1 , wherein the AR image masks the portion of the event that is degraded or obstructed so as to substantially match the first image with the second image.
11. A method for use by a system including a computing platform having a hardware processor and a memory storing an image compensation software code, the method comprising:
receiving, by the image compensation software code executed by the hardware processor, a first image data corresponding to an event being viewed by a viewer in a venue, the first image data obtained by a wearable augmented reality (AR) device worn by the viewer;
comparing, by the image compensation software code executed by the hardware processor, the first image data with a second image data including at least one structural feature of a model of the venue;
detecting, by the image compensation software code executed by the hardware processor, a portion of the event is degraded or obstructed for viewing by the viewer, based on comparing the first image data with the second image data including the at least one structural feature of the model of the venue;
generating, by the image compensation software code executed by the hardware processor, an AR image based on the portion of the event that is degraded or obstructed for viewing by the viewer; and
outputting, by the image compensation software code executed by the hardware processor, the AR image for rendering on a display of the wearable AR device while the viewer is viewing the event.
12. The method of claim 11 , wherein detecting the portion of the event that is degraded or obstructed for viewing by the viewer comprises:
selecting, by the image compensation software code executed by the hardware processor, a random set of first pixels from the first image data;
performing, by the image compensation software code executed by the hardware processor, a correspondence process between the random set of first pixels and second pixels from the second image data; and
determining, by the image compensation software code executed by the hardware processor, outliers of the correspondence process to detect the portion of the event that is degraded or obstructed for viewing by the viewer.
13. The method of claim 12 , further comprising:
generating, based on the correspondence process, by the image compensation software code executed by the hardware processor, a per-pixel lookup table matching the second pixels of the second image data to the first pixels in the first image data; and
determining, using the per-pixel lookup table, by the image compensation software code executed by the hardware processor, one or more pixels present in the second image data but missing from the first image data;
wherein the AR image is generated based on the one or more pixels.
14. The method of claim 11 , wherein receiving the first image data and to output the AR image in real-time with respect to a presentation of the event.
15. The method of claim 11 , wherein the event is a pre-recorded event.
16. The method of claim 11 , wherein the event is a live event and the first image data is a live image obtained during the live event.
17. The method of claim 11 , wherein the system is integrated with the wearable AR device, the method further comprising rendering, by the image compensation software code executed by the hardware processor, the AR image on the display.
18. The method of claim 11 , wherein the wearable AR device is AR glasses, AR goggles, or an AR headset.
19. The method of claim 11 , wherein the model of the venue is a three-dimensional (3D) model obtained from a venue model library.
20. The method of claim 11 , wherein the AR image masks the portion of the event that is degraded or obstructed so as to substantially match the first image with the second image.