Systems, methods, and media for extracting information and a display image from two captured images
Systems, methods, and media for extracting information and a display image from two captured images are provided, in some embodiments, systems for extracting information and a display image from two captured images are provided, the systems comprising: a rolling shutter sensor; and a hardware processor coupled to the rolling shutter sensor that is configured to: cause the rolling shutter sensor to capture two captured images; receive the two captured images; and extract the information, and the display image from the two captured images, wherein the information is represented in the captured images as a flicker pattern.
1. A system for extracting a message and a display image from two captured images, comprising:
a rolling shutter sensor; and
a hardware processor coupled to the rolling shutter sensor that is configured to:
cause the rolling shutter sensor to capture two captured images;
receive the two captured images; and
extract the message and the display image from the two captured images, wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.
2. The system of claim 1 , wherein the hardware processor causes the rolling shutter sensor to capture the two captured images using an exposure bracketing mode.
3. The system of claim 2 , wherein the hardware processor also performs motion compensation on at least one of the two captured images.
4. The system of claim 1 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.
5. The system of claim 1 , wherein the rolling shutter sensor detects phase-shift keying modulated light.
6. The system of claim 1 , wherein the rolling shutter sensor detects binary phase-shift keying modulated light.
7. The system of claim 1 , wherein the rolling shutter sensor detects modulated light in orthogonal frequency division multiplexing signal.
8. The system of claim 1 , wherein the hardware processor detects pilot symbols in the message to synchronize detection of the message with the display source.
9. The system of claim 1 , wherein the hardware processor determines a guard interval to synchronize detection of the message with the display source.
10. A method for extracting a message and a display image from two captured images, comprising:
causing a rolling shutter sensor to capture two captured images using a hardware processor;
receiving the two captured images using the hardware processor; and
extracting the message and the display image from the two captured images using the hardware processor,
wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.
11. The method of claim 10 , wherein the causing the rolling shutter sensor to capture the two captured images uses an exposure bracketing mode.
12. The method of claim 11 , further comprising performing motion compensation on at least one of the two captured images.
13. The method of claim 10 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.
14. The method of claim 10 , further comprising detecting phase-shift keying modulated light.
15. The method of claim 10 , further comprising detecting binary phase-shift keying modulated light.
16. The method of claim 10 , further comprising detecting modulated light in an orthogonal frequency division multiplexing signal.
17. The method of claim 10 , further comprising detecting pilot symbols in the message to synchronize detection of the message with the display source.
18. The method of claim 10 , further comprising determining a guard interval to synchronize detection of the message with the display source.
19. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for extracting a message and a display image from two captured images, the method comprising:
causing a rolling shutter sensor to capture two captured images;
receiving the two captured images; and
extracting the message and the display image from the two captured images, wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.
20. The non-transitory computer-readable medium of claim 19 , wherein the causing the rolling shutter sensor to capture the two captured images uses an exposure bracketing mode.
21. The non-transitory computer-readable medium of claim 20 , wherein the method further comprises performing motion compensation on at least one of the two captured images.
22. The non-transitory computer-readable medium of claim 19 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.
23. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting phase-shift keying modulated light.
24. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting binary phase-shift keying modulated light.
25. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting modulated light in an orthogonal frequency division multiplexing signal.
26. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting pilot symbols in the message to synchronize detection of the message with the display source.
27. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises determining a guard interval to synchronize detection of the message with the display source.