System for capturing images from applications rendering video to a native platform with a graphics rendering library
A method, system and computer-usable medium are disclosed for capturing an image rendered by a target application. One general aspect includes a computer-implemented method for capturing an image, the method including: intercepting API calls made by a target application to a graphics display driver, where the API calls made to the graphics display driver by the target application are made using a graphics rendering API library; and using the intercepted API calls to construct a copy of a frame buffer of the image, where the copy of the frame buffer is constructed independent of the graphics display driver. Certain embodiments may include corresponding stand-alone and/or network computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform one or more of these actions.
1. A computer-implemented method comprising:
providing an endpoint device with an endpoint agent to establish a protected endpoint, the endpoint agent comprising an image capture module and a risk-adaptive security policy;
acquiring an image using an image acquisition device at the endpoint device;
using a target application executing at the endpoint device to provide API calls to a graphics display driver to render the image acquired by the image acquisition device;
intercepting the API calls made by the target application to the graphics display driver, wherein the API calls are intercepted by the image capture module of the endpoint agent, wherein the API calls made to the graphics display driver by the target application are made using a graphics rendering API library;
using the API calls intercepted by the image capture module to construct a copy of a frame buffer of the image, wherein the copy of the frame buffer is constructed by the image capture module independent of the graphics display driver;
using the copy of the frame buffer of the image to detect an occurrence of a visual hacking incident, wherein the visual hacking incident includes visually collecting confidential information at the endpoint device using the image acquired by the image acquisition device; and
performing a risk-adaptive security operation, the risk-adaptive security operation adaptively responding to mitigate a risk associated with the visual hacking incident based on the risk-adaptive security policy.
2. The computer-implemented method of claim 1 , wherein
the intercepted API calls are obtained using software hooks inserted during runtime of the target application; and,
the software hooks allow the endpoint agent to subscribe to other events occurring at the endpoint device.
3. The computer-implemented method of claim 1 , wherein the intercepted API calls comprise one or more of:
API calls instantiating a frame buffer;
API calls updating a frame buffer; and
API calls swapping a window.
4. The computer-implemented method of claim 1 , wherein
the graphics rendering API library includes one or more of an EGL library, an OpenVG library, or an OpenGL library.
5. The computer-implemented method of claim 1 , wherein the target application comprises one or more of:
a word processing application;
a spreadsheet application;
an image editing application;
a web browser application;
a desktop environment application; and
an image acquisition application.
6. The computer-implemented method of claim 1 , further comprising:
storing the copied frame buffer in memory, wherein the memory is accessible by a security analytics system; and
analyzing the copied frame buffer by the security analytics system to detect potential violations of a security policy.
7. The computer-implemented method of claim 6 , wherein analysis of the copied frame buffer to detect potential violations of the security policy by the security analytics system is initiated in response to one or more of:
access of one or more predetermined images for display by the target application;
acquisition of an image by the image acquisition device at the endpoint device for display by the target application;
access of one or more predetermined files for display by the target application; and
access of one or more predetermined file types for display by the target application.
8. A system comprising:
a processor;
a data bus coupled to the processor; and
a non-transitory, computer-readable storage medium embodying computer program code, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations and comprising instructions executable by the processor and configured for:
providing an endpoint device with an endpoint agent to establish a protected endpoint, the endpoint agent comprising an image capture module and a risk-adaptive security policy;
acquiring an image using an image acquisition device at the endpoint device;
using a target application executing at the endpoint device to provide API calls to a graphics display driver to render the image acquired by the image acquisition device;
intercepting the API calls made by the target application to the graphics display driver, wherein the API calls are intercepted by the image capture module of the endpoint agent, wherein the API calls made to the graphics display driver by the target application are made using a graphics rendering API library;
using the API calls intercepted by the image capture module to construct a copy of a frame buffer of an image, wherein the copy of the frame buffer is constructed by the image capture module independent of the graphics display driver;
using the copy of the frame buffer of the image to detect an occurrence of a visual hacking incident, wherein the visual hacking incident includes visually collecting confidential information at the endpoint device using the image acquired by the image acquisition device; and,
performing a risk-adaptive security operation, the risk-adaptive security operation adaptively responding to mitigate a risk associated with the visual hacking incident based on the risk-adaptive security policy.
9. The system of claim 8 , wherein
the intercepted API calls are obtained using software hooks inserted during runtime of the target application; and,
the software hooks allow the endpoint agent to subscribe to other events occurring at the endpoint device.
10. The system of claim 8 , wherein the intercepted API calls comprise one or more of:
API calls instantiating a frame buffer;
API calls updating a frame buffer; and
API calls swapping a window.
11. The system of claim 8 , wherein
the graphics rendering API library includes one or more of an EGL library, an OpenVG library, or an OpenGL library.
12. The system of claim 8 , wherein the target application comprises one or more of:
a word processing application;
a spreadsheet application;
an image editing application;
a web browser application;
a desktop environment application; and
an image acquisition application.
13. The system of claim 8 , wherein the instructions are further configured for:
storing the copied frame buffer in memory, wherein the memory is accessible by a security analytics system; and
analyzing the copied frame buffer by the security analytics system to detect potential violations of a security policy.
14. The system of claim 13 , wherein analysis of the copied frame buffer to detect potential violations of the security policy by the security analytics system is initiated in response to one or more of:
access of one or more predetermined images for display by the target application;
acquisition of an image by the image acquisition device for display by the target application;
access of one or more predetermined files for display by the target application; and
access of one or more predetermined file types for display by the target application.
15. A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:
providing an endpoint device with an endpoint agent to establish a protected endpoint, the endpoint agent comprising an image capture module and a risk-adaptive security policy;
acquiring an image using an image acquisition device at the endpoint device;
using a target application executing at the endpoint device to provide API calls to a graphics display driver to render the image acquired by the image acquisition device;
intercepting the API calls made by the target application to the graphics display driver, wherein the API calls are intercepted by the image capture module of the endpoint agent, wherein the API calls made to the graphics display driver by the target application are made using a graphics rendering API library;
using the API calls intercepted by the image capture module to construct a copy of a frame buffer of an image, wherein the copy of the frame buffer is constructed by the image capture module independent of the graphics display driver;
using the copy of the frame buffer of the image to detect an occurrence of a visual hacking incident, wherein the visual hacking incident includes visually collecting confidential information at the endpoint device using the image acquired by the image acquisition device; and,
performing a risk-adaptive security operation, the risk-adaptive security operation adaptively responding to mitigate a risk associated with the visual hacking incident based on the risk-adaptive security policy.
16. The non-transitory, computer-readable storage medium of claim 15 , wherein
the intercepted API calls are obtained using software hooks inserted during runtime of the target application; and,
the software hooks allow the endpoint agent to subscribe to other events occurring at the endpoint device.
17. The non-transitory, computer-readable storage medium of claim 15 , wherein the intercepted API calls comprise one or more of:
API calls instantiating a frame buffer;
API calls updating a frame buffer; and
API calls swapping a window.
18. The non-transitory, computer-readable storage medium of claim 15 , wherein
the graphics rendering API library includes one or more of an EGL library, an OpenVG library, or an OpenGL library.
19. The non-transitory, computer-readable storage medium of claim 15 , wherein the instructions are further configured for:
storing the copied frame buffer in memory, wherein the memory is accessible by a security analytics system; and
analyzing the copied frame buffer by the security analytics system to detect potential violations of a security policy.
20. The non-transitory, computer-readable storage medium of claim 19 , wherein analysis of the copied frame buffer to detect potential violations of the security policy by the security analytics system is initiated in response to one or more of:
access of one or more predetermined images for display by the target application;
acquisition of an image by the image acquisition device for display by the target application;
access of one or more predetermined files for display by the target application; and
access of one or more predetermined file types for display by the target application.