Method and electronic device for managing privacy of screen view
A method for managing privacy of a screen view on an electronic device is provided. The method includes displaying content on the screen view of an electronic device, where the content includes one or more private objects, determining the upcoming event(s) of a user of the electronic device and an associated user intent to share the displayed content during execution of the at least one upcoming event, determining one or more privacy parameters of the displayed content in relation to the upcoming event(s), and modifying the screen view of the electronic device based on one or more privacy parameters during execution of the upcoming event(s), where the modified screen view exclude some or more private objects which is not essential to execute the upcoming event(s).
1 . A method for managing privacy of a screen view on an electronic device comprising a first display and a second display, the method comprises:
displaying, by the electronic device, a content on the first display of the electronic device, wherein the content comprises a plurality of UI components;
determining, by the electronic device, at least one upcoming event of a user of the electronic device based on a plurality of event parameters of the displayed content, the plurality of event parameters comprising screen context information, time-stamp information, location information, and information associated with currently running application of the electronic device;
determining, by the electronic device, one or more privacy parameters of the displayed content in relation to the at least one upcoming event; and
displaying, by the electronic device, one or more sharing UI component of the plurality of UI components included in the content on the second display based on one or more privacy parameters,
wherein the one or more privacy parameters comprises a region of interest (RoI), and
wherein the RoI is determined by scraping the displayed content to extract the RoI and serializes the extracted RoI based on application content localization.
2 . The method of claim 1 , wherein the determining, by the electronic device, of the at least one upcoming event of the electronic device comprises:
determining, by the electronic device, the plurality of event parameters of the displayed content;
applying, by the electronic device, the plurality of event parameters to a pre-trained on-device machine learning (ML) model to determine the at least one upcoming event in a real-time;
determining, by the electronic device, the at least one upcoming event of the electronic device;
determining, by the electronic device, whether a safe-to-view is compatible for the at least one upcoming event based on the displayed content on the first display of the electronic device, wherein the safe-to-view excludes one or more private objects which is not essential to execute the at least one upcoming event;
displaying, by the electronic device, a notification message on the first display of the electronic device to share the displayed content in response to determining that the safe-to-view is compatible for the at least one upcoming event; and
receiving, by the electronic device, an intent of the user to share the displayed content when the notification message is displayed on the first display of the electronic device.
3 . The method of claim 2 , wherein the at least one upcoming event comprises a payment event, a booking event, a check-in event, a dynamic web-content sharing event, and a screen sharing event.
4 . The method of claim 2 , wherein the intent of the user to share the displayed content is determined based on at least one of a text command received from a user of the electronic device, a voice input received from the user of the electronic device, a touch input received from the user of the electronic device, a gesture input received from the user of the electronic device, changing an orientation of the electronic device, selecting a region on a screen of the electronic device or pressing a hardware key of the electronic device.
5 . The method of claim 1 , wherein the RoI is determined by:
extracting, by the electronic device, at least one region of interest (RoI) of the first display of the electronic device through a segmentation method, wherein the at least one RoI comprises at least one user interface (UI) component.
6 . The method of claim 5 , wherein a sensitivity index is determined by:
determining, by the electronic device, the sensitivity index of each UI component using a pre-trained on-device deep learning classifier, where in the pre- trained on-device deep learning classifier trained using a diverse dataset, and the diverse dataset comprises an intent of the user, a preference of the user, a previous interaction of the user, and screen context information.
7 . The method of claim 6 , wherein event relevancy is determined by:
determining, by the electronic device, an event relevancy score of each UI component using the pre-trained on-device deep learning classifier, wherein the pre-trained on-device deep learning classifier trained using a diverse dataset, and the diverse dataset comprises an intent of the at least one upcoming event, a preference of the user relates to the at least one upcoming event, a previous interaction of the user with the at least one upcoming event, and the screen context information.
8 . The method of claim 1 , wherein the displaying, by the electronic device, of one or more sharing UI component comprises displaying, by the electronic device, one or more sharing UI component on the second display based on a folding style of the electronic device.
9 . An electronic device for managing privacy of a screen view, the electronic device comprising:
a first display and a second display;
at least one processor; and
a memory storing one or more programs configured to be executed by the at least one processor,
the one or more programs including instructions for:
displaying, on the first display, a content comprising a plurality of UI components,
determining at least one upcoming event of a user of the electronic device based on a plurality of event parameters of the displayed content, the plurality of event parameters comprising screen context information, time-stamp information, location information, and information associated with currently running application of the electronic device,
determining one or more privacy parameters of the displayed content in relation to the at least one upcoming event, and
displaying, by the electronic device, one or more sharing UI component of the plurality of UI components included in the content on the second display based on one or more privacy parameters,
wherein the one or more privacy parameters comprises a region of interest (RoI), and
wherein the RoI is determined by scraping the displayed content to extract the RoI and serializes the extracted RoI based on application content localization.
10 . The electronic device of claim 9 , wherein the one or more programs including instructions for:
determining the plurality of event parameters of the displayed content;
applying the plurality of event parameters to a pre-trained on-device machine learning (ML) model to determine the at least one upcoming event in a real-time;
determining the at least one upcoming event of the electronic device;
determining whether a safe-to-view is compatible for the at least one upcoming event based on the displayed content on the first display of the electronic device, wherein the safe-to-view excludes one or more private objects which is not essential to execute the at least one upcoming event;
displaying, on the display, a notification message on the first display of the electronic device to share the displayed content in response to determining that the safe-to-view is compatible for the at least one upcoming event; and
receiving an intent of the user to share the displayed content when the notification message is displayed on the first display of the electronic device.
11 . The electronic device of claim 10 , wherein the at least one upcoming event comprises a payment event, a booking event, a check-in event, a dynamic web-content sharing event, and a screen sharing event.
12 . The electronic device of claim 10 , wherein the intent of the user to share the displayed content is determined based on at least one of a text command received from a user of the electronic device, a voice input received from the user of the electronic device, a touch input received from the user of the electronic device, a gesture input received from the user of the electronic device, changing an orientation of the electronic device, selecting a region on a screen of the electronic device or pressing a hardware key of the electronic device.