Methods and systems for data feature extraction
There is provided systems and methods for data feature extraction based on feedback from a network. The system may be used generally to enable feature-specific network operations, including one or more of access control, data compression and selective encryption. Further, embodiments provide methods and systems for data compression based on feature similarity and may include privacy protection.
1 . A system for feature extraction, the system comprising a feature extraction router and a feature validation center, wherein each of the feature extraction router and the feature validation center have one or more associated memories storing instructions, wherein execution of the instructions by one or more associated processors results in:
the feature extraction router being configured to:
receive a request for feature extraction from a data consumer;
extract a data feature in response to the request; and
send the data feature to the feature validation center; and
the feature validation center being configured to:
determine whether the data feature belongs to a feature set, wherein the feature set includes existing data features provided by a third party off-line;
upon determination that the data feature does not belong to the feature set, generate a feedback which indicates potential data features, wherein the potential data features are associated with the data feature and the existing data features and send the feedback to the feature extraction router to re-extract a new data feature; and
upon determination that the data feature belongs to the feature set, trigger feature-enabled network operations at least in part based on a set of valid data features, the set of valid data features is associated with the feature set and the data feature.
2 . The system of claim 1 , wherein when determining whether the data feature belongs to the feature set, the feature validation center is further configured to:
calculate a feature similarity between the data feature and the existing data features, the feature similarity indicative of a level of similarity; and
upon determination that the feature similarity exceeds a threshold, determine the data feature belongs to the feature set.
3 . The system of claim 1 , wherein the feature extraction router is further configured to:
receive the feedback; and
re-extract the new data feature with respect to the feedback.
4 . The system of claim 1 , wherein the set of valid data features includes at least one of:
a list of features IDs with respective feature similarity; and
a privacy indication of whether sensitive data protection, whereas the privacy indication is generated by the feature validation center.
5 . The system of claim 1 , wherein the system further comprises a function configured to implement feature-enabled network operations, the feature validation center triggering the function by sending the set of valid data features to the function.
6 . The system of claim 5 , wherein the function is a compression controller, the compression controller being configured to:
determine a compression solution based on at least one of an input, compression performances of existing compression solutions, and an indication from a data consumer;
wherein the input includes the set of valid data features; and
wherein the indication is indicative of whether, upon decompression, data meets necessary service requirements.
7 . The system of claim 6 , wherein the compression controller is further configured to:
compress data based on the compression solution to obtain compressed data and send the compressed data to the data consumer; and
wherein to obtain the data from the compressed data, decompression is performed by the data consumer.
8 . A method for feature extraction, the method comprising:
receiving, by a feature extraction router, a request for feature extraction from a data consumer;
extracting, by the feature extraction router, a data feature in response to the request;
determining, by the feature validation center, whether the data feature belongs to a feature set, wherein the feature set includes existing data features provided by a third party off-line;
upon determination that the data feature does not belong to the feature set, generating, by the feature validation center, feedback which indicates potential data features, wherein the potential data features are identified from or associated with the data feature and the existing data features and sending, by the feature validation center, the feedback to the feature extraction router to re-extract a new data feature; and
upon determination that the data feature belongs to the feature set, triggering, by the feature validation center, feature-enabled network operations at least in part based on a set of valid data features, the set of valid data features associated with the feature set and the data feature.
9 . The method of claim 8 , wherein when determining whether the data feature belongs to the feature set, the method further comprises:
calculating, by the feature validation center, a feature similarity between the data feature and the existing data features, the feature similarity indicative of a level of similarity; and
upon determination that the feature similarity exceeds a threshold, determining, by the feature validation center, the data feature belongs to the feature set.
10 . The method of claim 8 , wherein the method further includes:
receiving, by the feature extraction router, the feedback; and
re-extracting, by the feature extraction router, the new data feature with respect to the feedback.
11 . The method of claim 8 , wherein the set of valid data features includes at least one of:
a list of features IDs with respective feature similarity; and
a privacy indication of whether sensitive data protection, whereas the privacy indication is generated by the feature validation center.
12 . The method of claim 8 , wherein the method further comprises triggering, by the feature validation center, a function configured to implement feature-enabled network operations by sending the set of valid data features to the function.
13 . The method of claim 12 , wherein the function is configured as a compression controller, the method further comprising:
determining, by the compression controller, a compression solution based on at least one of an input, compression performances of existing compression solutions, and an indication from a data consumer;
wherein the input includes the set of valid data features; and
wherein the indication is indicative of whether, upon decompression, data meets necessary service requirements.
14 . The method of claim 13 , further comprising:
compressing, by the compression controller, data based on the compression solution to obtain compressed data and send the compressed data to the data consumer; and
wherein to obtain the data from the compressed data, decompression is performed by the data consumer.
15 . A method for data feature validation, the method comprising operations performed by a feature validation center and a feature extraction router, wherein each of the feature validation center and the feature extraction router includes one or more associated memories storing instructions, wherein execution of the instructions by one or more associated processors result in:
receiving, by the feature validation center, a data feature from the feature extraction router;
determining, by the feature validation center, whether the data feature belongs to a feature set, wherein the feature set includes existing data features provided by a third party off-line;
upon determination that the data feature does not belong to the feature set, generating, by the feature validation center, feedback which indicates potential data features, wherein the potential data features are identified from or associated with the data feature and the existing data features and sending, by the feature validation center, the feedback to the feature extraction router to re-extract a new data feature; and
upon determination that the data feature belongs to the feature set, triggering, by the feature validation center, feature-enabled network operations at least in part based on a set of valid data features, the set of valid data features is associated with the feature set.
16 . The method of claim 15 , when determining, by the feature validation center, whether the data feature belongs to the feature set, the feature validation center is further configured to:
calculate, by the feature validation center, a feature similarity between the data feature and the existing data features, the feature similarity indicative of a level of similarity; and
upon determination that the feature similarity exceeds a threshold, determine, by the feature validation center, the data feature belongs to the feature set.
17 . The method of claim 15 , wherein the set of valid data features includes at least one of:
a list of features IDs with respective feature similarity; and
a privacy indication of whether sensitive data protection, whereas the privacy indication is generated by the feature validation center.
18 . A device for data feature validation, the device comprising one or more associated memories storing instructions and one or more associated processors, wherein execution of the instructions by one or more associated processors results in:
a transceiver module being configured to receive a data feature from a feature extraction router;
a processing module being configured to determine whether the data feature belongs to a feature set, wherein the feature set includes existing data features provided by a third party off-line, wherein
upon determination that the data feature does not belong to the feature set, generate, by the processing module, feedback which indicates potential data features, wherein the potential data features are identified from or associated with the data feature and the existing data features and send, by the transceiver module, the feedback to the feature extraction router to re-extract a new data feature; and
upon determination that the data feature belongs to the feature set, trigger, by the processing module, feature-enabled network operations at least in part based on a set of valid data features, the set of valid data features being associated with the feature set and the data feature.
19 . The device of claim 18 , wherein the processing module, configured to calculate a feature similarity between the data feature and the existing data features, the feature similarity indicative of a level of similarity;
upon determination that the feature similarity exceeds a threshold, the processing module, configured to determine the data feature belongs to the feature set.
20 . The device of claim 18 , wherein the set of valid data features includes at least one of:
a list of features IDs with respective feature similarity;
a privacy indication of whether sensitive data protection, whereas the privacy indication is generated by the processing module.