Content filtering in media playing devices
Various approaches relate to user defined content filtering in media playing devices of undesirable content represented in stored and real-time content from content providers. For example, video, image, and/or audio data can be analyzed to identify and classify content included in the data using various classification models and object and text recognition approaches. Thereafter, the identification and classification can be used to control presentation and/or access to the content and/or portions of the content. For example, based on the classification, portions of the content can be modified (e.g., replaced, removed, degraded, etc.) using one or more techniques (e.g., media replacement, media removal, media degradation, etc.) and then presented.
1 . A computing system, comprising:
an input buffer;
an output buffer;
a computing device processor; and
a memory device including instructions that, when executed by the computing device processor, enables the computing system to:
obtain media data from the input buffer,
use a neural network filter to identify undesirable content represented in the media data, wherein the neural network performs an autoencoding to generate a feature vector, sets a value of a feature that represents undesirable content to zero, and performs a decoding of the feature vector,
process the media data using the neural network filter to generate filtered media without the undesirable content, wherein the neural network filter performs autoencoding and autodecoding to generate the filtered media, and
store the filtered media to the output buffer.
2 . The computing system of claim 1 , wherein the media data includes video data, and wherein the instructions, when executed by the computing device processor to determine the classification of the content represented in the media data, further enables the computing system to:
determine a keyframe from the video data using at least one video frame selection algorithm;
analyze the keyframe to identify features representative of the content represented in the keyframe;
determine predetermined features that match the features representative of the content; and
determine the classification of the content based on the predetermined features.
3 . The computing system of claim 1 , wherein the neural network filter has at least one convolutional layer and at least one temporally recurrent layer.
4 . The computing system of claim 3 , wherein the neural network filter segments at least one region containing the undesirable content and performs degradation within the at least one region.
5 . The computing system of claim 1 , wherein the neural network filter includes a generative neural network, and wherein the generative neural network predicts replacement data at points that, in the media data, provide features that enable an observer to discern the undesirable content, and wherein the neural network filter segments at least one region containing the undesirable content and predicts the replacement data within the at least one region.
6 . The computing system of claim 1 , wherein the undesirable content is made indiscernible using a media degradation technique.
7 . The computing system of claim 1 , wherein the instructions, when executed by the computing device processor, further enables the computing system to:
obtain restriction preferences associated with a user account; and
classify the content as undesirable based on the restriction preferences.
8 . The computing system of claim 1 , wherein the instructions, when executed by the computing device processor, further enables the computing system to:
determine a location and a size of the undesirable content represented in the media data;
determine a replacement object;
scale the replacement object according to the size of the undesirable content; and
overlay the replacement object at the location of the undesirable content.
9 . The computing system of claim 1 , wherein parameters for the neural network filter are stored within the memory device, and wherein the instructions, when executed by the computing device processor, further enables the computing system to:
obtain updated filter parameters; and
update the neural network filter based on updated filter parameters.
10 . The computing system of claim 1 , wherein the instructions, when executed by the computing device processor, further enables the computing system to:
identify a set of filter parameters embedded with the media data, wherein the media data is filtered based on the set of filter parameters.
11 . A media playing device, comprising:
an input buffer;
an output buffer;
a computing device processor; and
a memory device including instructions that, when executed by the computing device processor, enables the media playing device to:
obtain media data from the input buffer,
use a neural network filter to identify undesirable content represented in the media data, wherein the neural network performs an autoencoding to generate a feature vector, sets a value of a feature that represents undesirable content to zero, and performs a decoding of the feature vector,
process the media data using the neural network filter to generate filtered media without the undesirable content, wherein the neural network filter performs autoencoding and autodecoding to generate the filtered media, and
store the filtered media to the output buffer.
12 . The media playing device of claim 11 , wherein the neural network filter comprises at least one convolutional layer and at least one temporally recurrent layer.
13 . The media playing device of claim 12 , wherein the neural network filter segments at least one region containing the undesirable content and performs degradation within the at least one region.
14 . The media playing device of claim 11 , wherein the neural network filter includes a generative neural network, and wherein the generative neural network predicts replacement data at points that, in the media data, provide features that enable an observer to discern the undesirable content, and wherein the neural network filter segments at least one region containing the undesirable content and predicts the replacement data within the at least one region.
15 . The media playing device of claim 11 , wherein the undesirable content is made indiscernible using a media degradation technique.
16 . The media playing device of claim 11 , wherein the instructions, when executed by the computing device processor, further enables the media playing device to:
obtain restriction preferences associated with a user account; and
classify the content as undesirable based on the restriction preferences.
17 . The media playing device of claim 11 , wherein the instructions, when executed by the computing device processor, further enables the media playing device to:
determine a location and a size of the undesirable content represented in the media data;
determine a replacement object;
scale the replacement object according to the size of the undesirable content; and
overlay the replacement object at the location of the undesirable content.
18 . The media playing device of claim 11 , wherein parameters for the neural network filter are stored within the memory device, and wherein the instructions, when executed by the computing device processor, further enables the media playing device to:
obtain updated filter parameters; and
update the neural network filter based on updated filter parameters.