Centralized content moderation in live streaming media communication
There is provided a technique of a centralized content moderation in a live streaming media. The technique comprises: periodically providing content evaluation of a sample of a contributing media stream, thereby obtaining a content evaluation (CE) result characterizing the stream, wherein a periodicity of sampling is defined by a sampling rate currently defined for the stream; periodically assigning to the stream a score being a function of the CE result and being indicative of a current compliance level of the stream to the moderation policy, wherein a periodicity of assigning is defined by the sampling rate currently defined for the stream; responsive to a predefined event, calculating a cumulative stream score (CSS) of the stream, wherein the CSS is calculated as a derivative of the scores assigned to the stream during a backward window of a predefined duration; and updating the sampling rate of the stream in accordance with CSS.
1. A method of a centralized content moderation in a live streaming media communication via a streaming platform operatively connected with a plurality of contributing devices transferring contributing media streams to the streaming system, the method comprising:
by a computer:
a. periodically providing a content evaluation of a sample of a given contributing media stream, thereby obtaining a content evaluation (CE) result characterizing the given contributing stream, wherein a periodicity of sampling is defined by a sampling rate currently defined for the given stream;
b. periodically assigning to the given stream a score being a function of the CE result and being indicative of a current compliance level of the given stream to the moderation policy, wherein a periodicity of assigning is defined by the sampling rate currently defined for the given stream;
c. responsive to a predefined event, calculating a cumulative stream score (CSS) of the given stream, wherein the CSS is calculated as a derivative of the scores assigned to the given stream during a backward window of a predefined duration;
d. updating the sampling rate of the given contributing stream in accordance with CSS; and
e. repeating the operations a)-d) in accordance with the updated sampling rate, wherein an initial sampling rate of a new stream associated with an account with higher account score has higher initial sampling rate than an initial sampling rate of a new stream associated with an account with lower account score.
2. The method of claim 1 , wherein the sample includes at least one of: a screenshot of a video stream, a portion of an audio stream and a streaming text.
3. The method of claim 1 , wherein a CE result is informative of at least one of: an event of recognizing an inappropriate content object, a number of the recognized inappropriate objects, categories of the recognized inappropriate objects, severity levels thereof, and a severity level evaluated for the entire sample.
4. The method of claim 1 , wherein the score of the given stream is assigned as a function of also a current score assigned to an account associated with the given stream and indicative of a current compliance level of the account to the moderation policy.
5. The method of claim 1 , wherein the predefined event is constituted by obtaining at least one of: a CE result characterizing the given stream and matching a predefined criterion, a stream score assigning to the given stream and matching a predefined criterion, a 3rd party report related to violation of the moderation policy, and a moderation action with regard to an account associated with the given stream.
6. The method of claim 1 , wherein the predefined duration of the backward window is defined so to guarantee that the window covers, in any given stream, at least one backward event of content evaluation.
7. The method of claim 6 , wherein the predefined duration of the backward window is equal for all contributing streams associated with accounts with the same account score and differs for the contributing streams associated with accounts with different account scores.
8. The method of claim 6 , further comprising using the CSS for updating the account score.
9. The method of claim 1 , further comprising using the calculated CSS for taking a moderation decision.
10. The method of claim 1 , wherein any new stream has the same initial sampling rate.
11. One or more computing devices comprising processors and memory, the one or more computing devices configured, via computer-executable instructions, to perform operations for operating, in a cloud computing environment, a system capable of a centralized content moderation in a live streaming media communication via a streaming platform operatively connected with a plurality of contributing devices transferring contributing media streams to the streaming system, the operations comprising:
a. periodically providing a content evaluation for a sample of a given contributing media stream, thereby obtaining a content evaluation (CE) result characterizing the given contributing stream, wherein a periodicity of sampling is defined by a sampling rate currently defined for the given stream;
b. periodically assigning to the given stream a score being a function of the CE result and being indicative of a current compliance level of the given stream to the moderation policy, wherein a periodicity of assigning is defined by the sampling rate currently defined for the given stream;
c. responsive to a predefined event, calculating a cumulative stream score (CSS) of the given stream, wherein the CSS is calculated as a derivative of the scores assigned to the given stream during a backward window of a predefined duration;
d. updating the sampling rate of the given contributing stream in accordance with CSS; and
e. repeating the operations a)-d) in accordance with the updated sampling rate, wherein an initial sampling rate of a new stream associated with an account with higher account score has higher initial sampling rate than an initial sampling rate of a new stream associated with an account with lower account score.
12. The one or more computing devices of claim 11 , wherein the sample includes at least one of: a screenshot of a video stream, a portion of an audio stream and a streaming text.
13. The one or more computing devices of claim 11 , wherein a CE result is informative of at least one of: an event of recognizing an inappropriate content object, a number of the recognized inappropriate objects, categories of the recognized inappropriate objects, severity levels thereof, and a severity level evaluated for the entire sample.
14. The one or more computing devices of claim 11 , wherein the score of the given stream is assigned as a function of also a current score assigned to an account associated with the given stream and indicative of a current compliance level of the account to the moderation policy.
15. The one or more computing devices of claim 11 , wherein the predefined event is constituted by obtaining at least one of: a CE result characterizing the given stream and matching a predefined criterion, a stream score assigning to the given stream and matching a predefined criterion, a 3rd party report related to violation of the moderation policy, and a moderation action with regard to an account associated with the given stream.
16. The one or more computing devices of claim 11 , wherein the predefined duration of the backward window is defined so to guarantee that the window covers, in any given stream, at least one backward event of content evaluation, wherein the predefined duration of the backward window is equal for all contributing streams associated with accounts with the same account score and differs for the contributing streams associated with accounts with different account scores.
17. The one or more computing devices of claim 11 , wherein any new stream has the same initial sampling rate.
18. A non-transitory computer-readable medium comprising instructions that, when executed by a computing system comprising a memory storing a plurality of program components executable by the computing system, cause the computing system to enable a centralized content moderation in a live streaming media via a streaming platform operatively connected with a plurality of contributing devices transferring contributing media streams to the streaming system to:
a. periodically provide a content evaluation of a sample of a given contributing media stream, thereby obtain a content evaluation (CE) result characterizing the given contributing stream, wherein a periodicity of sampling is defined by a sampling rate currently defined for the given stream;
b. periodically assign to the given stream a score being a function of the CE result and being indicative of a current compliance level of the given stream to the moderation policy, wherein a periodicity of assigning is defined by the sampling rate currently defined for the given stream;
c. responsive to a predefined event, calculate a cumulative stream score (CSS) of the given stream, wherein the CSS is calculated as a derivative of the scores assigned to the given stream during a backward window of a predefined duration;
d. update the sampling rate of the given contributing stream in accordance with CSS; and
e. repeat the operations a)-d) in accordance with the updated sampling rate, wherein an initial sampling rate of a new stream associated with an account with higher account score has higher initial sampling rate than an initial sampling rate of a new stream associated with an account with lower account score.