Training a non-reference video scoring system with full reference video scores

1. A tangible non-transitory computer readable storage media impressed with computer program instructions that, when executed on a processor, cause the processor to implement a method of training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, the method including:

generating synthetically impaired images selected from a series of scenes in a full reference (abbreviated FR) video, using filters tuned to generate impaired versions of unimpaired FR images from the FR video;

applying a FR video mean opinion score (abbreviated FR VMOS) generator to pairs of the unimpaired FR images and the impaired versions of the FR images to create ground truth scores for the impaired versions;

training by CNN machine learning model an image evaluation classifier using individual ground truth scores and corresponding impaired versions to generate NR VMOS scores for the series of scenes; and

storing coefficients of the image evaluation classifier for use as the NR VMOS score generator.

2. The tangible non-transitory computer readable storage media of claim 1 , wherein:

the filters tuned to generate impaired versions from the FR video approximate effects of constrained video delivery bandwidth.

3. The tangible non-transitory computer readable storage media of claim 1 , further including generating 50,000 to 10,000,000 synthetically impaired images for use in the applying and the training.

4. The tangible non-transitory computer readable storage media of claim 1 , further including generating 100,000 to 1,000,000 synthetically impaired images for use in the applying and the training.

5. The tangible non-transitory computer readable storage media of claim 1 , wherein the machine learning model is a support vector machine (abbreviated SVM) model.

6. The tangible non-transitory computer readable storage media of claim 1 , wherein the machine learning model is a convolutional neural network (abbreviated CNN) model.

7. A computer-implemented method for training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, including executing on a processor the program instructions from the non-transitory computer readable storage media of claim 1 , to implement the generating, applying, training and storing.

8. A computer-implemented method for training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, including executing on a processor the program instructions from the non-transitory computer readable storage media of claim 2 , to implement the generating, applying, training and storing.

9. A computer-implemented method for training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, including executing on a processor the program instructions from the non-transitory computer readable storage media of claim 5 , to implement the generating, applying, training and storing.

10. A computer-implemented method for training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, including executing on a processor the program instructions from the non-transitory computer readable storage media of claim 6 , to implement the generating, applying, training and storing.

11. A system for training a no-reference video mean opinion score (abbreviated NR VMOS) score generator, the system including a processor, memory coupled to the processor, and computer instructions from the non-transitory computer readable storage media of claim 1 loaded into the memory.

12. The system of claim 11 , wherein:

the filters tuned to generate impaired versions from the FR video approximate effects of constrained video delivery bandwidth.

13. The system of claim 11 , wherein the machine learning model is a support vector machine (abbreviated SVM) model.

14. The system of claim 11 , wherein the machine learning model is a convolutional neural network (abbreviated CNN) model.

15. A tangible non-transitory computer readable storage media impressed with computer program instructions that, when executed a processor, cause the processor to implement a method of generating a no-reference video mean opinion score (abbreviated NR VMOS) using a trained NR VMOS score generator, the method including:

invoking the trained NR VMOS score generator that includes stored coefficients generated by training an image evaluation classifier using individual ground truth scores generated by a full reference (FR) VMOS evaluation system applied to corresponding synthetically impaired versions of reference images from series of scenes in video sequences;

feeding the trained NR VMOS score generator with a series of at least three images captured from different scenes in a video sequence to be scored;

evaluating the series of at least three images to generate NR VMOS scores; and

combining the NR VMOS scores from the least three images to generate a sequence NR VMOS score for the video sequence.

16. The tangible non-transitory computer readable storage media of claim 15 , wherein the at least three images are separated by at least three seconds of video sequence between respective images.

17. The tangible non-transitory computer readable storage media of claim 15 , wherein the sequence NR VMOS score for the video sequence satisfies a predetermined correlation with standards-based FR VMOS scores.

18. A system for generating a no-reference video mean opinion score (abbreviated NR VMOS) using a trained NR VMOS score generator, the system including a processor, memory coupled to the processor, and computer instructions from the non-transitory computer readable storage media of claim 15 loaded into the memory.

19. A computer-implemented method for generating a no-reference video mean opinion score (abbreviated NR VMOS) using a trained NR VMOS score generator, including executing on a processor the program instructions from the non-transitory computer readable storage media of claim 15 .