Method and system for video classification
View Patent ↗Described herein is a method and system for video classification. The method and system can use predetermined color ranges to classify a video block. On a relative basis, a greater number of bits can be allocated to perceptually important video data such as skin. The quantization is adjusted accordingly. Determining relative quantization shifts for macroblocks in a picture prior to video encoding enables a corresponding bit allocation that can improve the tradeoff between perceptual quality and bit rate.
1. A method for video classification, said method comprising:
generating a set of detection metrics for a set of pixels in a video block, wherein a detection metric is based on one or more color components of a pixel by a circuit;
adjusting a quantization parameter for the video block according to the set of detection metrics, wherein generating a set of detection metrics further comprises:
comparing a color component of the pixel to a range associated with a classification type; and
selecting the detection metric based the comparison;
wherein the classification type is a presence of skin in the video block.
2. The method of claim 1 , wherein adjusting a quantization parameter further comprises:
summing the set of detection metrics; and
comparing the sum to a threshold.
3. The method of claim 1 , wherein adjusting a quantization parameter further comprises:
setting a quantization parameter shift value prior to a rate control.
4. The method of claim 3 , wherein a quantization parameter shift value is reduced to allocate a larger number of bits to a portion of a picture when a classification type is associated with perceptual importance.
5. The method of claim 3 , wherein a quantization parameter shift value is increased to allocate a fewer number of bits to a portion of a picture when a classification type is not associated with perceptual importance.
6. A system for video classification in a video encoder, said system comprising:
an integrated circuit for analyzing one or more color values associated with a block of pixels;
a memory for storing a quantization map, wherein the quantization map is adjusted according to the analysis;
a first circuit for assigning a combination of one or more color components of a pixel in said set of pixels to a range associated with a classification type, wherein the classification type is a skin detection; and
a second circuit for setting a detection metric based the comparison.
7. The system of claim 6 , wherein the integrated circuit further comprises:
summing the set of detection metrics; and
comparing the sum to a threshold to declare a detection of the classification type.
8. The system of claim 6 , wherein a value in the quantization map is decreased to allocate a larger number of bits to a portion of a picture when a classification type is associated with perceptual importance.
9. The system of claim 6 , wherein a value in the quantization map is increased to allocate a fewer number of bits to a portion of a picture when a classification type is not associated with perceptual importance.
10. An article of manufacture comprising:
a computer readable medium storing a plurality of execution instructions, wherein the plurality of execution instructions comprises instructions for:
generating a set of detection metrics for a set of pixels in a video block, wherein a detection metric is based on one or more color components of a pixel by a circuit; and
adjusting a quantization parameter for the video block according to the set of detection metrics,
wherein generating a set of detection metrics further comprises:
comparing a color component of the pixel to a range associated with a classification type; and
selecting the detection metric based the comparison;
wherein the classification type is a presence of skin in the video block.
11. The article of manufacture of claim 10 , wherein the plurality of instructions further comprises instructions for:
summing the set of detection metrics; and
comparing the sum to a threshold.
12. The article of manufacture of claim 10 , wherein adjusting a quantization parameter further comprises:
setting a quantization parameter shift value prior to a rate control.
13. The article of manufacture of claim 12 , wherein a quantization parameter shift value is reduced to allocate a larger number of bits to a portion of a picture when a classification type is associated with perceptual importance.
14. The article of manufacture of claim 12 , wherein a quantization parameter shift value is increased to allocate a fewer number of bits to a portion of a picture when a classification type is not associated with perceptual importance.