Classification apparatus for sport videos and method thereof
The present invention intends to provide a classification apparatus for broadcasted sport videos for classifying various scenes constituting a sport video, depending on the importance level without being limited to any particular sport video by using visual and audio features. A sport video classification processing portion determines and classifies a play scene, a close-up shot and the like using an audio and a color feature extracted from motion picture data. Because the determination of the most frequent color can be changed adaptively for each inputted sport video, it is not necessary to determine any particular color to the most frequent color previously.
1. A classification method for broadcasted sport videos in which the sport video is a soccer video that is captured by a camera, comprising: determining whether motion activity in a shot captured by the camera exceeds a first predetermined threshold value; setting an indicator that the shot is a candidate for a close-up shot in response to determining that the motion activity in the shot exceeds the first predetermined threshold value; determining a most frequent color in the shot in response to determining that the motion activity in the shot does not exceed the first predetermined threshold value; setting an indicator that the shot is a candidate for the close-up shot in response to determining that a number of pixels corresponding to the most frequent color in the shot is smaller than a second predetermined threshold value; determining whether energy indicating a characteristic of applause detected by an audio information analyzing portion is larger than a third predetermined threshold value; determining that the shot is a shot or scene of a goal or shoot in response to determining that the detected energy indicating the characteristic of the applause is larger than the third predetermined threshold value; determining whether energy indicating a characteristic of a whistle is larger than a fourth predetermined threshold value in response to determining that the detected energy indicating the characteristic of the applause is not larger than the third predetermined threshold value; determining that the shot is a shot of a free kick or offside in response to determining that the energy indicating the characteristic of the whistle is larger than the fourth predetermined threshold value; determining whether motion activity between adjoining two shots is larger than a fifth predetermined threshold value in response to determining that the energy indicating the characteristic of the whistle is not larger than the fourth predetermined threshold value; determining the shot to be in a corner kick scene in response to determining that the difference in motion activity between the adjoining two shots is larger than the fifth predetermined threshold value; determining whether the indicator indicates that the shot is the candidate for the close-up shot in response to determining that the difference in motion activity between the adjoining two shots is not larger than the fifth predetermined threshold value; determining that the shot is the close up shot in response to determining that the indicator indicates that the shot is the candidate for a close-up shot; and determining that the shot is a shot of a play scene in response to determining that the indicator indicates that the shot is not the candidate for a close-up shot.