System and method for automatically capturing and replaying images, and non-transitory computer readable storage medium
A system and method for automatically capturing and replaying images. The method is applied to the system to automatically capture and replay an image of a sporting motion. The system includes a signal sensing device installed at a handheld sport equipment for sensing a sporting motion of the player holding the handheld sport equipment so as to output a sensing signal. The method includes steps of: capturing a sporting video of the sporting motion of the player holding the handheld sport equipment by an image capturing device; identifying a strike motion conforming to a specific strike from the sensing signal by an electronic device; automatically extracting a swing image corresponding to the strike motion from the sporting video captured by the image capturing device by the electronic device; and playing the swing image.
1 . A system for automatically capturing and replaying images, which is applied to automatically capture and replay an image of a sporting motion of a player holding a handheld sport equipment, comprising:
an inertial signal sensing device installed at a handle or a club head of the handheld sport equipment for sensing the sporting motion of the player holding the handheld sport equipment so as to output an inertial sensing signal;
an image capturing device capturing a sporting video of the sporting motion of the player holding the handheld sport equipment; and
an electronic device individually coupled to the inertial signal sensing device and the image capturing device, wherein the electronic device comprises one or more processing units and a memory unit, the one or more processing units are coupled to the memory unit, the memory unit stores one or more instructions, and the one or more processing units perform, when executing the one or more instructions, following processes:
a first process: identifying a strike motion conforming to a user-specified specific strike from the inertial sensing signal;
a second process: automatically extracting a swing image corresponding to the strike motion conforming to the user-specified specific strike from the sporting video captured by the image capturing device; and
a third process: playing the swing image corresponding to the user-specified specific strike.
2 . The system of claim 1 , the one or more processing units adopts a strike-motion identifying algorism to identify the strike motion from the inertial sensing signal, and the strike-motion identifying algorism comprises a motion signal segmentation step, a signal normalization step, a CNN (convolutional neural network) classification step, and a strike-motion identification step.
3 . The system of claim 1 , wherein the strike motion comprises a forehand long serve, a backhand short serve, a forehand high clear, a backhand high clear, a forehand net lift, a backhand net lift, a forehand net shot, a backhand net shot, a forehand drive, a backhand drive, a forehand net block, a backhand net block, a forehand slow drop shot, a forehand high and long shot, a forehand smash, or a forehand push.
4 . The system of claim 1 , further comprising:
a player device coupled to the electronic device, wherein the swing image is played by the player device.
5 . The system of claim 1 , wherein the one or more processing units further perform:
a fourth process: calculating a parameter of the strike motion from the inertial sensing signal and displaying the parameter.
6 . A method for automatically capturing and replaying images, which is applied to a system for automatically capturing and replaying images to automatically capture and replay an image of a sporting motion of a player holding a handheld sport equipment, the system comprising an inertial signal sensing device, an image capturing device and an electronic device, the inertial signal sensing device being installed at a handle or a club head of the handheld sport equipment for sensing the sporting motion of the player holding the handheld sport equipment so as to output an inertial sensing signal, and the electronic device being individually coupled to the inertial signal sensing device and the image capturing device, the method comprising:
the image capturing device capturing a sporting video of the sporting motion of the player holding the handheld sport equipment;
the electronic device identifying a strike motion conforming to a user-specified specific strike from the inertial sensing signal;
the electronic device automatically extracting a swing image corresponding to the strike motion conforming to the user-specified specific strike from the sporting video captured by the image capturing device; and
playing the swing image corresponding to the user-specified specific strike.
7 . The method of claim 6 , wherein the electronic device adopts a strike-motion identifying algorism to identify the strike motion from the inertial sensing signal, and the strike-motion identifying algorism comprises a motion signal segmentation step, a signal normalization step, a CNN classification step, and a strike-motion identification step.
8 . The method of claim 6 , wherein the strike motion comprises a forehand long serve, a backhand short serve, a forehand high clear, a backhand high clear, a forehand net lift, a backhand net lift, a forehand net shot, a backhand net shot, a forehand drive, a backhand drive, a forehand net block, a backhand net block, a forehand slow drop shot, a forehand high and long shot, a forehand smash, or a forehand push.
9 . The method of claim 6 , wherein the system further comprises a player device coupled to the electronic device, and the swing image is played by the player device.
10 . The method of claim 6 , further comprising:
the electronic device calculating a parameter of the strike motion from the inertial sensing signal and displaying the parameter.
11 . A non-transitory computer readable storage medium storing an application software, an electronic device loading and executing the application software to perform a method for automatically capturing and replaying images, the method being applied to a system for automatically capturing and replaying images to automatically capture and replay an image of a sporting motion of a player holding a handheld sport equipment, the system comprising an inertial signal sensing device, an image capturing device and the electronic device, the inertial signal sensing device being installed at a handle or a club head of the handheld sport equipment for sensing the sporting motion of the player holding the handheld sport equipment so as to output an inertial sensing signal, the electronic device being individually coupled to the inertial signal sensing device and the image capturing device, and the method comprising:
the image capturing device capturing a sporting video of the sporting motion of the player holding the handheld sport equipment;
the electronic device identifying a strike motion conforming to a user-specified specific strike from the inertial sensing signal;
the electronic device automatically extracting a swing image corresponding to the strike motion conforming to the user-specified specific strike from the sporting video captured by the image capturing device; and
playing the swing image corresponding to the user-specified specific strike.
12 . The non-transitory computer readable storage medium of claim 11 , wherein the electronic device adopts a strike-motion identifying algorism to identify the strike motion from the inertial sensing signal, and the strike-motion identifying algorism comprises a motion signal segmentation step, a signal normalization step, a CNN classification step, and a strike-motion identification step.
13 . The non-transitory computer readable storage medium of claim 11 , wherein the strike motion comprises a forehand long serve, a backhand short serve, a forehand high clear, a backhand high clear, a forehand net lift, a backhand net lift, a forehand net shot, a backhand net shot, a forehand drive, a backhand drive, a forehand net block, a backhand net block, a forehand slow drop shot, a forehand high and long shot, a forehand smash, or a forehand push.
14 . The non-transitory computer readable storage medium of claim 11 , wherein the method further comprises:
the electronic device calculating a parameter of the strike motion from the inertial sensing signal and displaying the parameter.