Method for video recording and editing assistant
View Patent ↗A method for a video recording and editing application analyses the audio and video during the process of video recording using a smart device such as a smartphone or tablet. The method provides feedback to the user during the video recording to improve user performance and reduce video and audio user errors. The method includes the option of automatic skipping or editing of video segments that suffer from user errors during playback.
1. A method for interactively assisting a user with a video recording assistant in recording video content on a smart device having video recording capability, the method comprising:
receiving an input related to a property of a video recording for analysis in an analysis component of the video recording assistant;
analyzing the input for a user error in the analysis component;
sending notification from the analysis component to a control center of the video recording assistant if a user error is detected;
sending feedback from the control center to the user identifying the detected user error in the form of a graphical icon on a video display of the smart device; and
sending from the control center a correctional hint to be display on the video display when the user error is detected.
2. The method of claim 1 , wherein the input comprises a one of video frames, audio frames, accelerometer data and light intensity data.
3. The method of claim 1 , wherein the graphical icon is animated to provide feedback as to a magnitude of the user error.
4. The method of claim 1 , wherein the control center causes a first digital mark to be created on a first video frame of the video recording when the user error is detected and causes a second digital mark to be put on a second video frame of the video recording when the user error is no longer detected.
5. The method of claim 4 , further comprising automatically editing the video recording by detecting the first and second digital mark and skipping over or editing out video frames between and including the first and second video frames on playback by the video recording assistant.
6. The method of claim 1 , in which the input comprises video frames wherein the analysis in the analysis component comprises a one of determining the motion vectors and determining a motion energy level of a scene.
7. The method of claim 1 , in which the input comprises audio frames wherein the analysis in the analysis component comprises detecting a wind noise pattern.
8. The method of claim 1 , further comprising feedback to the user by providing an audio message.
9. The method of claim 1 , wherein the smart device is in a first camera mode and further comprising the control center checking whether the user error can be mitigated by switching the smart device to a second camera mode.
10. The method of claim 1 , wherein the property of the video recording is related to at least one of the group consisting of an audio input, a video input and a sensor input.
11. The method of claim 1 , wherein the control center automatically pauses the video recording if the user does not respond to the feedback with corrective measures after a pre-determined amount of time.
12. The method of claim 1 , wherein the control center tracks the user error over a plurality of video recordings and provides statistical feedback to the user on a frequency of the user error.
13. The method of claim 1 , wherein the control center at least one of provides positive feedback to the user if the frequency of the user error decreases over time and provides suggestions for improvement to the user after completion of the video recording.
14. The method of claim 1 , wherein user settings are input into the control center by the user.
15. A non-transitory computer-readable storage medium comprising instructions that, when executed in a smart device having video recording capability, enable the method of claim 1 .
16. A video recording assistant device for interactively assisting a user in recording video content on a smart device having video recording capability, the video recording assistant device comprising:
an analysis component to receive an input related to a property of a video recording for analysis, wherein the analysis component is configured to analyze the input for a user error in the analysis component; and
a control center to receive notification from the analysis component if a user error is detected, wherein the control center is configured to send feedback to display a graphical icon on a display of the smart device and the control center is further configured to automatically alter the video recording if the user error is detected.
17. The video recording assistant device of claim 16 , wherein the input comprises a one of video frames, audio frames, accelerometer data and light intensity data.
18. The video recording assistant device of claim 16 , wherein the graphical icon is animated to provide feedback as to a magnitude of the user error.
19. the video recording assistant device of claim 16 , where in the control center is configured to provide a correction hint when the user error is detected.