Method and system for dynamically analyzing, modifying, and distributing digital images and video
The present invention discloses a new method for analyzing, modifying, and distributing digital images and video in a quick, efficient, practical and/or cost-effective way. The method of processing video can take a different region or object and replace the pixels in the frames of the scenes that comprise the features and characteristics of the identified region or object with a different set of pixels. The replacement or other customizations of the frames and scenes lead to a naturally integrated video or image which is indistinguishable by the human eye or other visual system. In one embodiment, this invention can be used to provide different advertising elements into an image or set of images for different viewers, or to enable a viewer to control elements within a video and add their own preference or other elements.
1 . A computer implemented method for processing content in a video comprising one or more frames, the method comprising:
Identifying one or more elements in each frame of said video;
ii. Identifying one or more scenes from said video by comparing the elements in each frame with the elements in the previous frame and subsequent frame, wherein frames having common elements above a threshold number will be considered to be in the same scene;
iii. Obtaining one or more associated characteristics for each element in each frame;
iv. Generating a map of a 3D environment in each frame based on the associated characteristics in one or more previous frames and one or more subsequent frames; and
v. Modifying one or more scenes in said video based on said map.
2 . The method of claim 1 , wherein said one or more elements of step ( 1 ) is identified by comparing with the characteristics stored in an object database.
3 . The method of claim 1 , wherein said element is an object or a selected area in a scene of said video.
4 . The method of claim 1 , wherein said element is detected by a detection algorithm which is stored in a detection algorithm database or selected by user's input.
5 . The method of claim 1 , further comprising correlating two or more said scenes of step (ii) by the elements in each of said scenes and storing said scenes in a scene database.
6 . The method of claim 1 , wherein said associated characteristics comprises position, dimension, reflection, lighting, shadows, warping, rotation, blurring and occlusion.
7 . The method of claim 1 , wherein step (v) comprises modifying said one or more scenes by removing one or more elements and applying said map to average the one or more removed elements in each frame of said one or more scenes.
8 . The method of claim 1 , wherein step (v) comprises modifying said one or more scenes by warping a desired element and applying said map over said desired element in each frame of said one or more scenes.
9 . The method of claim 1 , further comprising delivering the modified video of step (v) by streaming or downloading.