Method for virtually expanding and enriching the field of view of a scene
View Patent ↗The invention relates to a method for virtually expanding and enriching the field of view of the current image of a scene described by a video including several images. This method includes the following steps of: a—expanding said field of view by at least one mosaic obtained from said images and by inserting at least one contextual datum in the reference frame of the current image of said scene, b—enriching said field of view by at least one piece of information referenced in said contextual datum.
1. A method for virtually expanding and enriching the field of view of the current image of a scene described by a video comprising several images including:
a—expanding said field of view by at least one mosaic obtained from said images and by inserting at least one contextual datum in the reference frame of the current image of said scene, wherein the at least one contextual datum is from, or derived from, a source other than said video comprising several images,
b—enriching said field of view by at least one piece of information referenced in said contextual datum,
c—inserting auxiliary location data in the current image, and
d—completing the field of view of the current image of said scene by mosaic portions stored beforehand and comprised in the field of view expanded by step a), wherein completing the field of view is achieved by partly reprojecting the mosaic obtained from said images, by partly retiming, and by reprojecting one or more contextual data in the reference frame of the current image,
wherein expanding said field of view is obtained by real multi-resolution mosaicking of said video in a fixed reference frame and the number of resolution levels of the mosaic is assessed from characteristics of said video.
2. The method according to claim 1 , wherein said mosaic stored beforehand includes a fixed pre-set number of resolution levels.
3. The method according to claim 1 , further including a contextual referencing of the current image of said scene by either direct retiming between said current image and said contextual data, or retiming the mosaic available with said contextual data.
4. The method according to claim 1 , wherein said contextual datum is an aerial image of the area where said scene occurs.
5. The method according to claim 1 , wherein said contextual datum is a textured or untextured 3D model of the area where said scene occurs.
6. The method according to claim 1 , wherein said contextual datum is made up of images of said scene taken at different points of view.
7. The method according to claim 1 , wherein said contextual datum is a geographical map.
8. A method for virtually expanding and enriching the field of view of the current image of a scene described by a video comprising several images including:
a—expanding said field of view by at least one mosaic obtained from said images and by inserting at least one contextual datum in the reference frame of the current image of said scene, wherein the at least one contextual datum is from, or derived from, a source other than said video comprising several images,
b—enriching said field of view by at least one piece of information referenced in said contextual datum,
c—inserting auxiliary location data in the current image, and
d—completing the field of view of the current image of said scene by mosaic portions stored beforehand and comprised in the field of view expanded by step a), wherein completing the field of view is achieved by partly reprojecting the mosaic obtained from said images, by partly retiming, and by reprojecting one or more contextual data in the reference frame of the current image,
wherein expanding said field of view is obtained by a delayed time multi-resolution mosaicking of all images of said video.
9. The method according to claim 8 , wherein said mosaic stored beforehand includes a fixed pre-set number of resolution levels.
10. The method according to claim 9 , wherein the number of resolution levels of the mosaic is assessed from characteristics of said video.
11. The method according to claim 8 , further including a contextual referencing of the current image of said scene by either direct retiming between said current image and said contextual data, or retiming the mosaic available with said contextual data.
12. The method according to claim 8 , wherein said contextual datum is an aerial image of the area where said scene occurs.
13. The method according to claim 8 , wherein said contextual datum is a textured or untextured 3 D model of the area where said scene occurs.
14. method according to claim 8 , wherein said contextual datum is made up of images of said scene taken at different points of view.
15. The method according to claim 8 , wherein said contextual datum is a geographical map.