Method and apparatus for displaying video on 3D map

1. A method of displaying a captured image onto a three-dimensional (3D) electronic map, the method comprising:

determining a position of a virtual photographing apparatus within the 3D electronic map based on a position of a real photographing apparatus in a real world environment;

determining nearest intersecting points in the 3D electronic map based on a plurality of virtual view angle vectors each of which originates from the virtual photographing apparatus and intersects with one of a plurality of polygons constituting the 3D electronic map at one of the nearest intersecting points, wherein the plurality of virtual view angle vectors are generated based on a view angle of the real photographing apparatus and the position of the virtual photographing apparatus in the 3D electronic map;

selecting pixels that are within a range of coordinates of the nearest intersecting points by comparing 3D coordinates of the nearest intersecting points and 3D coordinates of a plurality of pixels constituting the plurality of polygons;

converting 3D coordinates of the selected pixels to two-dimensional (2D) coordinates to display the selected pixels on a 2D display;

superimposing an image captured by the real photographing apparatus on top of the selected pixels, using the converted 2D coordinates of the selected pixels; and

outputting, in real-time, the 3D electronic map, including the superimposed image, on the 2D display,

wherein the view angle indicates a full extent of a view which is observable by the real photographing apparatus irrespective of an object seen in the view, and the plurality of virtual view angle vectors are directed at edges of a view which is seen from the position of the virtual photographing apparatus according to the view angle.

2. The method of claim 1 , wherein the nearest intersecting points are positioned on the virtual view angle vectors and intersect selected polygons which are nearest to the real photographing apparatus or the virtual photographing apparatus among the polygons constituting the 3D electronic map.

3. The method of claim 1 , wherein the plurality of virtual view angle vectors are used within the 3D electronic map and are formed of four vectors, and the each of the plurality of virtual view angle vectors has an angle corresponding to a view angle of the real photographing apparatus.

4. The method of claim 1 , wherein 2D coordinates information and 3D coordinates information, which refer to coordinates information obtained by converting the 3D coordinates information used in the 3D electronic map to the 2D coordinates information to display the 3D coordinate information on the 2D display, are stored in advance in a storage unit, and the stored 2D coordinates information is used in the converting.

5. The method of claim 1 , wherein a portion of the superimposed image may be designated by a user.

6. The method of claim 5 , wherein areas not corresponding to the superimposed image within the 3D electronic map are made dark or semi-transparent to highlight the superimposed image.

7. The method of claim 1 , wherein in the outputting, the 3D electronic map is output on the 2D display in real-time, such that only the superimposed image is highlighted in the 3D electronic map.

8. The method of claim 1 , wherein at least two of the nearest intersecting points are positioned on different polygons.

9. A non-transitory computer readable recording medium having recorded thereon a program for executing the method of claim 1 .

10. A non-transitory computer readable recording medium of claim 9 , wherein the nearest intersecting points are positioned on the virtual view angle vectors and intersect selected polygons which are nearest to the real photographing apparatus or the virtual photographing apparatus among the polygons constituting the 3D electronic map.

11. An apparatus for displaying a captured image onto a three-dimensional (3D) electronic map, comprising:

a reference setting device configured to determine a position of a virtual photographing apparatus within the 3D electronic map based on a position of a real photographing apparatus in a real world environment;

an intersecting point extracting device configured to determine nearest intersecting points in the 3D electronic map based on a plurality of virtual view angle vectors each of which originates from the virtual photographing apparatus and intersects with one of a plurality polygons constituting the 3D electronic map at one of the nearest intersecting points, wherein the plurality of virtual view angle vectors are generated based on a view angle of the real photographing apparatus and the position of the virtual photographing apparatus in the 3D electronic map;

a selecting device configured to select pixels that are within a range of coordinates of the nearest intersecting points by comparing 3D coordinates of the nearest intersecting points and 3D coordinates of a plurality of pixels constituting the plurality of polygons;

a converting device configured to convert 3D coordinates of the selected pixels to two-dimensional (2D) coordinates of the selected pixels to display the selected pixels on a 2D display;

an image superimposing device configured to superimpose an image captured by the real photographing apparatus on top of the selected pixels, wherein the superimposing device uses the converted 2D coordinates of the selected pixels; and

an output device configured to output, in real-time, the 3D electronic map, including the superimposed image, on the 2D display,

wherein the view angle indicates a full extent of a view which is observable by the real photographing apparatus irrespective of an object seen in the view, and the plurality of virtual view angle vectors are directed at edges of a view which is seen from the position of the virtual photographing apparatus according to the view angle.

12. The apparatus of claim 11 , wherein the intersecting points are positioned on the virtual view angle vectors and intersect selected polygons which are nearest to the real photographing apparatus or the virtual photographing apparatus among the polygons constituting the 3D electronic map.

13. The apparatus of claim 11 , further comprising a storage unit that stores 3D coordinates information used in the 3D electronic map and 2D coordinates information, wherein the 2D coordinates information is obtained by converting the 3D coordinates information to display the 3D coordinates information on the 2D display.

14. The apparatus of claim 11 , wherein the position of the virtual photographing apparatus is a position within the 3D electronic map corresponding to the position of the real photographing apparatus, wherein the position of the real photographing apparatus is determined by a global positioning system (GPS).

15. The apparatus of claim 11 , wherein the plurality of virtual view angle vectors are used in the 3D electronic map and are formed of four vectors, and the each of the plurality of virtual view angle vectors have an angle corresponding to a view angle of the real photographing apparatus.

16. A system for displaying a captured image onto a three-dimensional (3D) electronic map, comprising:

a map server configured to store data of the 3D electronic map, wherein the 3D electronic map consists of a plurality of polygons;

a real photographing apparatus configured to photograph a monitor area; and

an image superimposing apparatus comprising the apparatus of claim 11 configured to superimpose an image captured by the real photographing apparatus with a position on the 3D electronic map.

17. The system of claim 16 , wherein the intersecting points are positioned on the virtual view angle vectors and intersect selected polygons which are nearest to the real photographing apparatus or the virtual photographing apparatus among the polygons constituting the 3D electronic map.

18. The system of claim 16 , wherein the position of the virtual photographing apparatus is a position within the 3D electronic map corresponding to the position of the real photographing apparatus, wherein the position of the real photographing apparatus is determined by global positioning system (GPS).

19. The apparatus of claim 16 , wherein the plurality of virtual view angle vectors are used in the 3D electronic map and are formed of four vectors, and the each of the plurality of virtual view angle vectors have an angle corresponding to a view angle of the real photographing apparatus.

20. An apparatus for displaying a captured image onto a three-dimensional (3D) electronic map, comprising:

at least one memory configured to store at least one computer program; and

at least one processor configured to display the captured image onto the 3D electronic map by executing the computer program,

wherein the computer program comprises instructions implementing the operations of:

determining a position of a virtual photographing apparatus within the 3D electronic map based on a position of a real photographing apparatus in a real world environment;

determining nearest intersecting points in the 3D electronic map based on a plurality of virtual view angle vectors each of which originates from the virtual photographing apparatus and intersects with one of a plurality of polygons constituting the 3D electronic map at one of the nearest intersecting points, wherein the plurality of virtual view angle vectors are generated based on a view angle of the real photographing apparatus and the position of the virtual photographing apparatus in the 3D electronic map;

selecting pixels that are within a range of coordinates of the nearest intersecting points by comparing 3D coordinates of the nearest intersecting points and 3D coordinates of a plurality of pixels constituting the plurality of polygons;

converting 3D coordinates of the selected pixels to two-dimensional (2D) coordinates of the selected pixels to display the selected pixels on a 2D display;

superimposing an image captured by the real photographing apparatus on top of the selected pixels, wherein the superimposing device uses the converted 2D coordinates of the selected pixels; and

outputting, in real-time, the 3D electronic map, including the superimposed image, on the 2D display,

wherein the view angle indicates a full extent of a view which is observable by the real photographing apparatus irrespective of an object seen in the view, and the plurality of virtual view angle vectors are directed at edges of a view which is seen from the position of the virtual photographing apparatus according to the view angle.