Synthetic geotagging for computer-generated images
Systems and methods for constructing and saving files containing computer-generated image data with associated virtual camera location data during 3-D visualization of an object (e.g., an aircraft). The process tags computer-generated images with virtual camera location and settings information selected by the user while navigating a 3-D visualization of an object. The virtual camera location data in the saved image file can be used later as a way to return the viewpoint to the virtual camera location in the 3-D environment from where the image was taken. For example, these tagged images can later be drag-and-dropped onto the display screen while the 3-D visualization application is running to activate the process of retrieving and displaying a previously selected image. Multiple images can be loaded and then used to determine the relative viewpoint offset between images.
1. A method for adding virtual camera location data to computer-generated images, comprising:
opening a three-dimensional visualization application on a computer system;
retrieving digital data representing a three-dimensional model of an object from a nontransitory tangible computer-readable storage medium;
displaying a computer-generated default image of at least a first portion of the object as pixels on a display device using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model, the computer-generated default image having a default viewpoint;
navigating from the default viewpoint to a first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model until a computer-generated first image of a second portion the object appears on the display device;
selecting the computer-generated first image of the second portion of the object for storage in the nontransitory tangible computer-readable storage medium;
in response to selection of the computer-generated first image, constructing a first digital image file in accordance with the standards of the Exchangeable Image File format, the first digital image file containing, in a part reserved for image data, first digital image data corresponding to the computer-generated first image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a first apparent location of a virtual camera corresponding to the first viewpoint of interest, wherein the first apparent location includes a first position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a first orientation including yaw, pitch and roll angles of a first virtual line-of-sight of the virtual camera in the frame of reference of the object;
after the first digital image file has been constructed, storing the first digital image file in the nontransitory tangible computer-readable storage medium;
retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
displaying a stored first image based on the first digital image data of the retrieved first digital image file;
placing the stored first image onto a display screen of the three-dimensional visualization application by a drag-and-drop manipulation;
extracting, by the three-dimensional visualization application, the digital data representing the first position and the first orientation of the virtual camera from the first digital image file associated with the stored first image; and
re-creating and displaying, by the three-dimensional visualization application, the computer-generated first image of the second portion of the object on the display screen using the three-dimensional visualization application to process three-dimensional model data, the re-created computer-generated first image having the first viewpoint of interest.
2. The method as recited in claim 1 , further comprising:
navigating from the first viewpoint of interest to a second viewpoint of interest different than the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model until a computer-generated second image of a third portion of the object appears on the display device;
selecting the computer-generated second image of the third portion of the object for storage in the nontransitory tangible computer-readable storage medium;
in response to selection of the computer-generated second image, constructing a second digital image file in accordance with the standards of the Exchangeable Image File format, the second digital image file containing, in a part reserved for image data, second digital image data corresponding to the computer-generated second image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a second apparent location of a virtual camera corresponding to the second viewpoint of interest, wherein the second apparent location includes a second position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a second orientation including yaw, pitch and roll angles of a second virtual line-of-sight of the virtual camera in the frame of reference of the object; and
after the second digital image file has been constructed, storing the second digital image file in the nontransitory tangible computer-readable storage medium.
3. The method as recited in claim 2 , further comprising computing a position and orientation representation of a relative offset between the first and second viewpoints of interest.
4. A system for adding virtual camera location data to computer-generated images, comprising a nontransitory tangible computer-readable storage medium that stores digital data representing a three-dimensional model of an object, an input device, a display device and a computer system, wherein the computer system is configured to perform the following operations:
(a) controlling the display device to display a computer-generated default image of at least a first portion of the object as pixels using the three-dimensional visualization application to process the digital data representing the three-dimensional model of the object, the computer-generated default image having a default viewpoint;
(b) controlling the display device to change the default viewpoint using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model in response to movement of the input device by a user, the viewpoint being changed until a computer-generated first image of a second portion of the object having a first viewpoint of interest different than the default viewpoint is displayed;
(c) constricting a first digital image file in accordance with the standards of the Exchangeable Image File format, the first digital image file containing, in a part reserved for image data, first digital image data corresponding to the computer-generated first image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a first apparent location of a virtual camera corresponding to the first viewpoint of interest, wherein the first apparent location includes a first position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a first orientation including yaw, pitch and roll angles of a first virtual line-of-sight of the virtual camera in the frame of reference of the object;
(d) storing the first digital image file in the nontransitory tangible computer-readable storage medium;
(e) retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
(f) displaying a stored first image based on the first digital image data of the retrieved first digital image file;
(g) placing the stored first image onto a display screen of the three-dimensional visualization application by a drag-and-drop manipulation;
(h) extracting, by the three-dimensional visualization application, the digital data representing the first position and the first orientation of the virtual camera from the first digital image file associated with the stored first image; and
(i) re-creating and displaying, by the three-dimensional visualization application, the computer-generated first image of the second portion of the object using the three-dimensional visualization application to process three-dimensional model data, the re-created computer-generated first image having the first viewpoint of interest.
5. The system as recited in claim 4 , wherein the computer system is configured to perform operations (a) through (c) in response to user inputs.
6. The system as recited in claim 4 , wherein the computer system is further configured to perform the following operations:
(j) controlling the display device to change the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model in response to movement of the input device by a user, the viewpoint being changed until a computer-generated second image of a third portion of the object having a second viewpoint of interest different than the first viewpoint of interest is displayed;
(k) constructing a second digital image file in accordance with the standards of the Exchangeable Image File format, the second digital image file containing, in a part reserved for image data, second digital image data corresponding to the computer-generated second image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a second apparent location of a virtual camera corresponding to the second viewpoint of interest, wherein the second apparent location includes a second position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a second orientation including yaw, pitch and roll angles of a second virtual line-of-sight of the virtual camera in the frame of reference of the object; and
(l) storing the second digital image file in the nontransitory tangible computer-readable storage medium.
7. The system as recited in claim 6 , wherein the computer system is further configured to compute an offset matrix representing a relative offset between the first and second viewpoints of interest in response to a user input.
8. A method for adding virtual camera location data to computer-generated images, comprising:
displaying a computer-generated first image having a first viewpoint of interest using a three-dimensional visualization application to process digital data representing a three-dimensional model of an object;
selecting the computer-generated first image for storage in a nontransitory tangible computer-readable storage medium;
constructing a first digital image file in accordance with the standards of the Exchangeable Image File format, the first digital image file containing, in a part reserved for image data, first digital image data corresponding to the computer-generated first image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a first apparent location of a virtual camera corresponding to the first viewpoint of interest, wherein the first apparent location includes a first position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a first orientation including yaw, pitch and roll angles of a first virtual line-of-sight of the virtual camera in the frame of reference of the object;
storing the first digital image file in the nontransitory tangible computer-readable storage medium;
retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
displaying a stored first image based on the first digital image data of the retrieved first digital image file;
placing the stored first image onto a display screen of the three-dimensional visualization application by a drag-and-drop manipulation;
extracting, by the three-dimensional visualization application, the digital data representing the first position and the first orientation of the virtual camera from the first digital image file associated with the stored first image; and
re-creating and displaying, by the three-dimensional visualization application, the computer-generated first image of the second portion of the object using the three-dimensional visualization application to process three dimensional model data, the re-created computer-generated first image having the first viewpoint of interest.
9. The method as recited in claim 8 , further comprising:
navigating from the first viewpoint of interest to a second viewpoint of interest different than the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the three-dimensional model;
selecting a computer-generated second image for storage in the nontransitory tangible computer-readable storage medium;
constructing a second digital image file in accordance with the standards of the Exchangeable Image File format, the second digital image file containing, in a part reserved for image data, second digital image data corresponding to the computer-generated second image and containing, in a part reserved for metadata, first and second tags that respectively contain digital data representing a second apparent location of a virtual camera corresponding to the second viewpoint of interest, wherein the second apparent location includes a second position including x, y and z coordinates of the virtual camera in a frame of reference of the object and a second orientation including yaw, pitch and roll angles of a second virtual line-of-sight of the virtual camera in the frame of reference of the object; and
storing the second digital image file in the nontransitory tangible computer-readable storage medium.
10. The method as recited in claim 9 , further comprising computing a position and orientation representation of a relative offset between the first and second viewpoints of interest.