Information processing apparatus, display system, display method, and non-transitory computer readable medium storing program
An information processing apparatus includes a model-space storage unit that stores a 3D (three-dimensional) model of a predetermined object present in a real space, an object-information acquisition unit that acquires an image of the object taken by a camera of an augmented-reality display apparatus, a relation specifying unit that specifies a correspondence relation between a model coordinate system and a real-space coordinate system based on a result of a comparison between the image and the 3D model, a transformation unit that transforms coordinates in the model coordinate system for specifying a position at which a predetermined image is displayed into coordinates in the real-space coordinate system by using the correspondence relation, and a coordinate notification unit that notifies the augmented-reality display apparatus of the coordinates transformed by the transformation means.
1. An information processing apparatus comprising:
at least one memory storing instructions and a 3D (three-dimensional) model of an object present in a real space; and
at least one processor configured to execute the instructions stored in the memory to:
acquire an image of the object taken by a camera of an augmented-reality display apparatus together with coordinates of the camera and a direction of the camera, the augmented-reality display apparatus being an apparatus that displays an augmented-reality image in the real space in a superimposed manner;
specify a correspondence relation between a model coordinate system and a real-space coordinate system based on the coordinates of the camera, the direction of the camera, and a result of a comparison between the image of the object and the 3D model, the model coordinate system being a coordinate system in a model space in which the 3D model is present, and the real-space coordinate system being a coordinate system in the real space managed by the augmented-reality display apparatus;
acquire a plurality of sets that each of which is composed of the coordinates of the camera in the real-space coordinate system and the direction in the real-space coordinate system of which the starting point is the coordinates of the camera, the direction of each of the plurality of sets being designated by a user of the augmented-reality display apparatus;
transform coordinates in the model coordinate system for specifying a position at which the augmented-reality image is displayed into coordinates in the real-space coordinate system by using the specified correspondence relation; and
notify the augmented-reality display apparatus of the transformed coordinates to cause the augmented-reality display apparatus to display the augmented-reality image, wherein
the coordinates in the model coordinate system for specifying the position at which the augmented-reality image is displayed are coordinates specified based on the acquired coordinates and the acquired direction, and
the position at which the augmented-reality image is displayed is specified by using a line segment or an area represented by transformed coordinates of a plurality of points, the transformed coordinates of the plurality of points being coordinates specified based on the plurality of sets.
2. The information processing apparatus according to claim 1 , wherein the coordinates in the model coordinate system for specifying the position at which the augmented-reality image is displayed are specified as a position relative to the object.
3. The information processing apparatus according to claim 1 , wherein the processor is configured to execute the instructions to, when a new image of the object is acquired, specify the correspondence relation again.
4. An information processing apparatus comprising:
at least one memory storing instructions and a 3D (three-dimensional) model of an object present in a real space; and
at least one processor configured to execute the instructions stored in the memory to:
acquire an image of the object taken by a camera of an augmented-reality display apparatus together with coordinates of the camera and a direction of the camera, the augmented-reality display apparatus being an apparatus that displays an augmented-reality image in the real space in a superimposed manner;
specify a correspondence relation between a model coordinate system and a real-space coordinate system based on the coordinates of the camera, the direction of the camera, and a result of a comparison between the image of the object and the 3D model, the model coordinate system being a coordinate system in a model space in which the 3D model is present, and the real-space coordinate system being a coordinate system in the real space managed by the augmented-reality display apparatus;
acquire the coordinates of the camera in the real-space coordinate system and designation of the direction in the real-space coordinate system of which a starting point is the coordinates of the camera;
transform coordinates in the model coordinate system for specifying a position at which the augmented-reality image is displayed into coordinates in the real-space coordinate system by using the specified correspondence relation;
notify the augmented-reality display apparatus of the transformed coordinates to cause the augmented-reality display apparatus to display the augmented-reality image; and
specify in the real-space coordinate system an area of a venue where displaying is performed by using the acquired coordinates and the acquired direction, and information about a shape of the venue, wherein
the coordinates in the model coordinate system for specifying the position at which the augmented-reality image is displayed are coordinates specified based on the acquired coordinates and the acquired direction.
5. A display method comprising:
acquiring, by a processor, an image of an object present in a real space taken by a camera of an augmented-reality display apparatus together with coordinates of the camera and a direction of the camera, the augmented-reality display apparatus being an apparatus that displays an augmented-reality image in the real space in a superimposed manner;
specifying, by the processor, a correspondence relation between a model coordinate system and a real-space coordinate system based on the coordinates of the camera, the direction of the camera, and a result of a comparison between the image of the object and a 3D model of the object, the model coordinate system being a coordinate system in a model space in which the 3D model is present, and the real-space coordinate system being a coordinate system in the real space managed by the augmented-reality display apparatus;
acquiring, by a processor, a plurality of sets that each of which is composed of the coordinates of the camera in the real-space coordinate system and the direction in the real-space coordinate system of which the starting point is the coordinates of the camera, the direction of each of the plurality of sets being designated by a user of the augmented-reality display apparatus;
transforming, by the processor, coordinates in the model coordinate system for specifying a position at which the augmented-reality image is displayed into coordinates in the real-space coordinate system by using the correspondence relation; and
notifying, by the processor, the augmented-reality display apparatus of the transformed coordinates to cause the augmented-reality display apparatus to display the augmented-reality image, wherein
the coordinates in the model coordinate system for specifying the position at which the augmented-reality image is displayed are coordinates specified based on the acquired coordinates and the acquired direction, and
the position at which the augmented-reality image is displayed is specified by using a line segment or an area represented by transformed coordinates of a plurality of points, the transformed coordinates of the plurality of points being coordinates specified based on the plurality of sets.