Display control device, display control method, and program

1. A display control device, comprising at least one processor configured to:

acquire taken images taken at a predetermined frame rate by a camera, which is movable in a real space;

execute first processing of estimating a current position and orientation of the camera based on the taken images, and combine a virtual image with one of the taken images to be displayed, the virtual image showing a view of a virtual three-dimensional object as seen from a virtual viewpoint based on a result of the estimation; and

acquire, in a frame subsequent to a frame on which the virtual image and the one of the taken images have been combined, instead of executing the first processing for each frame, movement information on a movement of the camera, process the virtual image based on the movement information by two-dimensional processing, and combine the processed virtual image with another one of the taken images to be displayed,

wherein the at least one processor thins out frames on which the first processing is executed.

2. The display control device according to claim 1 ,

wherein first display control frames are repeatedly received for a plurality of times, the first display control frames are frames on which the virtual image and the one of the taken images are combined, and

wherein at least one second display control frame is set after each of the first display control frames, the at least one second display control frame is a frame on which the processed virtual image and the another one of the taken images are combined.

3. The display control device according to claim 2 , wherein the at least one processor is configured to process the virtual image generated based on a latest one of the first display control frames, which repeatedly come a plurality of times, based on the movement information on a movement of the camera from the latest one of the first display control frames.

4. The display control device according to claim 1 , wherein the at least one processor is configured to acquire the movement information based on a change of a feature point in the taken images.

5. The display control device according to claim 4 , wherein the at least one processor is configured to set an area corresponding to a display position of the virtual image in the taken images as an extraction target for the feature point.

6. The display control device according to claim 1 , wherein the at least one processor is configured to acquire the movement information based on at least one of a detection result of a sensor configured to detect a change in position of the camera, and a detection result of a sensor configured to detect a change in orientation of the camera.

7. The display control device according to claim 1 ,

wherein first display control frames are repeatedly received a plurality of times, the first display control frames are frames on which the virtual image and the one of the taken images are combined,

wherein at least one second display control frame is set after each of the first display control frames, the at least one second display control frame is a frame on which the processed virtual image and the another one of the taken images are combined, and

wherein the at least one processor is configured to acquire the movement information based on changes in estimation results of a position and an orientation of the camera.

8. The display control device according to claim 1 , wherein the at least one processor is configured to further determine a display position of the processed virtual image based on the movement information, and display the processed virtual image at the display position.

9. The display control device according to claim 1 , wherein the at least one processor is configured to estimate the current position and orientation of the camera based further on at least one of a detection result of a sensor configured to detect a change in position of the camera, and a detection result of a sensor configured to detect a change in orientation of the camera.

10. The display control device according to claim 1 ,

wherein the at least one processor is configured to:

acquire in real time the taken images taken by the camera,

combine one of the taken images acquired in real time and the virtual image with each other so that the combined image can be displayed, and

combine another one of the taken images acquired in real time and the processed virtual image with each other so that the combined image can be displayed.

11. The display control device according to claim 1 ,

wherein first display control frames are repeatedly received a plurality of times, the first display control frames which are frames on which the virtual image and the one of the taken images are combined,

wherein at least one second display control frame is set after each of the first display control frames, and a number of second display control frames is variable, the at least second display control frame is a frame on which the processed virtual image and the another one of the taken images are combined, and

wherein the at least one processor is configured to determine a frequency at which the first display control frames come based on a predetermined condition.

12. The display control device according to claim 11 ,

wherein a plurality of the virtual three-dimensional objects are arranged in a virtual space,

wherein the frequency at which the first display control frames come is variable for each of the virtual three-dimensional objects, and

wherein the at least one processor is configured to determine the frequency at which the first display control frames come for each of the virtual three-dimensional objects based on a position of the each of the virtual three-dimensional objects.

13. The display control device according to claim 1 ,

wherein the at least one processor is configured to generate the virtual image that is larger than each of the taken images, and

wherein the at least one processor is enabled to process and display a portion of the virtual image that is not displayed.

14. The display control device according to claim 1 ,

wherein the real space is inside of a room,

wherein the taken images are taken of a view of the inside of the room,

wherein the virtual three-dimensional object is virtual furniture, and

wherein the virtual image is an image that shows a view of the virtual furniture as seen from the virtual viewpoint.

15. A display control method, comprising:

acquiring taken images taken at a predetermined frame rate by a camera, which is movable in a real space;

executing first processing of estimating a current position and orientation of the camera based on the taken images, and combining a virtual image with one of the taken images to be displayed, the virtual image showing a view of a virtual three-dimensional object as seen from a virtual viewpoint based on a result of the estimation; and

acquiring, in a frame subsequent to a frame on which the virtual image and the one of the taken images have been combined, instead of executing the first processing for each frame, movement information on a movement of the camera, processing the virtual image based on the movement information by two-dimensional processing, and combining the processed virtual image with another one of the taken images to be displayed,

wherein the frames on which the first processing is executed are thinned out.

16. A non-transitory computer-readable information storage medium for storing a program for causing a computer to function as:

acquire taken images taken at a predetermined frame rate by a camera, which is movable in a real space;

execute first processing of estimating a current position and orientation of the camera based on the taken images, and combine a virtual image with one of the taken images to be displayed, the virtual image showing a view of a virtual three-dimensional object as seen from a virtual viewpoint based on a result of the estimation; and

acquire, in a frame subsequent to a frame on which the virtual image and the one of the taken images have been combined, instead of executing the first processing for each frame, movement information on a movement of the camera, process the virtual image based on the movement information by two-dimensional processing, and combine the processed virtual image with another one of the taken images to be displayed,

wherein the frames on which the first processing is executed are thinned out.