IP Library Granted Patent US 9,497,391
Granted Patent B2
US 9,497,391 · App. 14/710,873 · Granted Nov 15, 2016

Apparatus and method for displaying images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,497,391
App. No.
14/710,873
Granted
Nov 15, 2016
Kind
B2
Abstract

Methods and apparatus provide for: acquiring a still image of a scene at a location; acquiring a moving image of at least one object at the scene taken at a different time of day, a different date, and/or a different season; selecting an image frame from among a plurality of image frames of the moving image as a still image frame; generating a three-dimensional (3D) image from the still image in a three-dimensional (3D) object space; superimposing the still image frame from the moving image onto the three-dimensional (3D) image; displaying the three-dimensional (3D) image on a display screen for a user; and generating the moving image superimposed on the three-dimensional (3D) image, starting at the selected image frame, in response to receiving a command from the user.

Claims (48)

1. A method, comprising:

acquiring a still image of a scene at a location;

acquiring a moving image of at least one object at the scene taken at a different time of day, a different date, and/or a different season;

selecting an image frame from among a plurality of image frames of the moving image as a still image frame;

generating a three-dimensional (3D) image from the still image in a three-dimensional (3D) object space;

superimposing the still image frame from the moving image onto the three-dimensional (3D) image;

displaying the three-dimensional (3D) image on a display screen for a user; and

generating the moving image superimposed on the three-dimensional (3D) image, starting at the selected image frame, in response to receiving a command from the user.

2. The method of claim 1 , wherein the step of generating the moving image superimposed on the three-dimensional (3D) image includes putting the at least one object into motion from a first area on the three-dimensional (3D) image to a second area on the three-dimensional (3D) image.

3. The method of claim 1 , wherein the command from the user is a command to zoom in toward the still image frame within the displayed three-dimensional (3D) image.

4. The method of claim 1 , wherein the step of acquiring the still image of the scene includes downloading the still image of the scene from a server over a data network.

5. The method of claim 1 , wherein the step of acquiring the moving image of the scene includes downloading the moving image of the scene from a server over a data network.

6. The method of claim 1 , wherein the still image is a panoramic image and the three-dimensional (3D) object space is a three-dimensional (3D) panoramic space.

7. The method of claim 6 , wherein the three-dimensional (3D) panoramic space is one of: a spherical three-dimensional (3D) space, a cubic three-dimensional (3D) space, and a cylindrical three-dimensional (3D) space.

8. An image display apparatus, comprising:

a first acquisition unit configured to acquiring a still image of a scene at a location;

a second acquisition unit configured to acquire a moving image of at least one object at the scene taken at a different time of day, a different date, and/or a different season;

a control unit configured to select an image frame from among a plurality of image frames of the moving image as a still image frame;

an image generating unit configured to generate a three-dimensional (3D) image from the still image in a three-dimensional (3D) object space;

a mapping unit configured to superimpose the still image frame from the moving image onto the three-dimensional (3D) image;

a display controller unit configured to display the three-dimensional (3D) image on a display screen for a user; and

generating the moving image superimposed on the three-dimensional (3D) image, starting at the selected image frame, in response to receiving a command from the user.

9. The image display apparatus of claim 8 , wherein the image generating unit generates the moving image superimposed on the three-dimensional (3D) image by putting the at least one object into motion from a first area on the three-dimensional (3D) image to a second area on the three-dimensional (3D) image.

10. The image display apparatus of claim 8 , wherein the command from the user is a command to zoom in toward the still image frame within the displayed three-dimensional (3D) image.

11. The image display apparatus of claim 8 , wherein the first acquisition unit operates to acquire the still image of the scene by downloading the still image of the scene from a server over a data network.

12. The image display apparatus of claim 8 , wherein the second acquisition unit operates to acquire the moving image of the scene by downloading the moving image of the scene from a server over a data network.

13. The image display apparatus of claim 8 , wherein the still image is a panoramic image and the three-dimensional (3D) object space is a three-dimensional (3D) panoramic space.

14. The image display apparatus of claim 13 , wherein the three-dimensional (3D) panoramic space is one of: a spherical three-dimensional (3D) space, a cubic three-dimensional (3D) space, and a cylindrical three-dimensional (3D) space.

15. An image display apparatus, comprising:

a server operatively connected to a communications network and configured to transmit at least one of a still image of a scene at a location and a moving image of at least one object at the scene taken at a different time of day, a different date, and/or a different season, to a client terminal connected to the communications network,

wherein the client terminal, upon acquiring the still image of the scene and the moving image of the scene, operates to:

select an image frame from among a plurality of image frames of the moving image as a still image frame;

generate a three-dimensional (3D) image from the still image in a three-dimensional (3D) object space;

superimpose the still image frame from the moving image onto the three-dimensional (3D) image;

display the three-dimensional (3D) image on a display screen for a user; and

generate the moving image superimposed on the three-dimensional (3D) image, starting at the selected image frame, in response to receiving a command from the user.

16. The image display apparatus of claim 15 , wherein generating the moving image superimposed on the three-dimensional (3D) image includes putting the at least one object into motion from a first area on the three-dimensional (3D) image to a second area on the three-dimensional (3D) image.

17. The image display apparatus of claim 15 , wherein the command from the user is a command to zoom in toward the still image frame within the displayed three-dimensional (3D) image.

18. The image display apparatus of claim 15 , wherein the still image is a panoramic image and the three-dimensional (3D) object space is a three-dimensional (3D) panoramic space.

19. The image display apparatus of claim 15 , wherein the three-dimensional (3D) panoramic space is one of: a spherical three-dimensional (3D) space, a cubic three-dimensional (3D) space, and a cylindrical three-dimensional (3D) space.

20. A non-transitory, computer-readable storage medium containing a computer program, which is executable by a computer in order to cause the computer to carry out actions, comprising:

acquiring a still image of a scene at a location;

acquiring a moving image of at least one object at the scene taken at a different time of day, a different date, and/or a different season;

selecting an image frame from among a plurality of image frames of the moving image as a still image frame;

generating a three-dimensional (3D) image from the still image in a three-dimensional (3D) object space;

superimposing the still image frame from the moving image onto the three-dimensional (3D) image;

displaying the three-dimensional (3D) image on a display screen for a user; and

generating the moving image superimposed on the three-dimensional (3D) image, starting at the selected image frame, in response to receiving a command from the user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
CHANGE OF NAME Recorded Aug 29, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039561/0825 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2016
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 039561/0872 →