IP Library Granted Patent US 9,749,672
Granted Patent B2
US 9,749,672 · App. 15/245,451 · Granted Aug 29, 2017

Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

Inventors: Toshiaki Suzuki (Kyoto, JP); Shigefumi Kawase (Tokyo, JP)
Assignees: Nintendo Co., Ltd.; Hal Laboratory, Inc.
H04N21/4122G11B27/005G11B27/322H04N5/44591H04N5/76H04N9/87H04N21/41407H04N21/4728H04N21/6587H04N2005/44578
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,749,672
App. No.
15/245,451
Granted
Aug 29, 2017
Kind
B2
Abstract

An example information processing device displays a partial area of a panoramic video on a display device. The information processing device obtains range information with which it is possible to identify a display range of the panoramic video to be displayed and/or to identify a position within the display range. The obtained range information is information regarding a display range determined based on an input made on a predetermined input device while the panoramic video is played. Where the panoramic video is output using the display device, the information processing device outputs the panoramic video while changing output content thereof in accordance with the obtained range information.

Claims (60)

1. A non-transitory computer-readable storage medium comprising an information processing program to be executed by a computer of an information processing device for displaying a virtual image on a first display device, wherein the information processing program instructs the computer to:

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein

the information processing program further instructs the computer to determine a display range of a virtual image in the first display device based on a user input; and

the virtual image of the display range determined based on the user input is displayed on the first display device, and history-related information produced based on the history information is output.

3. The non-transitory computer-readable storage medium according to claim 2 , wherein the history-related information output together with the virtual image represents a direction of the display range identified by the range information included in the history information with respect to a current display range in the first display device.

4. The non-transitory computer-readable storage medium according to claim 2 , wherein the output history-related information represents a display frequency for a predetermined range in the virtual image obtained from the history information.

5. The non-transitory computer-readable storage medium according to claim 4 , wherein the history-related information represents a display frequency determined in accordance with the number of pieces of history information that satisfy a predetermined condition regarding the time information and the range information.

6. The non-transitory computer-readable storage medium according to claim 1 , wherein when display of the virtual image is completed on the second display device, a virtual image of a display range determined based on the range information stored as the history information during the display is displayed on the first display device as a still image or a video.

7. The non-transitory computer-readable storage medium according to claim 6 , wherein

range information representing the display range and/or a position within the display range is obtained as the history information;

the information processing program further instructs the computer to determine whether or not an object appearing in the virtual image is included in a display range identified by the history information so as to select an object to be output based on a result of the determination; and

a virtual image including the selected object therein is displayed on the first display device as a still image or a video.

8. The non-transitory computer-readable storage medium according to claim 6 , wherein

the information processing program further instructs the computer to determine whether or not an object is included within a display range during display of the virtual image on the second display device so as to select an object to be output based on a result of the determination;

information representing the selected object is obtained as the range information; and

a virtual image of a display range including therein the object represented by the range information is displayed on the first display device as a still image or a video.

9. The non-transitory computer-readable storage medium according to claim 6 , wherein

a virtual image of a display range, determined based on a plurality of pieces of history information, is displayed on the first display device as a still image or a video.

10. The non-transitory computer-readable storage medium according to claim 1 , wherein the second display device is the same as the first display device.

11. The non-transitory computer-readable storage medium according to claim 1 , wherein the second display device is different from the first display device.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the information processing program further instructs the computer to:

determine the display range based on an input made on the predetermined input device while the virtual image is displayed on the second display device; and

display the virtual image of the determined display range on the first display device while the virtual image is displayed on the second display device.

13. The non-transitory computer-readable storage medium according to claim 1 , wherein a virtual image of a display range determined based on the range information is displayed on the first display device.

14. The non-transitory computer-readable storage medium according to claim 13 , wherein:

range information regarding a virtual image displayed on a second display device different from the first display device is obtained; and

the virtual image is displayed on the first display device while reducing a change in the display range determined based on the range information.

15. The non-transitory computer-readable storage medium according to claim 1 , wherein:

the obtained range information represents a position specified by a user while the virtual image is displayed on the second display device; and

an image representing a position on a virtual image determined based on the range information is displayed on the first display device together with the virtual image.

16. The non-transitory computer-readable storage medium according to claim 1 , wherein an image representing a viewing direction corresponding to a display range or a position based on the range information is displayed on the first display device.

17. The non-transitory computer-readable storage medium according to claim 1 , wherein an image representing a space represented by the virtual image and a position in the space corresponding to a position on the virtual image based on the range information is displayed on the first display device.

18. The non-transitory computer-readable storage medium according to claim 1 , wherein the range information is obtained from an external device via a network.

19. The non-transitory computer-readable storage medium according to claim 1 , wherein:

user information representing a user who has made an input regarding the range information is further obtained; and

the user information is output when the virtual image is output.

20. An information processing device comprising at least one processor and configured to display a virtual image on a first display device, the at least one processor controlling the information processing device to:

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

21. An information processing system for displaying a virtual image on a first display device, the information processing system comprising:

a processing system having at least one processor, the processing system configured to:

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

22. An image display method for displaying a virtual image on a first display device, comprising:

obtaining range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

outputting the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

Assignments (1)
CHANGE OF ADDRESS Recorded Jan 23, 2026
From: HAL LABORATORY INC.
To: HAL LABORATORY INC.
Reel/Frame 074477/0344 →
Priority Claims (1)
JP 2012-125644 · Jun 1, 2012 · national
Continuity (2)
Continuation 13869401 · Apr 24, 2013
Related Publication 20160366460A1 · Dec 15, 2016