IP Library Granted Patent US 12,056,826
Granted Patent B2
US 12,056,826 · App. 17/436,079 · Granted Aug 6, 2024

Head-mounted information processing apparatus and head-mounted display system

Inventors: Naohisa Takamizawa (Kyoto, JP); Yasunobu Hashimoto (Kyoto, JP); Yoshinori Okada (Kyoto, JP)
Assignee: MAXELL, LTD.
G06T19/006G06T3/40G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,826
App. No.
17/436,079
Granted
Aug 6, 2024
Kind
B2
Abstract

The existence position of the virtual object displayed by the virtual reality or augmented reality is easily grasped. In a head-mounted information processing apparatus 100 , a virtual object generation processor 122 generates a virtual object. An input operation unit 121 sets and inputs information. A camera 111 captures a real space. A display unit 130 displays a photographed image captured by the camera 111 and the virtual object generated by the virtual object generation processor 122 . The controller 125 controls the virtual object generation processor 122 and the display unit 130 . The controller 125 displays the virtual objects generated by the virtual object generation processor 122 in a batch within a display visual field screen of the display unit 130 in accordance with virtual object display instruction information for instructing display of the virtual object input from the input operation unit 121.

Claims (93)

1. A head-mounted information processing apparatus comprising:

processing circuitry configured to

generate a plurality of virtual objects, each of which having a coordinate position in a three dimensional space, and

receive virtual object display instruction information for instructing display of the plurality of virtual objects;

a camera configured to capture a real space; and

a display configured to display a photographed image captured by the camera and the plurality of virtual objects, wherein the processing circuitry is configured to control the display to display, within a display visual field screen of the display, (1) a first virtual object of the plurality of virtual objects, the first virtual object being located virtually at a first coordinate position within a visual field of a user, and (2) a second virtual object of the plurality of virtual objects, the second virtual object being located virtually at a second coordinate position outside the visual field of the user, in accordance with the virtual object display instruction information,

wherein the processing circuitry is configured to:

generate a plurality of miniatures, each of which is a small model of each of the plurality of virtual objects,

generate a miniature display area in which the plurality of miniatures are displayed,

arrange the plurality of miniatures in the miniature display area, and

control the display to display the plurality of miniatures in the miniature display area, and

wherein the miniature display area has a spherical shape.

2. The head-mounted information processing apparatus according to claim 1 , wherein

the processing circuitry is configured to:

receive attitude operation information to operate an attitude of at least one of the plurality of virtual objects displayed on the display; and

control the attitude of the at least one of the plurality of virtual objects based on the received operation information.

3. The head-mounted information processing apparatus according to claim 1 , wherein

the processing circuitry is configured to:

in response to receiving the attitude operation information, control the attitude of the at least one of the plurality of virtual objects after moving the at least one of the plurality of virtual objects to a preset position within the display visual field screen of the display, and

return the at least one of the plurality of virtual objects to an original display position within the display visual field screen of the display.

4. The head-mounted information processing apparatus according to claim 1 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects in a first display area within the display visual field screen and the plurality of virtual objects in a second display area different from the first display area within the display visual field screen.

5. The head-mounted information processing apparatus according to claim 1 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects within the display visual field screen so as to be superimposed on a display area where the plurality of virtual objects are displayed within the display visual field screen.

6. A head-mounted information processing apparatus comprising:

processing circuitry configured to

generate a plurality of virtual objects, each of which having a coordinate position in a three dimensional space, and

receive virtual object display instruction information for instructing display of the plurality of virtual objects;

a camera configured to capture a real space; and

a display configured to display a photographed image captured by the camera and the plurality of virtual objects, wherein the processing circuitry is configured to control the display to display, within a display visual field screen of the display, (1) a first virtual object of the plurality of virtual objects, the first virtual object being located virtually at a first coordinate position within a visual field of a user, and (2) a second virtual object of the plurality of virtual objects, the second virtual object being located virtually at a second coordinate position outside the visual field of the user, in accordance with the virtual object display instruction information,

wherein the processing circuitry is configured to:

generate a plurality of miniatures, each of which is a small model of each of the plurality of virtual objects,

generate a miniature display area in which the plurality of miniatures are displayed,

arrange the plurality of miniatures in the miniature display area, and

control the display to display the plurality of miniatures in the miniature display area, and

wherein the processing circuitry is configured to:

generate a plurality of virtual lines, each of which is connecting each of the plurality of virtual objects and each of the plurality of miniatures each corresponding to the each of the plurality of virtual objects having the same shape, and

control the display to display the virtual line.

7. The head-mounted information processing apparatus according to claim 6 ,

wherein the processing circuitry is configured to:

receive attitude operation information to operate an attitude of at least one of the plurality of virtual objects displayed on the display; and

control the attitude of the at least one of the plurality of virtual objects based on the received operation information.

8. The head-mounted information processing apparatus according to claim 6 ,

wherein the processing circuitry is configured to:

in response to receiving the attitude operation information, control the attitude of the at least one of the plurality of virtual objects after moving the at least one of the plurality of virtual objects to a preset position within the display visual field screen of the display, and

return the at least one of the plurality of virtual objects to an original display position within the display visual field screen of the display.

9. The head-mounted information processing apparatus according to claim 6 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects in a first display area within the display visual field screen and the plurality of virtual objects in a second display area different from the first display area within the display visual field screen.

10. The head-mounted information processing apparatus according to claim 6 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects within the display visual field screen so as to be superimposed on a display area where the plurality of virtual objects are displayed within the display visual field screen.

11. A head-mounted information processing apparatus comprising:

processing circuitry configured to

generate a plurality of virtual objects, each of which having a coordinate position in a three dimensional space, and

receive virtual object display instruction information for instructing display of the plurality of virtual objects;

a camera configured to capture a real space, and

a display configured to display a photographed image captured by the camera and the plurality of virtual objects, wherein the processing circuitry is configured to control the display to display, within a display visual field screen of the display, (1) a first virtual object of the plurality of virtual objects, the first virtual object being located virtually at a first coordinate position within a visual field of a user, and (2) a second virtual object of the plurality of virtual objects, the second virtual object being located virtually at a second coordinate position outside the visual field of the user, in accordance with the virtual object display instruction information,

wherein the processing circuitry is configured to control the display to display the second virtual object by displaying a full spherical image that includes the second coordinate position outside the visual field of the user.

12. The head-mounted information processing apparatus according to claim 11 ,

wherein the camera is a full spherical camera configured to capture a full spherical image, and

wherein the processing circuitry is configured to control the display to display the full spherical image captured by the camera.

13. The head-mounted information processing apparatus according to claim 11 , wherein

the processing circuitry is configured to:

receive selection information that selects at least one of the plurality of virtual objects;

enlarge the at least one of the plurality of virtual objects that has been selected based on the selection information; and

move the at least one of the plurality of virtual objects that has been selected to a preset position within the display visual field screen of the display.

14. The head-mounted information processing apparatus according to claim 11 ,

wherein the processing circuitry is configured to:

generate a plurality of miniatures, each of which is a small model of each of the plurality of virtual objects,

generate a miniature display area in which the plurality of miniatures are displayed,

arrange the plurality of miniatures in the miniature display area, and

control the display to display the plurality of miniatures in the miniature display area.

15. The head-mounted information processing apparatus according to claim 11 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects in a first display area within the display visual field screen and the plurality of virtual objects in a second display area different from the first display area within the display visual field screen.

16. The head-mounted information processing apparatus according to claim 11 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects within the display visual field screen so as to be superimposed on a display area where the plurality of virtual objects are displayed within the display visual field screen.

17. A head-mounted information processing apparatus comprising:

processing circuitry configured to

generate a plurality of virtual objects, each of which having a coordinate position in a three dimensional space, and

receive virtual object display instruction information for instructing display of the plurality of virtual objects;

a camera configured to capture a real space; and

a display configured to display a photographed image captured by the camera and the plurality of virtual objects, wherein the processing circuitry is configured to control the display to display, within a display visual field screen of the display, (1) a first virtual object of the plurality of virtual objects, the first virtual object being located virtually at a first coordinate position within a visual field of a user, and (2) a second virtual object of the plurality of virtual objects, the second virtual object being located virtually at a second coordinate position outside the visual field of the user, in accordance with the virtual object display instruction information,

wherein the second virtual object is arranged virtually behind a real object in the real space, and

the processing circuitry is configured to control the display to display the second virtual object by displaying the second virtual object in front of the real object.

18. The head-mounted information processing apparatus according to claim 17 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects in a first display area within the display visual field screen and the plurality of virtual objects in a second display area different from the first display area within the display visual field screen.

19. The head-mounted information processing apparatus according to claim 17 ,

wherein the processing circuitry is configured to control the display to display a list of the plurality of virtual objects within the display visual field screen so as to be superimposed on a display area where the plurality of virtual objects are displayed within the display visual field screen.

20. The head-mounted information processing apparatus according to claim 17 ,

wherein the processing circuitry is configured to:

generate a plurality of miniatures, each of which is a small model of each of the plurality of virtual objects,

generate a miniature display area in which the plurality of miniatures are displayed,

arrange the plurality of miniatures in the miniature display area, and

control the display to display the plurality of miniatures in the miniature display area.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2021
From: TAKAMIZAWA, NAOHISA; HASHIMOTO, YASUNOBU; OKADA, YOSHINORI
To: MAXELL, LTD.
Reel/Frame 057637/0540 →
Continuity (1)
Related Publication 20220172439A1 · Jun 2, 2022