IP Library Granted Patent US 11,960,635
Granted Patent B2
US 11,960,635 · App. 17/425,254 · Granted Apr 16, 2024

Virtual object display device and virtual object display method

Inventors: Yasunobu Hashimoto (Kyoto, JP); Naohisa Takamizawa (Kyoto, JP); Hiroshi Shimizu (Kyoto, JP)
Assignee: MAXELL, LTD.
G06F3/011G01C19/00G01P13/00G01P15/18G06T7/70G06T11/00G06V40/103G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,960,635
App. No.
17/425,254
Granted
Apr 16, 2024
Kind
B2
Abstract

A virtual object display device comprises a display and a display control device configured to perform display control of the display. The display control device includes: a coordinate system calculation unit configured to detect movement and rotation of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows the movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with the rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view.

Claims (41)

1. A virtual object display device, comprising:

a display;

a display control device configured to perform display control of the display, the display control device including:

a coordinate system calculation unit configured to detect a movement amount and a rotation amount of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and

a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view; and

an input controller configured to receive an input operation from a user to the display control device, wherein

when the input controller receives the input operation related to a front direction of the inertial coordinate system, the coordinate system calculation unit resets the front direction of the inertial coordinate system in accordance with the input operation.

2. A virtual object display device, comprising:

a display;

a display control device configured to perform display control of the display, the display control device including:

a coordinate system calculation unit configured to detect a movement amount and a rotation amount of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and

a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view; and

a motion measurement sensor connected to the display control device to measure the movement amount and the rotation amount of the virtual object display device, wherein

the coordinate system calculation unit performs a smoothing process with respect to directions of the virtual object display device which have been calculated based on signals from the motion measurement sensor so as to reset a front direction of the inertial coordinate system.

3. The virtual object display device according to claim 2 , wherein

the motion measurement sensor is a gyro sensor, and the coordinate system calculation unit makes a set front direction follow a smoothed rotation direction obtained by smoothing rotation directions of the virtual object display device which have been calculated based on signals output from the gyro sensor so as to reset the front direction.

4. The virtual object display device according to claim 2 , wherein

the motion measurement sensor is an acceleration sensor, and

the coordinate system calculation unit computes a smoothed traveling direction obtained by smoothing traveling directions of the virtual object display device which have been calculated based on signals from the acceleration sensor, and makes the front direction of the inertial coordinate system follow the smoothed traveling direction so as to reset the front direction of the inertial coordinate system.

5. A virtual object display device, comprising:

a display;

a display control device configured to perform display control of the display, the display control device including:

a coordinate system calculation unit configured to detect a movement amount and a rotation amount of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and

a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view; and

an in-camera connected to the display control device to capture an image of a user wearing the virtual object display device, wherein

the coordinate system calculation unit recognizes a trunk region of the user based on the image captured by the in-camera, and matches a front direction of the inertial coordinate system with a front direction of the trunk region so as to reset the front direction of the inertial coordinate system.

6. A virtual object display device, comprising:

a display;

a display control device configured to perform display control of the display, the display control device including:

a coordinate system calculation unit configured to detect a movement amount and a rotation amount of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and

a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view; and

a coordinate system information storage unit configured to store a front direction of the inertial coordinate system, wherein

the coordinate system information storage unit stores therein a direction that was set in the virtual object display device as the front direction at a last time, and

when a main power of the virtual object display device is turned on, the coordinate system calculation unit resets the front direction stored in the coordinate system information storage unit as the front direction of the inertial coordinate system.

7. A virtual object display device, comprising:

a display;

a display control device configured to perform display control of the display, the display control device including:

a coordinate system calculation unit configured to detect a movement amount and a rotation amount of the virtual object display device in a real world, and use an inertial coordinate system in which a coordinate origin thereof follows movement of the virtual object display device and an effective field of view of the display is rotated therein in accordance with rotation of the virtual object display device so as to define an arrangement position of an inertial coordinate system virtual object; and

a display control unit configured to, when the inertial coordinate system virtual object is included in the effective field of view of the display, display the inertial coordinate system virtual object within the effective field of view; and

an acceleration sensor connected to the display control device to measure acceleration of the virtual object display device, wherein

the coordinate system calculation unit computes a smoothed position obtained by smoothing positions of the virtual object display device which have been calculated based on signals from the acceleration sensor so as to reset an origin of the inertial coordinate system on the smoothed position.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2021
From: HASHIMOTO, YASUNOBU; TAKAMIZAWA, NAOHISA; SHIMIZU, HIROSHI
To: MAXELL, LTD.
Reel/Frame 056953/0146 →
Continuity (1)
Related Publication 20220091663A1 · Mar 24, 2022