IP Library Granted Patent US 11,321,920
Granted Patent B2
US 11,321,920 · App. 16/648,019 · Granted May 3, 2022

Display device, display method, program, and non-temporary computer-readable information storage medium

Inventor: Hiroaki Iwase (Tokyo, JP)
Assignee: RAKUTEN GROUP, INC.
G06T19/003G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,321,920
App. No.
16/648,019
Granted
May 3, 2022
Kind
B2
Abstract

A state information storage ( 121 ) stores an observation position, an observation direction, and a base direction in a virtual space. Upon acceptance of an instruction input given to an external controller and indicating a moving direction, an observation position updater ( 112 ) updates the observation position so that the observation position moves in the moving direction indicated by the instruction input relative to the base direction. An observation direction updater ( 114 ) updates the observation direction in accordance with a change in orientation of a display apparatus ( 100 ) as detected by a detector ( 113 ). An obtainer ( 115 ) obtains a relative position between the controller and the display apparatus ( 100 ). A base direction updater ( 116 ) updates the base direction on the basis of the observation direction and of the obtained relative position.

Claims (32)

1. A display device comprising:

at least one memory configured to store computer program code;

at least one processor configured to access said computer program code and operate as instructed by the computer program code, said computer program code including:

accepting code configured to cause at least one of the at least one processor to accept an instruction input indicating a moving direction of an avatar, the instruction input being given to an external controller;

detecting code configured to cause at least one of the at least one processor to detect a change in orientation of the display device;

storing control code configured to cause at least one of the at least one processor to store an observation position based on a position of a head of the avatar, an observation direction based on a direction of an eye of the avatar, and a base direction based on a direction of a torso of the avatar in a virtual space;

observation position updating code configured to cause at least one of the at least one processor to update, upon acceptance of the instruction input, the observation position so that the observation position moves in the moving direction indicated by the instruction input relative to the base direction, even if the observation direction is different from the moving direction indicated by the instruction input relative to the base direction;

observation direction updating code configured to cause at least one of the at least one processor to update the observation direction in accordance with the detected change in orientation of the display device;

obtaining code configured to cause at least one of the at least one processor to obtain a relative position between the controller and the display device;

base direction updating code configured to cause at least one of the at least one processor to update the base direction, based on the observation direction and on the obtained relative position; and

light emitter code configured to cause at least one of the at least one processor to shine light in a predetermined pattern,

wherein the obtaining code is further configured to cause at least one of the at least one processor to obtain from the controller the relative position that is identified by the controller based on a position of the light emitter in an image taken by a camera included in the controller and on the pattern.

2. The display device according to claim 1 ,

wherein the obtaining code is configured to cause at least one of the at least one processor to obtain the relative position through detection performed by a sensor included in at least one of the controller or display device to detect another of the at least one of the controller or the display device.

3. The display device according to claim 1 ,

wherein the obtaining code is configured to cause at least one of the at least one processor to obtain the relative position estimated from a difference between a first orientation detected by a first attitude sensor included in the controller and a second orientation detected by a second attitude sensor included in the display device.

4. A display method executed by a display device that comprises a storage storing an observation position based on a position of a head of an avatar, an observation direction based on a direction of an eye of the avatar, and a base direction based on a direction of a torso of the avatar in a virtual space, the display method comprising:

accepting an instruction input indicating a moving direction of the avatar, the instruction input being given to an external controller;

detecting a change in orientation of the display device;

updating, upon acceptance of the instruction input, the observation position so that the observation position moves in the moving direction indicated by the instruction input relative to the base direction, even if the observation direction is different from the moving direction indicated by the instruction input relative to the base direction;

updating the observation direction in accordance with the detected change in orientation of the display device;

obtaining a relative position between the controller and the display device; and

updating the base direction, based on the observation direction and on the obtained relative position; and

shining light in a predetermined pattern and obtaining the relative position that is identified by the controller based on a position of the light emitted in an image taken by a camera included in the controller and on the pattern.

5. A non-temporary computer-readable information storage medium recording a program causing a computer that comprises a storage storing an observation position based on a position of a head of an avatar, an observation direction based on a direction of an eye of the avatar, and a base direction based on a direction of a torso of the avatar in a virtual space to:

accept an instruction input indicating a moving direction of the avatar, the instruction input being given to an external controller;

detect a change in orientation of a display device;

update, upon acceptance of the instruction input, the observation position so that the observation position moves in the moving direction indicated by the instruction input relative to the base direction, even if the observation direction is different from the moving direction indicated by the instruction input relative to the base direction;

update the observation direction in accordance with the detected change in orientation of the display device;

obtain a relative position between the controller and the display device; and

update the base direction, based on the observation direction and on the obtained relative position; and

shine light in a predetermined pattern and obtain the relative position that is identified by the controller based on a position of the light emitted in an image taken by a camera included in the controller and on the pattern.

Assignments (2)
CHANGE OF NAME Recorded Jul 9, 2021
From: RAKUTEN INC
To: RAKUTEN GROUP INC
Reel/Frame 056816/0068 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2020
From: IWASE, HIROAKI
To: RAKUTEN, INC.
Reel/Frame 052139/0463 →