IP Library Granted Patent US 10,025,105
Granted Patent B2
US 10,025,105 · App. 15/019,339 · Granted Jul 17, 2018

Display control apparatus, display control method, and recording medium for a head mounted display

Inventors: Nicolas Doucet (Yokohama, JP); Yutaka Yokokawa (Kanagawa, JP); Masafumi Noda (Tokyo, JP); Takumi Yoshida (Tokyo, JP); Keiichiro Ishihara (Tokyo, JP); Gento Morita (Tokyo, JP); Yuki Miyamae (Tokyo, JP); Ngo Tuyen Thibaud (Tokyo, JP); Kazutomo Sasaki (Kanagawa, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G02B27/0179A63F13/211A63F13/212A63F13/26A63F13/40A63F13/825A63F13/95G02B27/017G02B27/0172G06F3/011A63F2300/308G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,025,105
App. No.
15/019,339
Granted
Jul 17, 2018
Kind
B2
Abstract

A display control apparatus includes: a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user; an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user; an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block. The image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus.

Claims (48)

1. A display control apparatus comprising:

a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user;

an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user,

wherein the input apparatus comprises a light emitting section on a body of the input apparatus for emitting light in a color assigned to the input apparatus by the display control apparatus, and

wherein the input apparatus information acquisition block acquires the position of the input apparatus using the assigned color;

an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and

an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block,

wherein the image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus,

wherein the input apparatus information acquisition block acquires information associated with a position of the input apparatus acquired on a basis of an image of the input apparatus taken by an imaging apparatus, and,

wherein, if the image of input apparatus cannot be imaged by the imaging apparatus, the image of the input apparatus is displayed using information obtained from an attitude sensor of the input apparatus,

wherein the attitude sensor comprises a gyro sensor, an acceleration sensor, and an angular acceleration sensor.

2. The display control apparatus according to claim 1 , wherein

the image generation block changes a position of the input apparatus that is displayed in the image as a position of the input apparatus changes and,

if the position of the input apparatus in the image deviates from a predetermined range, notifies the user thereof.

3. The display control apparatus according to claim 1 , wherein

the input apparatus information acquisition block acquires information associated with an attitude of the input apparatus from the imaging apparatus or the attitude sensor, and

on a basis of the attitude of the input apparatus, the image generation block changes the attitude of the input apparatus to be displayed in the image.

4. The display control apparatus according to claim 1 , wherein,

as flick operations are applied to a touch pad of the input apparatus by the user which are acquired by the instruction input acquisition block, the image generation block changes an image of the input apparatus displayed in the image to depict each flick operation being performed as an object coming out of the image of the input apparatus in a direction of each flick operation.

5. The display control apparatus according to claim 1 , wherein

the head mounted display information acquisition block further acquires information associated with an attitude of the head mounted display, and

the image generation block determines a sightline direction for generating the image on a basis of the attitude of the head mounted display.

6. The display control apparatus according to claim 1 , wherein, if a second apparatus is used concurrently with the input apparatus, the display control apparatus causes a light emitting section of the second input apparatus to emit a second color different than the color assigned to the input apparatus.

7. The display control apparatus according to claim 1 , further comprising

a digital camera for acquiring an image of an environment surrounding the input apparatus,

wherein the color assigned to the light emitting section is assigned by a) analyzing the image to determine a percentage of each color in the image and b) selecting a color having a percentage less than a threshold amount as the color assigned to the light emitting section.

8. A display control method for a computer, comprising:

acquiring information indicative of a position of a head mounted display worn on a head of a user;

acquiring information indicative of a position of an input apparatus for use by the user,

wherein the input apparatus comprises a light emitting section on a body of the input apparatus for emitting light in a color assigned to the input apparatus by the computer, and

wherein the assigned color is used to determine the position of the input;

acquiring information indicative of an instruction entered in the input apparatus;

generating an image to be displayed on the head mounted display on the basis of an acquired instruction;

acquiring information associated with a position of the input apparatus acquired on a basis of an image of the input apparatus taken by an imaging apparatus

displaying an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus,

wherein, if the image of input apparatus cannot be imaged by the imaging apparatus, the image of the input apparatus is displayed using information obtained from an attitude sensor of the input apparatus,

wherein the attitude sensor comprises a gyro sensor, an acceleration sensor, and an angular acceleration sensor.

9. A non-transitory computer-readable recording medium recording a display control program for a computer, the program comprising:

by a head mounted display information acquisition block, acquiring information indicative of a position of a head mounted display worn on a head of a user;

by an input apparatus information acquisition block, acquiring information indicative of a position of an input apparatus for use by the user,

wherein the input apparatus comprises a light emitting section on a body of the input apparatus for emitting light in a color assigned to the input apparatus by the computer, and

wherein the input apparatus information acquisition block acquires the position of the input apparatus using the assigned color;

by an instruction input acquisition block, acquiring information indicative of an instruction entered in the input apparatus; and

by an image generation block, generating an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block,

wherein the image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus,

wherein the input apparatus information acquisition block acquires information associated with a position of the input apparatus acquired on a basis of an image of the input apparatus taken by an imaging apparatus, and,

wherein, if the image of input apparatus cannot be imaged by the imaging apparatus, the image of the input apparatus is displayed using information obtained from an attitude sensor of the input apparatus,

wherein the attitude sensor comprises a gyro sensor, an acceleration sensor, and an angular acceleration sensor.

Assignments (2)
CHANGE OF NAME Recorded Apr 4, 2018
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 045434/0938 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2016
From: DOUCET, NICOLAS; YOKOKAWA, YUTAKA; NODA, MASAFUMI; YOSHIDA, TAKUMI; ISHIHARA, KEIICHIRO; MORITA, GENTO; MIYAMAE, YUKI; THIBAUD, NGO TUYEN; SASAKI, KAZUTOMO
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 037696/0434 →
Priority Claims (1)
JP 2015-039075 · Feb 27, 2015 · national
Continuity (1)
Related Publication 20160252729A1 · Sep 1, 2016