IP Library Granted Patent US 9,721,396
Granted Patent B2
US 9,721,396 · App. 15/286,084 · Granted Aug 1, 2017

Computer and computer system for controlling object manipulation in immersive virtual space

Inventor: Naruatsu Baba (Tokyo, JP)
Assignee: COLOPL, Inc.
G06T19/20A63F13/211A63F13/213A63F13/25A63F13/26A63F13/428A63F13/525G02B27/017G06F3/005G06F3/01G06F3/012G06F3/013G06F3/033G06F3/0416G06F3/0484G06T19/006A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,721,396
App. No.
15/286,084
Granted
Aug 1, 2017
Kind
B2
Abstract

Action of a head around which an HMD main body is worn is related to manipulation of an object in an immersive three-dimensional virtual space. Information on a sight in a virtual space may be determined based on information on head inclination sensed with an inclination sensor; an image of the sight in the virtual space may be generated based on the sight information in order to display the sight image in the head mounted display; an object placed on a reference sight line in the virtual space may be identified, the reference sight line being determined in correspondence with a predetermined position in the sight image; and an object the identified object may be manipulated in response to the identification of the object in accordance with action of inclining in a predetermined direction the head around which the head mounted display is worn.

Claims (26)

1. A computer comprising a CPU and a memory having a computer program stored therein wherein the computer program, when executed by the CPU causes the CPU to perform operations comprising:

determining information on a sight in a three-dimensional virtual space based on three-dimensional virtual space information stored in the memory and information on inclination sensed with an inclination sensor provided in a head mounted display connected to the computer;

generating an image of the sight in the three-dimensional virtual space based on the sight information in order to display the sight image in the head mounted display;

identifying an object in the generated sight image placed on a reference sight line in the generated sight image in the three-dimensional virtual space, the reference sight line being determined in correspondence with a predetermined position in the generated sight image; and

manipulating the identified object in the three-dimensional virtual space in accordance with action of inclining the head mounted display in a predetermined direction.

2. The computer according to claim 1 , wherein the determining sight information based further on information on a position of the head mounted display that is sensed with a position sensor connected to the computer and capable of sensing the head mounted display.

3. The computer according to claim 1 , wherein in a case where a plurality of objects are placed on the reference sight line, the identifying an object in the generated sight image comprises selecting an object closest to a point of view in the three-dimensional virtual space.

4. The computer according to claim 1 , wherein the predetermined position is set at a central point of the sight image.

5. The computer according to claim 1 , wherein the predetermined direction is a vertical direction.

6. The computer according to claim 1 , wherein the manipulating the identified object in the three-dimensional virtual space comprises manipulating the identified object in cooperation with an external controller connectable to the computer.

7. The computer according to claim 6 , wherein the external controller includes a touch display, and the manipulation performed on the identified object in cooperation with the external controller is performed in accordance with touch action including any of tapping, swiping, and holding performed on the touch display.

8. A computer system comprising a computer and a head mounted display connected to the computer and including an inclination sensor,

wherein the computer is configured to perform operations comprising:

determining information on a sight in a three-dimensional virtual space based on stored three-dimensional virtual space information and information on inclination sensed with the inclination sensor,

generating an image of the sight in the three-dimensional virtual space based on the sight information in order to display the sight image in the head mounted display,

identifying an object in the generated sight image placed on a reference sight line in the generated sight image in the three-dimensional virtual space, the reference sight line being determined in correspondence with a predetermined position in the generated sight image, and

manipulating the identified object in the three-dimensional virtual space in accordance with action of inclining the head mounted display in a predetermined direction.

9. The computer system according to claim 8 , further comprising a position sensor connected to the computer and capable of sensing the head mounted display,

wherein the sight information is determined based further on information on a position of the head mounted display sensed with the position sensor.

10. The computer system according to claim 8 , further comprising an external controller connectable to the computer,

wherein the manipulation performed on the identified object is performed in accordance with touch action performed on a touch display provided in the external controller.

11. A non-transitory computer-readable medium having a computer program stored therein, the computer program when read and executed by a processor causing the processor to perform operations comprising:

determining information on a sight in a three-dimensional virtual space based on stored three-dimensional virtual space information and information on sensed inclination of a head mounted display;

generating an image of the sight in the three-dimensional virtual space based on the sight information in order to display the sight image in the head mounted display;

identifying an object in the generated sight image placed on a reference sight line in the generated sight image in the three-dimensional virtual space, the reference sight line being determined in correspondence with a predetermined position in the generated sight image; and

manipulating the identified object in the three-dimensional virtual space in accordance with action of inclining the head mounted display in a predetermined direction.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2026
From: COLOPL, INC.
To: VERICON SYSTEMS LLC
Reel/Frame 074248/0125 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2016
From: BABA, NARUATSU
To: COLOPL, INC.
Reel/Frame 039947/0492 →
Priority Claims (1)
JP 2015-052897 · Mar 17, 2015 · national
Continuity (2)
Continuation PCTJP2016057822 · Mar 11, 2016
Related Publication 20170024935A1 · Jan 26, 2017