IP Library Granted Patent US 10,850,177
Granted Patent B2
US 10,850,177 · App. 16/070,382 · Granted Dec 1, 2020

Virtual environment construction apparatus, method, and computer readable medium

Inventors: Kosuke Takahashi (Yokosuka, JP); Dan Mikami (Yokosuka, JP); Mariko Isogawa (Yokosuka, JP); Akira Kojima (Yokosuka, JP); Hideaki Kimata (Yokosuka, JP); Ayumi Matsumoto (Yokosuka, JP)
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
A63B69/0002G06F17/18G06T19/00G06T19/006A63B2069/0006A63B2069/0008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,850,177
App. No.
16/070,382
Granted
Dec 1, 2020
Kind
B2
Abstract

Preliminary experience of a match at a player's perspective is enabled. A virtual environment material storage 13 has stored therein virtual environment materials for reproducing a dynamic object and a static object on a virtual environment. A dynamic object sensing unit 11 chronologically measures a position and a posture of the dynamic object in a real environment and generates position and posture information composed of one movement action. A presentation sequence acquisition unit 17 obtains a presentation sequence including position and posture information of a plurality of different kinds of dynamic objects. A virtual environment construction unit 14 synthesizes a virtual environment material of the dynamic object and a virtual environment material of the static object based on the presentation sequence to construct the virtual environment.

Claims (44)

1. A virtual reality system that includes a virtual environment construction apparatus that constructs a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the virtual reality system comprising:

the virtual environment construction apparatus which includes circuitry configured to:

generate a presentation sequence representing a time series of scenes to be presented to the user based on a probability combining a prior probability of a scene of the flying object with dynamics representing connection between a plurality of scenes,

decide a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence,

decide a presentation action representing a motion of the other party corresponding to each scene included in the presentation sequence, and

synthesize the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action; and

a virtual reality head mounted display which presents a video to the user based on the synthesized virtual environment constructed by the virtual environment construction apparatus.

2. A virtual reality system that includes a virtual environment construction apparatus that constructs a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the virtual reality system comprising:

the virtual environment construction apparatus which includes circuitry configured to:

generate a presentation sequence representing a time series of scenes to be presented to the user,

decide a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence,

decide a presentation action representing a motion of the other party different from one in the real environment corresponding to each scene included in the presentation sequence, and

synthesize the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action; and

a virtual reality head mounted display which presents a video to the user based on the synthesized virtual environment constructed by the virtual environment construction apparatus.

3. The virtual environment construction apparatus according to claim 2 , wherein

the circuitry is configured to generate the presentation sequence based on a probability combining a prior probability of a scene of the flying object with dynamics representing connection between a plurality of scenes.

4. The virtual environment construction apparatus according to claim 1 or 3 , wherein

the circuitry is configured to generate the presentation sequence based on a probability combining the prior probability of the flying object with the dynamics for all of a course, a speed, and a pitch type of the flying object, and if none of trajectories of the flying object obtained from the real environment corresponds to the presentation sequence, generates the presentation sequence based on a probability combining the prior probability of the flying object with the dynamics while giving priority to one of the course, the speed, and the pitch type in accordance with a practice goal which has been predefined given a scene to be experienced by the user.

5. The virtual environment construction apparatus according to claim 1 or 3 , wherein

the circuitry is configured to generate the presentation sequence based on a probability combining the prior probability of the flying object with the dynamics for all of a plurality of parameters relating to flying of the flying object, and if none of trajectories of the flying object obtained from the real environment corresponds to the presentation sequence, generates the presentation sequence based on a probability combining the prior probability of the flying object with the dynamics while giving priority to some of the plurality of parameters in accordance with a practice goal which has been predefined given a scene to be experienced by the user.

6. A virtual environment construction method for constructing a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the virtual environment construction method comprising:

generating, by circuitry of a virtual environment construction apparatus, a presentation sequence representing a time series of scenes to be presented to the user based on a probability combining a prior probability of a scene of the flying object with dynamics representing connection between a plurality of scenes by circuitry of a virtual environment construction apparatus;

deciding, by the circuitry, a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence by the circuitry of the virtual environment construction apparatus;

deciding, by the circuitry, a presentation action representing a motion of the other party corresponding to each scene included in the presentation sequence by the circuitry of the virtual environment construction apparatus;

synthesizing, by the circuitry, the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action by the circuitry of the virtual environment construction apparatus; and

presenting, by a virtual reality head mounted display, a video to the user based on the synthesized virtual environment.

7. A virtual environment construction method for constructing a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the virtual environment construction method comprising:

generating, by circuitry of a virtual environment construction apparatus, a presentation sequence representing a time series of scenes to be presented to the user by circuitry of a virtual environment construction apparatus;

deciding, by the circuitry, a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence by the circuitry of the virtual environment construction apparatus;

deciding, by the circuitry, a presentation action representing a motion of the other party different from one in the real environment corresponding to each scene included in the presentation sequence by the circuitry of the virtual environment construction apparatus;

synthesizing, by the circuitry, the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action by the circuitry of the virtual environment construction apparatus; and

presenting, by a virtual reality head mounted display, a video to the user based on the synthesized virtual environment.

8. A non-transitory computer readable medium including computer executable instructions that make a virtual reality system that includes a virtual environment construction apparatus perform a method for a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the method comprising:

generating, by circuitry of the virtual environment construction apparatus, a presentation sequence representing a time series of scenes to be presented to the user based on a probability combining a prior probability of a scene of the flying object with dynamics representing connection between a plurality of scenes;

deciding, by the circuitry, a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence;

deciding, by the circuitry, a presentation action representing a motion of the other party corresponding to each scene included in the presentation sequence;

synthesizing, by the circuitry, the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action; and

presenting, by a virtual reality head mounted display, a video to the user based on the synthesized virtual environment.

9. A non-transitory computer readable medium including computer executable instructions that make a virtual reality system that includes a virtual environment construction apparatus perform a method for constructing a virtual environment to be used for generating a video based on a real environment in which another party launches a flying object, the method comprising:

generating, by circuitry of the virtual environment construction apparatus, a presentation sequence representing a time series of scenes to be presented to the user;

deciding, by the circuitry, a presentation trajectory representing a motion of the flying object corresponding to each scene included in the presentation sequence;

deciding, by the circuitry, a presentation action representing a motion of the other party different from one in the real environment corresponding to each scene included in the presentation sequence;

synthesizing, by the circuitry, the virtual environment to be experienced by the user based on the presentation trajectory and the presentation action; and

presenting, by a virtual reality head mounted display, a video to the user based on the synthesized virtual environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2018
From: TAKAHASHI, KOSUKE; MIKAMI, DAN; ISOGAWA, MARIKO; KOJIMA, AKIRA; KIMATA, HIDEAKI; MATSUMOTO, AYUMI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 046358/0574 →
Priority Claims (6)
JP 2016-014487 · Jan 28, 2016 · national
JP 2016-014488 · Jan 28, 2016 · national
JP 2016-107729 · May 30, 2016 · national
JP 2016-107730 · May 30, 2016 · national
JP 2016-171420 · Sep 2, 2016 · national
JP 2016-212800 · Oct 31, 2016 · national
Continuity (1)
Related Publication 20190022492A1 · Jan 24, 2019