IP Library Granted Patent US 8,655,015
Granted Patent B2
US 8,655,015 · App. 13/158,003 · Granted Feb 18, 2014

Image generation system, image generation method, and information storage medium

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,655,015
App. No.
13/158,003
Granted
Feb 18, 2014
Kind
B2
Abstract

An image generation system includes an image information acquisition section that acquires image information from an image sensor, a skeleton information acquisition section that acquires skeleton information based on the image information from the image sensor, the skeleton information specifying a motion of an operator viewed from the image sensor, a correction section that performs a correction process on position information about a bone of a skeleton indicated by the skeleton information, and an image generation section that generates an image based on a result of the correction process.

Claims (57)

1. An image generation system comprising:

an image information acquisition section that acquires image information from an image sensor;

a skeleton information acquisition section that acquires skeleton information based on the image information from the image sensor, the skeleton information specifying a motion of an operator viewed from the image sensor;

a correction section that performs a correction process on position information about a bone of a skeleton indicated by the skeleton information, the correction section performing the correction process using physique information about the operator in a first mode;

an image generation section that generates an image corresponding to a result of the correction process; and

an object control section that controls an object that moves or makes a motion based on a motion of the operator, the object control section being configured to selectively control the object in the first mode by using the result of the correction process and in a second mode without using the result of the correction process,

wherein:

in the first mode, the object is controlled so that a position or moving amount of the object is identical when a first operator and a second operator have made a similar motion, the first operator having a first physique and the second operator having a second physique, the first physique being smaller than the second physique, and

in the second mode, the object is controlled so that the position or the moving amount of the object is not identical when the first operator and the second operator have made the similar motion.

2. The image generation system as defined in claim 1 ,

the correction section performing the correction process on the position information about the bone of the skeleton to obtain corrected position information;

the object control section controlling the object based on the corrected position information; and

the image generation section generating an image so that the object is displayed at a display position on a screen corresponding to the corrected position information.

3. The image generation system as defined in claim 1 ,

the object being an object that moves based on a motion of a given part of the operator.

4. The image generation system as defined in claim 3 ,

the given part being a hand of the operator, and the object being a hand object that moves based on a motion of the hand of the operator.

5. The image generation system as defined in claim 1 ,

the correction section performing the correction process so that a display position of the object when a skeleton of a first operator is in a first state is identical with a display position of the object when a skeleton of a second operator is in the first state.

6. The image generation system as defined in claim 1 , further comprising:

a game calculation section that performs a game calculation process,

the game calculation section performing the game calculation process corresponding to the result of the correction process.

7. The image generation system as defined in claim 6 ,

the game calculation section performing a game result calculation process corresponding to the result of the correction process as the game calculation process.

8. The image generation system as defined in claim 7 ,

the correction section performing the correction process on moving amount information about a position of the bone of the skeleton to obtain corrected moving amount information; and

the game calculation section performing the game result calculation process based on the corrected moving amount information.

9. The image generation system as defined in claim 1 , further comprising:

an object control section that controls an object of a character that moves or makes a motion based on a motion of the operator,

the correction section performing the correction process that changes a size of the character by a scaling factor based on a positional relationship between the character and a contact target object that is a contact target of the character.

10. The image generation system as defined in claim 9 ,

the correction section performing the correction process that adjusts a placement position of the character based on the positional relationship between the contact target object and the character.

11. The image generation system as defined in claim 1 , further comprising:

a reliability information acquisition section that acquires reliability information that indicates reliability of the skeleton information,

the image generation section generating an image corresponding to the acquired reliability information as the image displayed on the display section.

12. The image generation system as defined in claim 11 ,

the image generation section changing a display state of the image displayed on the display section based on the reliability information.

13. An image generation method comprising;

acquiring image information from an image sensor;

acquiring skeleton information based on the image information from the image sensor, the skeleton information specifying a motion of an operator viewed from the image sensor;

performing a correction process on position information about a bone of a skeleton indicated by the skeleton information, the correction process is performed using physique information about the operator in a first mode;

generating an image corresponding to a result of the correction process; and

controlling an object that moves or makes a motion based on a motion of the operator, the object control section being configured to selectively control the object in the first mode by using the result of the correction process and in a second mode without using the result of the correction process,

wherein:

in the first mode, the object is controlled so that a position or moving amount of the object is identical when a first operator and a second operator have made a similar motion, the first operator having a first physique and the second operator having a second physique, the first physique being smaller than the second physique, and

in the second mode, the object is controlled so that the position or the moving amount of the object is not identical when the first operator and the second operator have made the similar motion.

14. A non-transitory computer-readable information storage medium storing a program that causes a computer to execute steps comprising:

acquiring image information from an image sensor;

acquiring skeleton information based on the image information from the image sensor, the skeleton information specifying a motion of an operator viewed from the image sensor;

performing a correction process on position information about a bone of a skeleton indicated by the skeleton information, the correction process is performed using physique information about the operator in a first mode;

generating an image corresponding to a result of the correction process; and

controlling an object that moves or makes a motion based on a motion of the operator, the object control section being configured to selectively control the object in the first mode by using the result of the correction process and in a second mode without using the result of the correction process,

wherein:

in the first mode, the object is controlled so that a position or moving amount of the object is identical when a first operator and a second operator have made a similar motion, the first operator having a first physique and the second operator having a second physique, the first physique being smaller than the second physique, and

in the second mode, the object is controlled so that the position or the moving amount of the object is not identical when the first operator and the second operator have made the similar motion.

15. The image generation system as defined in claim 1 , wherein the correction section corrects position information about a distal bone of a skeleton indicated by the skeleton information so as to extend a reach of the character.

16. The image generation method as defined in claim 13 , wherein the correction section corrects position information about a distal bone of a skeleton indicated by the skeleton information so as to extend a reach of the character.

Assignments (3)
CHANGE OF NAME Recorded Mar 16, 2016
From: BANDAI NAMCO GAMES INC.
To: BANDAI NAMCO ENTERTAINMENT INC.
Reel/Frame 038104/0788 →
CHANGE OF NAME Recorded Jun 11, 2014
From: NAMCO BANDAI GAMES INC.
To: BANDAI NAMCO GAMES INC.
Reel/Frame 033134/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2011
From: NISHIMOTO, YASUHIRO; KOZASA, CHIHIRO; SAKAKIBARA, TADASHI; SEKIOKA, DAISUKE
To: NAMCO BANDAI GAMES INC.
Reel/Frame 026437/0096 →