IP Library › Granted Patent US 11,081,015
Granted Patent B2
US 11,081,015 · App. 15/430,798 · Granted Aug 3, 2021

Training device, training method, and program

Inventors: Yuya Maruyama (Chino, JP); Hideki Tanaka (Chino, JP)
G09B5/02G06F3/015G09B23/28G02B27/017G02B2027/014G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,081,015
App. No.
15/430,798
Filed
Feb 13, 2017
Granted
Aug 3, 2021
Kind
B2
Art Unit
3715
USPC
434/308
Abstract

A training device, which is used to cause a user to be trained to operate an extra part based on a measurement result of user's brain activity, notifies the user of information indicating a degree of activation of a brain area corresponding to the extra part, as information indicating the state of the brain activity of the user who imagines trying to operate the extra part.

Claims (39)

1. A training device comprising:

a sensor configured to:

detect one of an electrical signal, a magnetic signal, an electro-magnetic signal, or an optical signal indicating an amount of a blood flow or a cell ignition in brain areas of a brain of a user; and

output a sensor result based on the detected signal;

a memory configured to store the sensor result and computer-readable instructions;

a display configured to display a notification image and a user activity image, the user activity image showing an extra part shown overlapping a first actual body part of the user, and showing a second actual body part of the user;

a stimulation device configured to generate a vibration, the stimulation device being configured to be attached to the second actual body part of the user, the stimulation device being configured to apply the vibration to the second actual body part of the user; and

a processor configured to execute the computer-readable instructions so as to:

display, on the display, the user activity image from a viewpoint that shows the extra part moving with respect to the second actual body part of the user;

determine a timing at which the extra part and the second actual body part of the user come into contact with each other in the user activity image from the viewpoint;

cause the stimulation device to generate the vibration to the second actual body part of the user when the processor determines the timing;

determine, using the sensor result, an area within the brain based on the amount of the blood flow or the cell ignition, the determined area indicating where a brain activity occurs when the user activity image is displayed; and

display (i) the notification image indicating a degree of the brain activity of the determined area in the brain based on the sensor result and (ii) the user activity image on the display together so as to show a degree of an illusion of the user, the illusion of the extra part being a part of the body of the user.

2. The training device according to claim 1 ,

wherein the training device is a head mounted display, and

the processor is configured to cause the display to display a virtual image for the user.

3. The training device according to claim 1 ,

wherein the processor is configured to cause the display to display a first image of the user activity image and a second image of the user activity image,

the processor is configured to create the first image from a viewpoint of the user, and

the processor is configured to create the second image from a viewpoint of a different person who observes the user.

4. The training device according to claim 3 ,

wherein the training device is a transparent head mounted display, and

wherein the first image is an image in which the extra part appears to be disposed relative to the body of the user.

5. The training device according to claim 1 ,

wherein the processor is configured to cause the display to display the user activity image in which the extra part appears to apply the vibration, when the vibration is applied to at least one of a tactile organ and an auditory organ of the user as the second actual body part of the user.

6. A training method for causing a processor to execute computer-readable instructions stored in a memory, the method comprising executing on the processor the steps of:

detecting one of an electrical signal, a magnetic signal, an electro-magnetic signal, or an optical signal indicating an amount of a blood flow or a cell ignition in brain areas of a brain of a user so as to output a sensor result based on the detected signal;

displaying, on a display, a user activity image showing an extra part shown as overlapping a first actual body part of the user, and showing a second actual body part of the user, the user activity image being displayed from a viewpoint that shows the extra part moving with respect to the second actual body part of the user;

determining a timing at which the extra part and the second actual body part of the user come into contact with each other in the user activity image from the viewpoint;

causing a stimulation device to generate a vibration to the second actual body part of the user when the processor determines the timing;

determining, using the sensor result, an area within the brain based on the amount of the blood flow or the cell ignition, the determined area indicating where a brain activity occurs when the user activity image is displayed; and

displaying (i) a notification image indicating a degree of the brain activity of the determined area in the brain based on the sensor result and (ii) the user activity image on the display together so as to show a degree of an illusion of the user, the illusion of the extra part being a part of the body of the user.

7. A computer program product embodying computer-readable instructions stored on a non-transitory computer-readable medium in which a program stored for causing a computer to execute a process by a processor for a training device so as to perform the steps of:

detecting one of an electrical signal, a magnetic signal, an electro-magnetic signal, or an optical signal indicating an amount of a blood flow or a cell ignition in brain areas of a brain of a user so as to output a sensor result based on the detected signal;

displaying, on a display, a user activity image showing an extra part shown as overlapping a first actual body part of the user, and showing a second actual body part of the user, the user activity image being displayed from a viewpoint that shows the extra part moving with respect to the second actual body part of the user;

determining a timing at which the extra part and the second actual body part of the user come into contact with each other in the user activity image from the viewpoint;

causing a stimulation device to generate a vibration to the second actual body part of the user when the processor determines the timing;

determining, using the sensor result, an area within the brain based on the amount of the blood flow or the cell ignition, the determined area indicating where a brain activity occurs when the user activity image is displayed; and

displaying (i) a notification image indicating a degree of the brain activity of the determined area in the brain based on the sensor result and (ii) the user activity image on the display together so as to show a degree of an illusion of the user, the illusion of the extra part being a part of the body of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2017
From: MARUYAMA, YUYA; TANAKA, HIDEKI
To: SEIKO EPSON CORPORATION
Reel/Frame 041237/0894 →
Priority Claims (1)
JP JP2016-031555 · Feb 23, 2016 · national
Continuity (1)
Related Publication 20170243499A1 · Aug 24, 2017