IP Library Granted Patent US 10,360,814
Granted Patent B2
US 10,360,814 · App. 15/104,385 · Granted Jul 23, 2019

Motion learning support apparatus

Inventors: Hideyuki Ando (Osaka, JP); Taro Maeda (Osaka, JP); Daisuke Kondo (Osaka, JP); Kazutaka Obama (Kyoto, JP); Hiroyuki Izuka (Hokkaido, JP)
Assignee: Japan Science and Technology Agency
G09B23/285G09B5/02A61B5/1124A61B5/16A61B5/162A61B5/4082A63B71/06G06F3/04883G06T11/203G09B11/04G09B15/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,360,814
App. No.
15/104,385
Granted
Jul 23, 2019
Kind
B2
Abstract

A motion learning support apparatus displays a teaching-aid video segment and a segment of practice video of a learner alternately on a monitor, the practice video being of the learner who is imitating a motion of the teaching-aid video segment and being taken with an imaging unit. The motion learning support apparatus includes: motion detection unit to detect a motion of the learner and a motion information acquisition unit; an evaluation unit to evaluate similarity of a motion of the learner to a motion in the teaching-aid video segment; and first learning support processing unit to, when the evaluation unit evaluates that the motions are similar, switch the monitor from video taken with the imaging unit to a following teaching-aid video segment. Thereby, vividness of an image due to the illusion effect induced to the learner can be improved, and so the learning effect can be improved for supporting.

Claims (33)

1. A motion learning support apparatus for laparoscopic surgery training, comprising:

a dry box that imitates a patient's body;

a base on which the dry box is placed;

a motion detection unit;

a monitor that displays an image; and

an information processing device,

wherein the dry box comprises:

a tubular body imitating an abdomen of the patient's body;

a laparoscopic camera; and

a forceps,

wherein, on the upper surface of the tubular body, a plurality of circular holes are provided on membranes having cross-shaped cuttings for inserting and removing the forceps and the laparoscopic camera;

wherein the laparoscopic camera is fixed to the dry box and captures movement of a tip of the forceps of a model person and a learner for suturing;

wherein the motion detection unit comprises:

a magnetic generator attached to the base; and

magnetic sensors attached in three axial directions at predetermined positions of the forceps;

wherein the motion detection unit detects motion information including a position, orientation, and displacement speed of the tip of the forceps;

wherein the information processing device comprises:

an operation unit;

a RAM;

a ROM; and

a control unit;

wherein the operation unit accepts instructions including teaching-aid display mode switching input by the learner;

wherein the RAM comprises:

a learning-by-following teaching-aid storage unit for storing an image of movement of a tip of the forceps of the model person; and

a procedure learning teaching-aid storage unit for storing segments of a teaching-aid video obtained by dividing the image of the movement of the tip of the forceps of the model person;

wherein the control unit, when a program stored in the ROM is executed, functions as an evaluation unit, a procedure learning video display processing unit, and a learning-by-following video display processing unit;

wherein the evaluating unit calculates a difference between the motion information of the tip of the forceps of the learner detected by the motion detection unit at a time point corresponding to just before an end of one segment of the teaching-aid video and the motion information of the tip of the forceps of the model person at a time point immediately after a start of a next segment of the teaching-aid video, and evaluates as to whether or not the difference is within a predetermined threshold value;

wherein the procedure learning video display processing unit replays one segment of the teaching-aid video in response to an instruction from the learner in procedural learning mode, and whenever the replay is completed, switches an image on the monitor to an image of the laparoscopic camera capturing the movement of the tip of the forceps of the learner; then, if evaluation result by the evaluation unit is within the predetermined threshold value, automatically switches the image on the monitor to the next segment of the teaching-aid video; and, if the evaluation result is larger than the predetermined threshold value, waits for an instruction from the learner to display the next segment of the teaching-aid video; and

wherein the learning-by-following video display processing unit, in response to an instruction from the learner in learning-by-following mode, time-divisionally displays the teaching-aid video of the learning-by-following teaching-aid storage unit and the image of the laparoscopic camera of the learner, from a same viewpoint and in frequency of approximately 2 Hz to 4 Hz and in the learner-to-the model person ratio from 1:1 to 1:3 alternately.

2. The motion learning support apparatus according to claim 1 , wherein, in place of the magnetic generator and the magnetic sensors of the motion detection unit, a three-dimensional acceleration sensor is provided at the tip of the forceps.

3. The motion learning support apparatus according to claim 1 , wherein, in place of the motion information including a position, orientation, and displacement speed of the tip of the forceps detected by the magnetic generator and the magnetic sensors of the motion detection unit, a motion information including a position, orientation, and displacement speed of the tip of the forceps calculated from an image captured by the laparoscopic camera are used.

4. The motion learning support apparatus according to claim 2 , wherein the motion detection unit detects displacement acceleration in addition to the position, the orientation, and the displacement speed of the tip of the forceps.

5. The motion learning support apparatus according to claim 3 , wherein the motion detection unit detects displacement acceleration in addition to the position, the orientation, and the displacement speed of the tip of the forceps.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE THIRD INVENTOR PREVIOUSLY RECORDED ON REEL 038993 FRAME 0706. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 6, 2016
From: ANDO, HIDEYUKI; MAEDA, TARO; KONDO, DAISUKE; OBAMA, KAZUTAKA; IZUKA, HIROYUKI
To: JAPAN SCIENCE AND TECHNOLOGY AGENCY
Reel/Frame 039265/0148 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE FOURTH INVENTOR PREVIOUSLY RECORDED ON REEL 038993 FRAME 0706. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 6, 2016
From: ANDO, HIDEYUKI; MAEDA, TARO; KONDO, DAISUKE; OBAMA, KAZUTAKA; IZUKA, HIROYUKI
To: JAPAN SCIENCE AND TECHNOLOGY AGENCY
Reel/Frame 039265/0175 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2016
From: ANDO, HIDEYUKI; MAEDA, TARO; KONDO, DAISUKE; OBAMA, KUZUTAKA; IZUKA, HIROYUKI
To: JAPAN SCIENCE AND TECHNOLOGY AGENCY
Reel/Frame 038993/0706 →
Continuity (1)
Related Publication 20160314713A1 · Oct 27, 2016
Cited By (2)
US 1,093,426 US 1,093,427