Camera based interaction and instruction
View Patent ↗Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.
1. Instructional method comprising the steps of:
providing a display;
providing at least one TV camera to observe a first person, said camera having an output;
providing a computer;
analyzing said camera output with said computer to determine information concerning location or movement of a plurality of points relating to said first person;
using a computer, deriving from said location information a suggested pose; and
displaying said suggested pose to said first person.
2. A method according to claim 1 , including the further step of obtaining and displaying a video image of said first person.
3. A method according to claim 2 , wherein said information and said image are transmitted to a remote display for viewing by a second person.
4. A method according to claim 3 , wherein said second person assists in deriving said suggested pose.
5. A method according to claim 1 , wherein said pose is a static pose.
6. A method according to claim 1 , wherein said pose is a motion sequence.
7. A method according to claim 1 , wherein said pose is a sequence of poses.
8. A method according to claim 1 , wherein the suggested pose images are displayed.
9. A method according to claim 1 , wherein pose images are displayed from remote sources.
10. A method according to claim 1 , including the further step of providing audio suggestions to said first person.
11. A method according to claim 1 , wherein said suggested pose is displayed on a substantially life size display in order to provide realism to the instruction.
12. A method of coordinated human interaction with displayed image information comprising the steps of:
providing a computer;
providing at least one TV camera to observe a first person undertaking a movement or location based activity, said camera having an output;
providing a display to display image information to said first person;
using said computer, determining from said camera output movement or location data concerning a plurality of points of said first person;
analyzing said data using said computer; and
as a result of said analysis, displaying an image of at least one further person on said display.
13. A method according to claim 12 , wherein said displayed further person image is that of a partner.
14. A method according to claim 12 , wherein said further person displayed image is that of a person to be emulated.
15. A method according to claim 12 , including the further step of providing audio information to said first person.
16. A method according to claim 12 , wherein said display is a substantially life size display in order to provide a realism to said first person.
17. A method according to claim 12 , including the further step of controlling the apparent position of said further second person displayed as a function of the actual position of the first person with respect to the display.
18. A method according to claim 12 , including the further step of transmitting said further person image from a remote source.
19. A method according to claim 12 , wherein a mirrored image corresponding to the first person is displayed.
20. A method according to claim 12 , wherein said data concerns the relationship of said first person to other persons or their surroundings.