IP Library Granted Patent US 10,679,396
Granted Patent B2
US 10,679,396 · App. 16/035,280 · Granted Jun 9, 2020

Holographic multi avatar training system interface and sonification associative training

Inventors: Jeffrey Thielen (Lino Lakes, MN); Andrew John Blaylock (Minneapolis, MN)
Assignee: Visyn Inc.
G06T13/40G06F3/017G06F3/167G06T19/006G06T19/20G09B5/06G09B5/065G09B19/0038G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,679,396
App. No.
16/035,280
Granted
Jun 9, 2020
Kind
B2
Abstract

A system or method for training may display a student avatar and an expert avatar. A method may include capturing movement of a user attempting a technique, and generating a student avatar animation from the captured movement. The method may include retrieving a 3D expert avatar animation corresponding to the technique. The method may include displaying the 3D student avatar animation and the 3D expert avatar animation. For example, the animations may be displayed concurrently.

Claims (38)

1. A system comprising:

a sensor to capture movement of a user attempting a technique;

a processor, coupled to memory, the memory including instructions, which when executed by the processor, cause the processor to:

generate a 3D student avatar animation from the captured movement; and

retrieve a 3D expert avatar animation corresponding to the technique; and

a display device to display the 3D student avatar animation and the 3D expert avatar animation concurrently;

wherein the processor is further caused to receive a user adjustment, separate from the captured movement of the user attempting the technique, the user adjustment modifying a distance between a reference point of the 3D student avatar animation and a reference point of the 3D expert avatar animation for displaying the 3D student avatar animation and the 3D expert avatar animation concurrently on the display device, and wherein the display device is further configured, in response to receiving the user adjustment, to move an entirety of one of the 3D student avatar animation or the 3D expert avatar animation according to the user adjustment to the distance to cause the user adjustment to the distance to be displayed.

2. The system of claim 1 , wherein the display device is a mixed reality device configured to display the 3D student avatar animation and the 3D expert avatar animation as holograms.

3. The system of claim 1 , wherein the instructions further cause the processor to automatically align the 3D student avatar animation and the 3D expert avatar animation by modifying at least one of a duration, a direction, or a physical size of the 3D student avatar animation or the 3D expert avatar animation.

4. The system of claim 1 , wherein the instructions further cause the processor to modify an avatar brightness level of the 3D student avatar animation or the 3D expert avatar animation before outputting the 3D student avatar animation and the 3D expert avatar animation to the display device for display.

5. The system of claim 4 , wherein to modify the avatar brightness level, the instructions further cause the processor to modify a brightness or salience for a skin layer, a muscle layer, or a skeletal layer of the 3D student avatar animation or the 3D expert avatar animation.

6. The system of claim 1 , further comprising a microphone to capture a voice control, the voice control indicating a playback control of the 3D student avatar animation or the 3D expert avatar animation.

7. The system of claim 1 , wherein the system further comprises a camera to capture a gesture, the gesture indicating a playback control of the 3D student avatar animation or the 3D expert avatar animation.

8. The system of claim 1 , wherein the display device is to display the 3D student avatar animation and the 3D expert avatar animation with a visual differentiation.

9. The system of claim 8 , wherein the visual differentiation includes a first color for the 3D student avatar animation and a second color for the 3D expert avatar animation.

10. A method comprising:

capturing, using a sensor, movement of a user attempting a technique;

generating, using a processor, a 3D student avatar animation from the captured movement;

retrieving a 3D expert avatar animation corresponding to the technique;

displaying the 3D student avatar animation and the 3D expert avatar animation concurrently;

receiving a user adjustment, separate from the captured movement of the user attempting the technique, the user adjustment modifying a distance between a reference point of the 3D student avatar animation and a reference point of the 3D expert avatar animation for displaying the 3D student avatar animation and the 3D expert avatar animation concurrently on the display device; and

moving, in response to receiving the user adjustment, an entirety of one of the 3D student avatar animation or the 3D expert avatar animation according to the user adjustment to the distance to cause the user adjustment to the distance to be displayed.

11. The method of claim 10 , wherein displaying the 3D student avatar animation and the 3D expert avatar animation concurrently includes displaying the 3D student avatar animation and the 3D expert avatar animation as holograms using a mixed reality device.

12. The method of claim 10 , further comprising automatically aligning the 3D student avatar animation and the 3D expert avatar animation by modifying at least one of a duration, a direction, or a physical size of the 3D student avatar animation or the 3D expert avatar animation.

13. The method of claim 10 , further comprising modifying an avatar brightness level of the 3D student avatar animation or the 3D expert avatar animation before displaying the 3D student avatar animation and the 3D expert avatar animation.

14. The method of claim 13 , wherein modifying the avatar brightness level includes modifying a brightness or salience for a skin layer, a muscle layer, or a skeletal layer of the 3D student avatar animation or the 3D expert avatar animation.

15. The method of claim 10 , further comprising capturing a gesture or a voice control, the gesture or the voice control indicating a playback control of the 3D student avatar animation or the 3D expert avatar animation.

16. The method of claim 10 , wherein the 3D student avatar animation and the 3D expert avatar animation are displayed with a visual differentiation.

17. The method of claim 16 , wherein the visual differentiation includes a first color for the 3D student avatar animation and a second color for the 3D expert avatar animation.

18. A non-transitory machine-readable medium including instructions, which when executed by a processor, cause the processor to perform operations to:

capture movement of a user attempting a technique;

generate a 3D student avatar animation from the captured movement;

retrieve a 3D expert avatar animation corresponding to the technique;

display the 3D student avatar animation and the 3D expert avatar animation concurrently;

receive a user adjustment, separate from the captured movement of the user attempting the technique, the user adjustment modifying a distance between a reference point of the 3D student avatar animation and a reference point of the 3D expert avatar animation for displaying the 3D student avatar animation and the 3D expert avatar animation concurrently on the display device; and

move, in response to receiving the user adjustment, an entirety of one of the 3D student avatar animation or the 3D expert avatar animation according to the user adjustment to the distance to cause the user adjustment to the distance to be displayed.

19. The non-transitory machine-readable medium of claim 18 , wherein the instructions to display the 3D student avatar animation and the 3D expert avatar animation concurrently include instructions to display the 3D student avatar animation and the 3D expert avatar animation as holograms using a mixed reality device.

20. The non-transitory machine-readable medium of claim 18 , wherein the instructions further cause the processor to: automatically align the 3D student avatar animation and the 3D expert avatar animation by modifying at least one of a duration, a direction, or a physical size of the 3D student avatar animation or the 3D expert avatar animation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2018
From: THIELEN, JEFFREY; BLAYLOCK, ANDREW JOHN
To: VISYN INC.
Reel/Frame 047293/0890 →
Continuity (3)
Provisional Application 62678073 · May 30, 2018
Provisional Application 62532120 · Jul 13, 2017
Related Publication 20190019321A1 · Jan 17, 2019
Cited By (1)
US 12,481,361