IP Library Granted Patent US 12,175,394
Granted Patent B2
US 12,175,394 · App. 18/299,521 · Granted Dec 24, 2024

Systems and methods for computerized interactive skill training

Inventors: Martin L. Cohen (Malibu, CA); Edward G. Brown (Malibu, CA)
Assignee: Breakthrough PerformanceTech, LLC
G06Q10/06G06Q10/06398G06Q99/00G06T13/80G09B5/00G09B5/04G09B5/06G09B5/065G09B5/10G09B7/00G09B7/02G09B7/04G09B7/06G09B7/063G09B7/08G09B9/00G09B15/00G09B17/003G09B17/006G09B19/00G09B19/0046G09B19/0053G09B19/025G09B19/04G09B19/06G09B19/18G09B23/28G06T11/00H04L67/02H04M2201/38H04M2201/40H04M2201/42H04M2250/62H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,175,394
App. No.
18/299,521
Granted
Dec 24, 2024
Kind
B2
Abstract

The present invention is directed to interactive training, and in particular, to methods and systems for computerized interactive skill training. An example embodiment provides a method and system for providing skill training using a computerized system. The computerized system receives a selection of a first training subject. Several related training components can be invoked, such as reading, watching, performing, and/or reviewing components. In addition, a scored challenge session is provided, wherein a training challenge is provided to a user via a terminal, optionally in video form.

Claims (119)

1. A training system configured to train a user, comprising:

a server comprising a hardware computing device;

a network interface coupled to the server;

a tangible, non-transitory, computer-readable medium having computer-executable instructions stored thereon that, when executed by the server, cause the training system to perform operations comprising:

for a challenge, that includes a statement or question regarding a subject, instantiate a learning session and a practice session, wherein:

the learning session includes:

a first section configured to train, using text, the user in how to respond to the challenge;

generate for display on a user terminal during a first section a first user interface configured to present:

a textual representation comprising key elements presented via the first user interface;

an audio video presentation of a first animated avatar audibly presenting guideline language constructs, including key elements,

wherein lips, facial expression, and gestures of the first animated avatar are animated to provide a simulation of a human while being visually distinguishable as an animation rather than a real person and wherein the first animated avatar has lip motions at least substantially synchronized with the audibly presented key elements;

generate for display, in response to at least one user action, on the user terminal one or more user interfaces associated with a scored challenge session configured to test the user with respect to the challenge, wherein the scored challenge user interfaces comprise:

a given avatar audibly presenting the challenge, wherein the given avatar has lip motions at least substantially synchronized with the audible challenge, and wherein the user is to audibly respond to the challenge by at least presenting corresponding key elements;

a scoring interface for the challenge, the scoring interface configured to receive and/or provide scoring information comprising:

how accurately the user audibly presented the key elements corresponding to the challenge audibly presented by the avatar; and

how confident the user seemed when audibly, verbally responding to the challenge audibly presented by the given avatar.

2. The system as defined in claim 1 , wherein the system is configured to:

generate an avatar design interface that enables an avatar designer to provide an avatar specification, the avatar specification specifying for an avatar comprising:

hair style,

hair color,

skin color,

facial characteristics,

clothing,

receive the avatar specification via the avatar design interface,

generate a scene including an animation of the specified avatar with the specified avatar hair style, hair color, skin color, facial characteristics, and clothing.

3. The system as defined in claim 1 , wherein the system is further configured to use a formula to generate a cumulative score using at least:

a score related to correctness and/or completeness of the challenge response; and

a score related to how quickly the user initiated the challenge response.

4. The system as defined in claim 1 , wherein the system is configured to size and position a plurality of guideline language constructs so that they are displayed together via the user terminal.

5. The system as defined in claim 1 , wherein the system further comprises a voice recognition system configured to:

detect when the user has begun responding to the challenge,

perform voice recognition of user audible, verbal responses, and

visually emphasize respective key elements the user correctly stated and/or respective key elements the user incorrectly stated or did not state at all.

6. The system as defined in claim 1 , wherein the system further comprises a voice recognition system configured to detect when the user begins responding and convert the user's verbal challenge responses to machine readable characters, compare the machine readable characters to text corresponding to a reference version of the key elements, and determine which key elements the user correctly recited.

7. A computer implemented method, the method comprising:

generating for display a first user interface configured to present:

a textual representation comprising key elements to be used in responding to a challenge that includes a statement or question regarding a subject;

an audio video presentation of a first animated avatar audibly presenting guideline language constructs, including key elements,

wherein lips, facial expression, and gestures of first animated avatar are animated to provide a simulation of a human while being visually distinguishable as an animation rather than a real person and wherein the first animated avatar has lip motions at least substantially synchronized with the audibly presented key elements;

generating for display one or more user interfaces associated with a scored challenge session configured to test the user with respect to the challenge, wherein a scored challenge user interface includes:

an avatar audibly presenting the challenge, wherein the avatar has lip motions at least substantially synchronized with the audible challenge, and wherein the user is to audibly respond to the challenge by at least presenting corresponding key elements;

a scoring interface for the challenge, the scoring interface configured to receive and/or provide scoring information comprising:

how accurately the user audibly, verbally presented the key elements corresponding to the challenge audibly presented by the avatar; and

how confident the user seemed when audibly, verbally responding to the challenge audibly presented by the avatar.

8. The method as defined in claim 7 , the method further comprising:

generating an avatar design interface that enables an avatar designer to provide an avatar specification, the avatar specification specifying for an avatar comprising:

hair style,

hair color,

skin color,

facial characteristics,

clothing,

receiving the avatar specification via the avatar design interface; and

generating a scene including an animation of the specified avatar with the specified avatar hair style, hair color, skin color, facial characteristics, and clothing.

9. The method as defined in claim 7 , the method further comprising:

generating a cumulative score using, for a given challenge response:

a score related to correctness and/or completeness of the challenge response; and

a score related to how quickly the user initiated the challenge response.

10. The method as defined in claim 7 , the method further comprising:

sizing and positioning a plurality of guideline language constructs so that they are displayed together.

11. The method as defined in claim 7 , the method further comprising using a voice recognition system configured to:

detect when the user has begun responding to the challenge,

perform voice recognition of user audible, verbal responses, and

visually emphasize respective key elements the user correctly stated and/or respective key elements the user incorrectly stated or did not state at all.

12. The method as defined in claim 7 , the method further comprising:

detecting, using a voice recognition system, when the user audibly and verbally begins responding to the challenge and convert the user's audible and verbal challenge responses to machine readable characters;

comparing the machine readable characters to text corresponding to a reference version of the key elements; and

determining which key elements the user correctly recited.

13. A tangible, non-transitory, computer-readable medium having computer-executable instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

providing an avatar design interface that enables an avatar designer to provide an avatar specification for an avatar, the avatar specification comprising:

hair style,

hair color,

skin color,

facial characteristics,

clothing,

receiving the avatar specification via the avatar design interface;

providing a first user interface configured to present:

a textual representation comprising key elements;

providing an audio video presentation of a first animated avatar, generated using the avatar design interface, audibly presenting guideline language constructs, including key elements,

wherein lips, facial expression, and gestures of first animated avatar are animated to provide a simulation of a human and wherein the first animated avatar has lip motions at least substantially synchronized with the audibly presented key elements;

providing, for presentation on a user terminal, user interfaces associated with a scored challenge session configured to test the user with respect to a challenge, that includes a statement or question regarding a subject, wherein the scored challenge user interface includes:

an avatar audibly presenting the challenge, wherein the avatar has lip motions at least substantially synchronized with the audible challenge, and wherein the user is to audibly respond to the challenge by at least presenting corresponding key elements; and

providing a scoring interface for the challenge, the scoring interface configured to receive and/or provide at least scoring information comprising:

how accurately the user audibly presented the key elements corresponding to the challenge audibly presented by the avatar.

14. The computer-readable medium as defined in claim 13 , the operations further comprising using a formula to generate a cumulative score using, for a given challenge response, at least:

a score related to correctness and/or completeness of the challenge response; and

a score related to how quickly the user initiated the challenge response.

15. The computer-readable medium as defined in claim 13 , the operations further comprising:

detecting when the user begins responding to a given challenge;

halting a response timer in response to detecting that the user has begun responding;

performing voice recognition of user audible, verbal responses; and

bolding, illuminating, and/or emphasizing respective key elements the user correctly audibly verbalized.

16. A training system configured to train a user, comprising:

a server comprising a hardware computing device;

a network interface coupled to the server;

a tangible, non-transitory, computer-readable medium having computer-executable instructions stored thereon that, when executed by the server, cause the training system to perform operations comprising:

provide an avatar design interface that enables an avatar designer to provide an avatar specification for an avatar, the avatar specification comprising:

hair style,

hair color,

skin color,

facial characteristics,

clothing,

receive the avatar specification via the avatar design interface;

provide a first user interface configured to present:

a textual representation comprising key elements;

provide an audio video presentation of a first animated avatar, generated using the avatar design interface, audibly presenting guideline language constructs, including key elements,

wherein lips, facial expression, and gestures of first animated avatar are animated to provide a simulation of a human and wherein the first animated avatar has lip motions at least substantially synchronized with the audibly presented key elements;

generate for presentation on a user terminal one or more user interfaces associated with a scored challenge session configured to test the user with respect to a challenge that includes a statement or question regarding a subject, wherein the scored challenge user interface includes:

an avatar audibly presenting the challenge, wherein the avatar has lip motions at least substantially synchronized with the audible challenge, and wherein the user is to audibly respond to the challenge by at least presenting corresponding key elements; and

provide a scoring interface for the challenge, the scoring interface configured to receive and/or provide at least scoring information comprising:

how accurately the user audibly presented the key elements corresponding to the challenge audibly presented by the avatar.

17. The system as defined in claim 16 , wherein the system is further configured to use a formula to generate a cumulative score using at least:

a score related to correctness and/or completeness of the user's challenge response; and

a score related to how quickly the user initiated the challenge response.

18. The system as defined in claim 16 , wherein the system is configured to size and position a plurality of guideline language constructs so that they are displayed together.

19. The system as defined in claim 16 , wherein the system further comprises a voice recognition system configured to:

detect when the user has begun responding to the challenge,

perform voice recognition of user audible, verbal responses, and

visually emphasize respective key elements the user correctly stated and/or respective key elements the user incorrectly stated or did not state at all.

20. The system as defined in claim 16 , wherein the system further comprises a voice recognition system configured to detect when the user begins verbally responding to the challenge and convert the user's verbal challenge responses to machine readable characters, compare the machine readable characters to text corresponding to a reference version of the key elements, and determine which key elements the user correctly recited.

Continuity (7)
Continuation 17645568 · Dec 22, 2021
Continuation 16167045 · Oct 22, 2018
Continuation 15335182 · Oct 26, 2016
Continuation 14090278 · Nov 26, 2013
Continuation 12510868 · Jul 28, 2009
Provisional Application 61084181 · Jul 28, 2008
Related Publication 20240070565A1 · Feb 29, 2024