Systems and methods for customizing playback of digital tutorials
Systems and methods are disclosed herein for continuing playback of a digital tutorial until a user interrupts the playback by signaling to the system that there is an issue or that the user needs help. The system, through detecting a recording that the user captured or a person's utterance (e.g., through passive voice monitoring) determines that the user's needs assistance with the digital tutorial. The system determines, based on the recording, that the user needs help to get to a specific step and play supplemental instructions to the user to get to the specific step.
1. A method for modifying a tutorial in response to detecting that a step of the tutorial has not been completed, the method comprising:
playing a tutorial, wherein the tutorial comprises a plurality of steps for completing a task;
determining that a given step of the tutorial has finished playing;
based on determining that the given step of the tutorial has finished playing, accessing a captured recording showing a current progress of the task;
determining, based on the captured recording, that the task is at a different progress point than a progress point corresponding to the given step, by:
determining a type of the captured recording;
accessing database that stores a plurality of recordings corresponding to the given step;
retrieving, from the database, a set of recordings of the type of the captured recording;
comparing the captured recording with recordings in the set; and
determining, that the captured recording does not match any recording in the set; and
in response to determining that the task is at a different progress point than a progress point corresponding to the given step:
identifying a recording, wherein the recording includes instructions to bring the task from the different progress point to the progress point corresponding to the given step; and
playing the recording.
2. A method for modifying a tutorial in response to detecting that a step of the tutorial has not been completed, the method comprising:
playing a tutorial, wherein the tutorial comprises a plurality of steps for completing a task;
determining that a given step of the tutorial has finished playing;
based on determining that the given step of the tutorial has finished playing:
generating for display a prompt to capture a recording of the current progress of the task; and
capturing the recording of the current progress of the task;
determining, based on the captured recording, that the task is at a different progress point than a progress point corresponding to the given step.
3. The method of claim 1 , wherein determining that the task is at the different progress point than the progress point corresponding to the given step comprises:
comparing a recording showing the task at the progress point corresponding to the given step with the recording of the current progress of the task; and
determining, based on comparing the recording showing the task at the progress point corresponding to the given step with the recording of the current progress of the task, that the recording showing the task at the progress point corresponding to the given step does not match the recording of the current progress of the task.
4. The method of claim 3 , wherein the recording is one or more of:
an image of the progress point, an audio recording of the progress point, a video recording of the progress point, and an audio/visual recording of the progress point.
5. The method of claim 1 , wherein determining that the task is at a different progress point than a progress point corresponding to the given step comprises:
accessing a neural network that is configured to determine whether a given recording matches pre-determined criteria;
determining a plurality of features of the neural network can receive as input;
extracting one or more features from the recording showing the current progress point, wherein each of the one or more features corresponds to a feature within the plurality of features; and
executing the neural network using the one or more features extracted from the recording showing the current progress.
6. A system for modifying a tutorial in response to detecting that a step of the tutorial has not been completed, the system comprising:
storage; and
control circuitry configured to:
play a tutorial, wherein the tutorial comprises a plurality of steps for completing a task;
determine that a given step of the tutorial has finished playing;
based on determining that the given step of the tutorial has finished playing, access, in the storage, a captured recording showing a current progress of the task;
determine, based on the captured recording, that the task is at a different progress point than a progress point corresponding to the given step, by
determining a type of the captured recording;
accessing database that stores a plurality of recordings corresponding to the given step;
retrieving, from the database, a set of recordings of the type of the captured recording;
comparing the captured recording with recordings in the set; and
determining, that the captured recording does not match any recording in the set; and
in response to determining that the task is at a different progress point than a progress point corresponding to the given step:
identify a recording, wherein the recording includes instructions to bring the task from the different progress point to the progress point corresponding to the given step; and
play the recording.
7. The system of claim 6 , wherein the control circuitry is further configured to:
based on determining that the given step has finished playing, generate for display a prompt to capture the recording of the current progress of the task; and
capture the recording of the current progress of the task.
8. The system of claim 6 , wherein the control circuitry is further configured to determine that the task is at the different progress point than the progress point corresponding to the given step by:
comparing a recording showing the task at the progress point corresponding to the given step with the recording of the current progress of the task; and
determining, based on comparing the recording showing the task at the progress point corresponding to the given step with the recording of the current progress of the task, that the recording showing the task at the progress point corresponding to the given step does not match the recording of the current progress of the task.
9. The system of claim 8 , wherein the recording is one or more of:
an image of the progress point, an audio recording of the progress point, a video recording of the progress point, and an audio/visual recording of the progress point.
10. The system of claim 6 , wherein the control circuitry is further configured to determine that the task is at a different progress point than a progress point corresponding to the given step by:
accessing a neural network that is configured to determine whether a given recording matches pre-determined criteria;
determining a plurality of features of the neural network can receive as input;
extracting one or more features from the recording showing the current progress point, wherein each of the one or more features corresponds to a feature within the plurality of features; and
executing the neural network using the one or more features extracted from the recording showing the current progress.