Systems and methods for customizing playback of digital tutorials
Systems and methods are disclosed herein for continuing playback of a digital tutorial until a user interrupts the playback by signaling to the system that there is an issue or that the user needs help. The system, through detecting a recording that the user captured or a person's utterance (e.g., through passive voice monitoring) determines that the user's needs assistance with the digital tutorial. The system determines, based on the recording, that the user needs help to get to a specific step and play supplemental instructions to the user to get to the specific step.
1. A method for modifying a tutorial in response to an utterance, the method comprising:
generating for display a prompt to capture video data showing a current progress of a task;
capturing via a camera the video data showing the current progress of the task in response to acceptance of a prompt;
storing the video data showing the current progress of the task in a memory device;
generating for display a tutorial, wherein the tutorial comprises a plurality of steps for completing the task;
receiving, via microphone, at control circuitry audio data comprising an utterance;
determining that the utterance is associated with the tutorial;
based on determining that the utterance is associated with the tutorial:
accessing, by the control circuitry, the video data stored in the memory device, showing the current progress of the task;
determining, based on analyzing the video data stored in the memory device, that the task is at a different progress point than a current progress point of the tutorial; and
based on determining that the task is at the different progress point than the current progress point of the tutorial, outputting instructions for matching the current progress point of the tutorial.
2. The method of claim 1 , wherein determining that the task is at the different progress point than the current progress point of the tutorial comprises:
comparing a plurality of recordings showing the task at the current progress point of the tutorial with the video data stored in the memory device; and
determining, based on comparing the plurality of recordings showing the task at the current progress point of the tutorial with the video data stored in the memory device, that the video data does not match any recording of the current progress of the tutorial.
3. The method of claim 1 , wherein outputting the instructions for matching to the current progress point of the tutorial comprises:
comparing the video data stored in the memory device with a plurality of recordings, wherein each of the plurality of recordings corresponds to instructions for bringing the task to a given progress point;
retrieving, instructions corresponding to a recording of the plurality of recordings that matches the video data stored in the memory device.
4. A system for modifying a tutorial in response to an utterance, the system comprising:
a camera;
a microphone;
a user input interface; and
control circuitry configured to:
generate for display a prompt to capture video data showing a current progress of a task;
capture via the camera the video data showing the current progress of the task in response to acceptance of a prompt;
store the video data showing the current progress of the task in a memory device;
generate for display a tutorial, wherein the tutorial comprises a plurality of steps for completing the task;
receive, via the microphone, at control circuitry audio data comprising an utterance;
determine that the utterance is associated with the tutorial;
based on determining that the utterance is associated with the tutorial, access, by the control circuitry, the video data stored in the memory device, showing the current progress of the task;
determine, based on analyzing the video data stored in the memory device, that the task is at a different progress point than a current progress point of the tutorial; and
based on determining that the task is at the different progress point than the current progress point of the tutorial, output instructions for matching the current progress point of the tutorial.
5. The system of claim 4 , wherein the control circuitry is further configured to determine that the task is at the different progress point than the current progress point of the tutorial by:
comparing a plurality of recordings showing the task at the current progress point of the tutorial with the video data stored in the memory device; and
determining, based on comparing the plurality of recordings showing the task at the current progress point of the tutorial with the video data stored in the memory device, that the video data stored in the memory device does not match any recording of the current progress of the tutorial.
6. The system of claim 4 , wherein the control circuitry is further configured to output the instructions for matching to the current progress point of the tutorial by:
comparing the video data stored in the memory device with a plurality of recordings, wherein each of the plurality of recordings corresponds to instructions for bringing the task to a given progress point;
retrieving, instructions corresponding to a recording of the plurality of recordings that matches the video data stored in the memory device.