IP Library Patent Application 17249051
Patent Application
App. No. 17/249,051

PROVIDING ENHANCED FUNCTIONALITY IN AN INTERACTIVE ELECTRONIC TECHNICAL MANUAL

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/249,051
Abstract

Embodiments of the present disclosure provide methods, apparatus, systems, computing devices, and computing entities for controlling content found in technical documentation via an IETM viewer. In accordance with one embodiment, a method is provided comprising: providing a window for display via the IETM viewer, the window displaying the content found in the documentation; receiving a first verbal command from a user; responsive to receiving the first verbal command: identifying a focus of a first portion of the content; and causing a first action to be performed with respect to a first user interface control element associated with the first portion; and thereafter: receiving a second verbal command from the user; and responsive to receiving the second verbal command: identifying a focus of a second portion of the content; and causing a second action to be performed with respect to a second user interface control element associated with the second portion.

Claims (60)

1 . A method for controlling content found in technical documentation for an item via an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the method comprising:

providing a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window displaying the content found in the technical documentation;

receiving a first verbal command, wherein the first verbal command is received as a result of the user speaking the first verbal command that is detected by an audio input of the user computing entity;

responsive to receiving the first verbal command:

identifying, via one or more processors, a focus of a first portion of the content; and

causing, via the one or more processors, a first action to be performed based at least in part on the first verbal command with respect to a first user interface control element associated with the first portion of the content; and

after causing the first action to be performed with respect to the first user interface control element associated with the first portion of the content:

receiving a second verbal command, wherein the second verbal command is received as a result of the user speaking the second verbal command that is detected by the audio input of the user computing entity; and

responsive to receiving the second verbal command:

identifying, via the one or more processors, a focus of a second portion of the content; and

causing, via the one or more processors, a second action to be performed based at least in part on the second verbal command with respect to a second user interface control element associated with the second portion of the content.

2 . The method of claim 1 further comprising:

processing one or more features of the first verbal command using a verbal command machine learning model to generate the first action; and

processing one or more features of the second verbal command using the verbal command machine learning model to generate the second action.

3 . The method of claim 2 , wherein the verbal command machine learning model is trained using first training data comprising a first plurality of samples of the user speaking the first verbal command for the first action and second training data comprising a second plurality of samples of the user speaking the second verbal command for the second action.

4 . The method of claim 3 , wherein the user identifies the first action for the first verbal command and the second action for the second verbal command.

5 . The method of claim 1 , wherein the focus of the first portion of the content comprises a selection of the first portion of the content via a selection verbal command received as a result of the user speaking the selection verbal command that is detected by the audio input of the user computing entity.

6 . The method of claim 1 , wherein the first action comprises causing the first user interface control element to at least one of convey input, navigate to a particular section of the first portion of the content, or display other content associated with the first portion of the content.

7 . The method of claim 1 , wherein the focus of the second portion of the content results from the first action being performed with respect to the first user interface control element associated with the first portion of the content.

8 . The method of claim 7 , wherein the content comprises a plurality of sequential portions of the content, the second portion of the content immediately follows the first portion of the content in the plurality of sequential portions of the content, and the first action with respect to the first user interface control element associated with the first portion of the content comprises setting the first user interface control element associated with the first portion of the content to indicate a completion of the first portion of the content.

9 . An apparatus for controlling content found in technical documentation for an item via an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

provide a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window displaying the content found in the technical documentation;

receive a first verbal command, wherein the first verbal command is received as a result of the user speaking the first verbal command that is detected by an audio input of the user computing entity;

responsive to receiving the first verbal command:

identify a focus of a first portion of the content; and

cause a first action to be performed based at least in part on the first verbal command with respect to a first user interface control element associated with the first portion of the content; and

after causing the first action to be performed with respect to the first user interface control element associated with the first portion of the content:

receive a second verbal command, wherein the second verbal command is received as a result of the user speaking the second verbal command that is detected by the audio input of the user computing entity; and

responsive to receiving the second verbal command:

identify a focus of a second portion of the content; and

cause a second action to be performed based at least in part on the second verbal command with respect to a second user interface control element associated with the second portion of the content.

10 . The apparatus of claim 9 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:

process one or more features of the first verbal command using a verbal command machine learning model to generate the first action; and

process one or more features of the second verbal command using the verbal command machine learning model to generate the second action.

11 . The apparatus of claim 10 , wherein the verbal command machine learning model is trained using first training data comprising a first plurality of samples of the user speaking the first verbal command for the first action and second training data comprising a second plurality of samples of the user speaking the second verbal command for the second action.

12 . The apparatus of claim 11 , wherein the user identifies the first action for the first verbal command and the second action for the second verbal command.

13 . The apparatus of claim 9 , wherein the focus of the first portion of the content comprises a selection of the first portion of the content via a selection verbal command received as a result of the user speaking the selection verbal command that is detected by the audio input of the user computing entity.

14 . The apparatus of claim 9 , wherein the first action comprises causing the first user interface control element to at least one of convey input, navigate to a particular section of the first portion of the content, or display other content associated with the first portion of the content.

15 . The apparatus of claim 9 , wherein the focus of the second portion of the content results from the first action being performed with respect to the first user interface control element associated with the first portion of the content.

16 . The apparatus of claim 15 , wherein the content comprises a plurality of sequential portions of the content, the second portion of the content immediately follows the first portion of the content in the plurality of sequential portions of the content, and the first action with respect to the first user interface control element associated with the first portion of the content comprises setting the first user interface control element associated with the first portion of the content to indicate a completion of the first portion of the content.

17 . A non-transitory computer storage medium comprising instructions for displaying media content of an electrical connector comprising a plurality of pins that is referenced in technical documentation for an item via an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the instructions being configured to cause one or more processors to at least perform operations configured to:

provide a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window displaying the content found in the technical documentation;

receive a first verbal command, wherein the first verbal command is received as a result of the user speaking the first verbal command that is detected by an audio input of the user computing entity;

responsive to receiving the first verbal command:

identify a focus of a first portion of the content; and

cause a first action to be performed based at least in part on the first verbal command with respect to a first user interface control element associated with the first portion of the content; and

after causing the first action to be performed with respect to the first user interface control element associated with the first portion of the content:

receive a second verbal command, wherein the second verbal command is received as a result of the user speaking the second verbal command that is detected by the audio input of the user computing entity; and

responsive to receiving the second verbal command:

identify a focus of a second portion of the content; and

cause a second action to be performed based at least in part on the second verbal command with respect to a second user interface control element associated with the second portion of the content.

18 . The non-transitory computer storage medium of claim 17 , wherein the instructions are configured to cause the one or more processors to at least perform operations configured to:

process one or more features of the first verbal command using a verbal command machine learning model to generate the first action; and

process one or more features of the second verbal command using the verbal command machine learning model to generate the second action.

19 . The non-transitory computer storage medium of claim 18 , wherein the verbal command machine learning model is trained using first training data comprising a first plurality of samples of the user speaking the first verbal command for the first action and second training data comprising a second plurality of samples of the user speaking the second verbal command for the second action.

20 . The non-transitory computer storage medium of claim 19 , wherein the user identifies the first action for the first verbal command and the second action for the second verbal command.

21 . The non-transitory computer storage medium of claim 17 , wherein the focus of the first portion of the content comprises a selection of the first portion of the content via a selection verbal command received as a result of the user speaking the selection verbal command that is detected by the audio input of the user computing entity.

22 . The non-transitory computer storage medium of claim 17 , wherein the first action comprises causing the first user interface control element to at least one of convey input, navigate to a particular section of the first portion of the content, or display other content associated with the first portion of the content.

23 . The non-transitory computer storage medium of claim 17 , wherein the focus of the second portion of the content results from the first action being performed with respect to the first user interface control element associated with the first portion of the content.

24 . The non-transitory computer storage medium of claim 23 , wherein the content comprises a plurality of sequential portions of the content, the second portion of the content immediately follows the first portion of the content in the plurality of sequential portions of the content, and the first action with respect to the first user interface control element associated with the first portion of the content comprises setting the first user interface control element associated with the first portion of the content to indicate a completion of the first portion of the content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2021
From: MERIAZ, RAN; MERIAZ, YORAM; TKACHMAN, ALEXANDER
To: MBTE HOLDINGS SWEDEN AB
Reel/Frame 056400/0144 →