IP Library Granted Patent US 10,235,353
Granted Patent B1
US 10,235,353 · App. 15/706,548 · Granted Mar 19, 2019

Natural language translation interface for networked devices

Inventors: Mark S Sanders (Roanoke, VA); Gavin R Cato (Los Gatos, CA)
Assignee: Dell Products LP
G06F17/271G06F17/289G06F17/30976
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,235,353
App. No.
15/706,548
Granted
Mar 19, 2019
Kind
B1
Abstract

Embodiments for translating an input message into a device specific command for a network interface device, by: receiving the input message as a generalized language message at an input interface; separating the input message into its language parts to identify keyword elements; identifying keyword actions, targets, and variables used to indicate corresponding device specific commands; classifying the keyword elements against a learned language map to identify a best match action; utilizing the best match action to access a playlist data set for the device specific commands of the target device for execution; and providing a feedback path to a learning mechanism for adding new message and language semantics into the learned language map when identification of the best match action is unclear.

Claims (37)

1. A method of translating an input message into a device specific command, comprising:

receiving the input message as a generalized language message at an input interface of a network interface device serving as a transmission device connecting an edge of a local network to an external cloud network;

installing a natural language translator as a micro-service resident in the network interface device to process the input message as natural language input into corresponding device specific commands defined by a manufacturer of the network interface device;

separating the input message into its language parts to identify keyword elements;

identifying, using the natural language translator, keyword actions, targets, and variables used in the input message to indicate the corresponding device specific commands;

classifying the message keyword elements against a learned language map to identify a best match action corresponding to the device specific commands;

utilizing the best match action to access a playlist data set for the device specific commands of the target device for execution; and

providing a feedback path to a learning process for adding new message and language semantics into the learned language map when identification of the best match action is unclear.

2. The method of claim 1 wherein the generalized language message comprises a natural language message provided by a user through one of a spoken input or written input to the input interface.

3. The method of claim 2 wherein the network interface device provides an entry point for a network node of the local network to the cloud network, and wherein the transmission device comprises one of: a switch, a router, and a firewall.

4. The method of claim 3 further comprising a transmutation process of the natural language translator performing natural language processing (NLP) tasks including: parsing, classifying, translating, and action processing the input message for converting the input message into the device specific commands.

5. The method of claim 4 further wherein the learning process is configured to create and update the learned language map as a language ontology framework through at least one of a static seed-data based process or a dynamic process using actions iteratively matched to user input.

6. The method of claim 5 wherein a portion of the transmutation process and learning process are provided as co-resident software components in a server computer in the cloud network.

7. The method of claim 6 further comprising transmitting the device specific command over a secured target channel to the network interface device.

8. The method of claim 5 wherein the learning process is provided as a remote process resident on a server computer coupled to the network interface device.

9. The method of claim 8 further comprising transmitting the device specific command over a direct command interface to the network interface device.

10. The method of claim 1 wherein the device specific commands comprise one of: a single device command for performing a desired action specified in the input message, and multiple device commands that together perform the desired action specified in the input message.

11. A method of learning a language to translate natural language into machine commands, comprising:

receiving an input message as a generalized language message at an input interface of a network interface device serving as a transmission device connecting an edge of a local network to an external cloud network;

building a message-to-command correlation data set dictionary in a micro-service resident in the network interface device to process the input message as natural language input into corresponding device specific commands defined by a manufacturer of the network interface device;

processing the correlation dictionary data set to identify language parts of the input message;

computing probabilities of the language parts to create a learned language map for translation of messages into device specific actions; and

processing the correlation dictionary to create a playlist of actions that provide the device specific commands.

12. The method of claim 11 wherein building the message-to-command correlation data set dictionary comprises a dynamic process of receiving a number of different input messages and modifying the learned language map based on unrecognized action words.

13. The method of claim 11 wherein building the message-to-command correlation data set dictionary comprises a static process comprising:

starting with a seed set of data including at least one of: known device commands, generic device commands, and anticipated device commands; and

modifying the seed set of data through one of corrective user input and learned commands.

14. The method of claim 11 wherein the playlist of actions comprises a database correlating input message data elements to specific device commands, and wherein the specific device commands comprise one of: a single device command for performing a desired action specified in the input message, and multiple device commands that together perform the desired action specified in the input message.

15. The method of claim 11 further comprising updating the learned language map through a learning process that learns commands processed through a natural language processor (NLP) but not matched to any present existing entry in the message-to-command correlation data set dictionary.

16. The method of claim 11 wherein the network interface device comprises one of: a switch, a router, and a firewall.

17. A system translating an input message into a device specific command, comprising:

an input interface of a network interface device serving as a transmission device connecting an edge of a local network to an external cloud network receiving the input message as a generalized language message;

a natural language translator installed as a micro-service resident in the network interface device to process the input message as natural language input into corresponding device specific commands defined by a manufacturer of the network interface device;

a transmutation component of the natural language translator, separating the input message into its language parts to identify keyword elements, identifying keyword actions, targets, and variables used in the input message to indicate corresponding device specific commands, classifying the message keyword elements against a learned language map to identify a best match action corresponding to the device specific commands, and utilizing the best match action to access a playlist data set for the device specific commands of the target device for execution; and

a learning component coupled to the transmutation component through feedback path, configured to add new message and language semantics into the learned language map when identification of the best match action is unclear.

18. The system of claim 17 wherein the generalized language message comprises a natural language message provided by a user through one of a spoken input or written input to the input interface, and wherein the network interface device comprises an edge device coupling a network node to a cloud network, and wherein the edge device comprises one of: a switch, a router, a firewall, a server computer, and a storage device.

19. The system of claim 18 wherein the learning process is provided as a remote process resident on a server computer coupled to the network interface device.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0466) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 060753/0486 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (044535/0109) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 060753/0414 →
RELEASE OF SECURITY INTEREST AT REEL 044535 FRAME 0001 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0475 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0466 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 044535/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 044535/0109 →
Cited By (1)
US 12,470,469