IP Library › Granted Patent US 10,867,236
Granted Patent B2
US 10,867,236 · App. 15/247,160 · Granted Dec 15, 2020

Interface neural network

Inventors: Jun Haeng Lee (Hwaseong-si, KR); Tobi Delbruck (Zurich, CH); Eric Hyunsurk Ryu (Hwaseong-si, KR)
Assignees: SAMSUNG ELECTRONICS CO., LTD.; UNIVERSITAET ZUERICH
G06N3/0454
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,867,236
App. No.
15/247,160
Granted
Dec 15, 2020
Kind
B2
Abstract

An operation method of a neural network, a training method, and a signal processing apparatus are provided. The operation method includes receiving an output signal from a first neural network, and converting a first feature included in the output signal to a second feature configured to be input to a second neural network, based on a conversion rule controlling conversion between a feature to be output from the first neural network and a feature to be input to the second neural network. The operation method further includes generating an input signal to be input to the second neural network, based on the second feature, and transmitting the input signal to the second neural network.

Claims (38)

1. An operation method of an interface neural network, the operation method comprising:

receiving an output signal from a first neural network;

converting a first feature vector of the output signal to a second feature vector of an input signal to be input to a second neural network, based on parameters of the interface neural network controlling conversion between a feature vector to be output from the first neural network and a feature vector to be input to the second neural network;

generating the input signal to be input to the second neural network, the input signal comprising the second feature vector; and

transmitting the input signal to the second neural network.

2. The operation method of claim 1 , wherein an input dimension of the interface neural network corresponds to an output dimension of the first neural network, and

an output dimension of the interface neural network corresponds to an input dimension of the second neural network.

3. The operation method of claim 1 , wherein the conversion the parameters of the interface neural network are optimized.

4. The operation method of claim 1 , further comprising:

based on the first neural network being replaced with a third neural network, updating the parameters to control conversion between a feature vector to be output from the third neural network and the feature vector to be input to the second neural network; and

based on the second neural network being replaced with a fourth neural network, updating the parameters to control conversion between the feature vector to be output from the first neural network and a feature vector to be input to the fourth neural network.

5. The operation method of claim 4 , wherein the updating the parameters to control the conversion between the feature vector to be output from the third neural network and the feature vector to be input to the second neural network comprises adjusting the parameters of the interface neural network, based on a relationship between the feature vector to be output from the third neural network and the feature vector to be input to the second neural network, and

the updating the parameters to control the conversion between the feature vector to be output from the first neural network and the feature vector to be input to the fourth neural network comprises adjusting the parameters of the interface neural network, based on a relationship between the feature vector to be output from the first neural network and the feature vector to be input to the fourth neural network.

6. The operation method of claim 4 , wherein the third neural network and the first neural network are distinguished with respect to any one or any combination of an input modality, an output modality, an input dimension, an output dimension, an input feature vector, and an output feature vector, and

the fourth neural network and the second neural network are distinguished with respect to any one or any combination of an input modality, an output modality, an input dimension, an output dimension, an input feature vector, and an output feature, vector.

7. The operation method of claim 4 , wherein, based on the first neural network being replaced with the third neural network, a type of an input signal based on the updated parameters is identical to a type of the input signal based on the parameters, and

based on the second neural network being replaced with the fourth neural network, a type of an output signal based on the updated parameters is identical to a type of the output signal based on the parameters.

8. The operation method of claim 1 , further comprising, based on a third neural network being additionally connected to the interface neural network, generating the parameters controlling the conversion between the feature vector to be output from the third neural network and the feature vector to be input to the second neural network.

9. The operation method of claim 1 , wherein the first neural network is configured to extract the first feature vector from an object, and

the second neural network is configured to identify the object, based on the input signal.

10. The operation method of claim 1 , wherein the first neural network is configured to determine, as the first feature vector, a command vector of an actuator, and

the second neural network is configured to control the actuator, based on the input signal.

11. A non-transitory computer-readable medium storing a program comprising instructions to control a processor to perform the method of claim 1 .

12. A signal processing apparatus comprising:

a processor configured to:

receive an output signal from a first neural network;

convert a first feature vector of the output signal to a second feature vector of an input signal to be input to a second neural network, based on parameters of an interface neural network controlling conversion between a feature vector to be output from the first neural network and a feature vector to be input to the second neural network;

generate the input signal to be input to the second neural network, the input signal comprising the second feature vector; and

transmit the input signal to the second neural network.

13. An operation method of an interface neural network, the operation method comprising:

receiving an output signal from a first neural network;

converting a first feature vector of an object and of the output signal to a second feature vector of the object and of an input signal to be input to a second neural network, based on parameters of the interface neural network that are optimized, the parameters controlling conversion between a feature vector to be output from the first neural network and a feature vector to be input to the second neural network;

generating the input signal to be input to the second neural network, the input signal comprising the second feature vector of the object;

transmitting the input signal to the second neural network; and

based on the second neural network being replaced with a third neural network, updating the parameters to control conversion between the feature vector to be output from the first neural network and a feature vector to be input to the third neural network.

14. The operation method of claim 13 , further comprising:

converting a first command of an actuator and included in the output signal to a second command of the actuator and configured to be input to the second neural network; and

generating the input signal to be input to the second neural network, the input signal comprising the second command of the actuator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2016
From: LEE, JUN HAENG; DELBRUCK, TOBI; RYU, ERIC HYUNSURK
To: SAMSUNG ELECTRONICS CO., LTD.; UNIVERSITAET ZUERICH
Reel/Frame 039541/0820 →
Priority Claims (1)
KR 10-2016-0046426 · Apr 15, 2016 · national
Continuity (1)
Related Publication 20170300813A1 · Oct 19, 2017
Cited By (1)
US 12,506,897