IP Library Granted Patent US 11,423,284
Granted Patent B2
US 11,423,284 · App. 16/380,788 · Granted Aug 23, 2022

Subgraph tile fusion in a convolutional neural network

Inventors: Xiangdong Jin (Mountain View, CA); Fen Zhou (Fremont, CA); Chengyu Xiong (San Jose, CA)
Assignee: Black Sesame Technologies, Inc
G06N3/04G06F16/9024G06F17/15G06F17/16G06F30/18G06F30/27G06F30/3308G06F30/392G06N3/082G06N3/10G06N7/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,284
App. No.
16/380,788
Granted
Aug 23, 2022
Kind
B2
Abstract

A method of subgraph tile fusion in a convolutional neural network, including partitioning a network into at least one subgraph node, determining a layer order of at least one layer of the at least one subgraph node, determining a input layer of the at least one subgraph node, determining a weight layer of the at least one subgraph node, determining a output layer of the at least one subgraph node and fusing the at least one subgraph node, the input layer, the weight layer and the output layer in the layer order.

Claims (40)

1. A method of subgraph tile fusion in a convolutional neural network, comprising:

partitioning a network into at least one subgraph node;

determining a layer order of at least one layer of the at least one subgraph node;

determining a input layer of the at least one subgraph node;

determining a weight layer of the at least one subgraph node;

determining a output layer of the at least one subgraph node; and

fusing the at least one subgraph node, the input layer, the weight layer and the output layer in the layer order.

2. The method of subgraph tile fusion of claim 1 , further comprising controlling the fused at least one subgraph node control from within the fused at least one subgraph node.

3. The method of subgraph tile fusion of claim 1 , further comprising receiving input from an input buffer table.

4. The method of subgraph tile fusion of claim 3 , further comprising partitioning the input buffer table into a plurality of input buffer tensor tiles.

5. The method of subgraph tile fusion of claim 1 , further comprising sending output from an output buffer table.

6. The method of subgraph tile fusion of claim 5 , further comprising partitioning the output buffer table into a plurality of output buffer tensor tiles.

7. The method of subgraph tile fusion of claim 1 , further comprising receiving weight data from a weight buffer table.

8. The method of subgraph tile fusion of claim 7 , further comprising partitioning the weight buffer table into a plurality of weight buffer tensor tiles.

9. The method of subgraph tile fusion of claim 1 , further comprising executing the at least one subgraph node in the layer order.

10. The method of subgraph tile fusion of claim 1 , further comprising adding an additional layer having two input layers.

11. The method of subgraph tile fusion of claim 1 , further comprising retaining the input layer based on the input.

12. The method of subgraph tile fusion of claim 1 , further comprising linking the output layer to a set of multiple nodes.

13. A method of subgraph tile fusion in a convolutional neural network, comprising:

partitioning a network operation into at least one subgraph node;

determining a layer order of at least one layer of the subgraph node;

determining a input layer of the subgraph node;

determining a weight layer of the subgraph node;

determining a output layer of the subgraph node; and

fusing the at least one subgraph node, the input layer, the weight layer and the output layer in the layer order.

14. The method of subgraph tile fusion of claim 13 , further comprising:

receiving input from an input buffer table;

receiving weight data from a weight buffer table; and

sending output from an output buffer table.

15. The method of subgraph tile fusion of claim 14 , further comprising:

partitioning the input buffer table into a plurality of input buffer tensor tiles;

partitioning the output buffer table into a plurality of output buffer tensor tiles; and

partitioning the weight buffer table into a plurality of weight buffer tensor tiles.

16. The method of subgraph tile fusion of claim 14 , further comprising:

reading one input from the input buffer table; and

outputting one output from the output buffer table.

17. The method of subgraph tile fusion of claim 13 , further comprising executing the at least one subgraph node in the layer order.

18. The method of subgraph tile fusion of claim 13 , further comprising adding an additional layer having two input layers.

19. The method of subgraph tile fusion of claim 13 , further comprising retaining the input layer based on the input.

20. The method of subgraph tile fusion of claim 13 , further comprising linking the output layer to a set of multiple nodes.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: BLACK SESAME INTERNATIONAL HOLDING LIMITED
To: BLACK SESAME TECHNOLOGIES INC.
Reel/Frame 058301/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2019
From: JIN, XIANGDONG; ZHOU, FEN; XIONG, CHENGYU
To: BLACK SESAME INTERNATIONAL HOLDING LIMITED
Reel/Frame 050159/0809 →
Continuity (2)
Provisional Application 62728308 · Sep 7, 2018
Related Publication 20200082243A1 · Mar 12, 2020