IP Library Granted Patent US 12,217,147
Granted Patent B2
US 12,217,147 · App. 17/764,453 · Granted Feb 4, 2025

Advanced wavelet filtering for accelerated deep learning

Inventors: Michael Morrison (Sunnyvale, CA); Michael Edwin James (San Carlos, CA); Sean Lie (Los Altos, CA); Srikanth Arekapudi (Los Altos Hills, CA); Gary R. Lauterbach (Los Altos, CA)
Assignee: Cerebras Systems Inc.
G06N3/04G06F9/3887G06F9/3888G06F13/42G06F17/148G06N3/063G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,147
App. No.
17/764,453
Filed
Apr 11, 2022
Granted
Feb 4, 2025
Kind
B2
Art Unit
2184
USPC
706/15
Abstract

Techniques in wavelet filtering for advanced deep learning provide improvements in one or more of accuracy, performance, and energy efficiency. An array of processing elements comprising a portion of a neural network accelerator performs flow-based computations on wavelets of data. Each processing element comprises a compute element to execute programmed instructions using the data and a router to route the wavelets in accordance with virtual channel specifiers. Each processing element is enabled to perform local filtering of wavelets received at the processing element, selectively, conditionally, and/or optionally discarding zero or more of the received wavelets, thereby preventing further processing of the discarded wavelets. The wavelet filtering is performed by one or more configurable wavelet filters operable in various modes, such as counter, sparse, and range modes.

Claims (53)

1. A method comprising:

communicating packets between a plurality of processing elements coupled via a fabric, wherein each of the communicated packets comprises a respective color field and a respective type field;

receiving, from the fabric, a particular one of the communicated packets in a particular one of the processing elements, wherein the color field of the particular packet is a particular color value and the type field of the particular packet is a particular type value indicating a mutually exclusive one of a plurality of types;

managing a wavelet filter of the particular processing element, wherein the wavelet filter is enabled to retain state comprising a filtered color; and

queueing information of the particular packet to enable execution, by the particular processing element, of an instruction that uses the queued information, wherein the queueing is conditional based on one or more queueing criteria, a first one of the queueing criteria is that the particular color value and the filtered color are different, and a second one of the queueing criteria is that the particular type value indicates a particular one of the types.

2. A method comprising:

communicating packets between a plurality of processing elements coupled via a fabric, wherein each of the communicated packets comprises a respective color field and a respective type field;

receiving, from the fabric, a particular one of the communicated packets in a particular one of the processing elements, wherein the color field of the particular packet is a particular color value and the type field of the particular packet is a particular type value indicating a mutually exclusive one of a plurality of types;

managing a wavelet filter of the particular processing element, wherein the wavelet filter is enabled to retain state comprising a filtered color; and

updating a counter, wherein;

the updating is conditional based on one or more updating criteria, a first one of the updating criteria is that the particular color value and the filtered color are identical, and a second one of the updating criteria is that the particular type value indicates a particular one of the types,

the updating is responsive to the receiving, and

the state further comprises the counter.

3. A method comprising:

communicating packets between a plurality of processing elements coupled via a fabric, wherein each of the communicated packets comprises a respective color field and a respective type field;

receiving, from the fabric, a particular one of the communicated packets in a particular one of the processing elements, wherein the color field of the particular packet is a particular color value and the type field of the particular packet is a particular type value indicating a mutually exclusive one of a plurality of types;

managing a wavelet filter of the particular processing element, wherein the wavelet filter is enabled to retain state comprising a filtered color;

queueing information of the particular packet to enable execution, by the particular processing element, of an instruction that uses the queued information, wherein the queueing is conditional based on one or more queueing criteria and a first one of the queueing criteria is that the particular color value and the filtered color are different, and a second one of the queueing criteria is that the particular type value indicates a particular one of the types; and

updating a counter, wherein:

the updating is conditional based on one or more updating criteria and a first one of the updating criteria is that the particular color value and the filtered color are identical, and a second one of the updating criteria is that the particular type value indicates the particular type,

the updating is responsive to the receiving, and

the state further comprises the counter.

4. The method of claim 3 , wherein the state further comprises a filter mode indicator enabled to indicate a mutually exclusive one of a plurality of filter operating modes and a third one of the queueing criteria is that the filter mode indicator indicates a particular one of the filter operating modes.

5. The method of claim 3 , wherein the state further comprises a filter mode indicator enabled to indicate a mutually exclusive one of a plurality of filter operating modes and a third one of the updating criteria is that the filter mode indicator indicates a particular one of the filter operating modes.

6. The method of claim 3 , wherein the state further comprises a filter mode indicator enabled to indicate a mutually exclusive one of a plurality of filter operating modes, a third one of the queueing criteria is that the filter mode indicator indicates a particular one of the filter operating modes, and a third one of the updating criteria is that the filter mode indicator indicates the particular filter operating mode.

7. The method of claim 4, claim 5, or claim 6 , wherein the filter operating modes comprise a counter mode, a sparse mode, and a range mode.

8. The method of claim 3 , wherein the state further comprises a limit and a third one of the queueing criteria is that the counter is one of less than the limit and equal to the limit.

9. The method of claim 1 or claim 3 wherein the particular packet comprises a particular index value, the state further comprises a range specifier, and a third one of the queueing criteria is that the particular index value is in accordance with a range specified by the range specifier.

10. The method of claim 9 , wherein the types comprise a control type and a data type.

11. The method of claim 2 or claim 3 , wherein the types comprise a control type and a data type.

12. The method of claim 2 or claim 3 , wherein the wavelet filter is a first wavelet filter, the state is first state, the filtered color is a first filtered color, and a second wavelet filter of the particular processing element is enabled to retain second state comprising a second filtered color.

13. The method of claim 12 , wherein the managing is a first managing and further comprising a second managing the second wavelet filter.

14. The method of claim 13 , wherein the updating is a first updating, the counter is a first counter, and the updating criteria is a first updating criteria; and further comprising a second updating a second counter, wherein the second updating is conditional based on one or more second updating criteria and a first one of the second updating criteria is that the particular color value, and the second filtered color are identical, and further wherein the second updating is responsive to the receiving.

15. The method of claim 2 or claim 3 , wherein the managing is a first managing, the wavelet filter is a first wavelet filter, the state is first state, the filtered color is a first filtered color, the updating is a first updating, the counter is a first counter, and the updating criteria is a first updating criteria; and further comprising:

a second managing a second wavelet filter of the particular processing element, wherein the second wavelet filter is enabled to retain second state comprising a second filtered color; and

a second updating a second counter, wherein the second updating is conditional based on one or more second updating criteria and a first one of the second updating criteria is that the particular color value and the second filtered color are identical, and the second updating is responsive to the receiving.

16. The method of claim 1 or claim 3 , wherein the particular packet comprises a particular index value, the state further comprises a range specifier, and a third one of the queueing criteria is that the particular index value is in accordance with a range specified by the range specifier.

17. The method of claim 1, claim 2, or claim 3 , wherein one or more configuration registers of the particular processing element comprise one or more portions of the state.

18. The method of claim 17 , wherein at least one of the configuration registers is modifiable by a load control register instruction that is executable by the particular processing element.

19. The method of claim 17 , wherein at least one of the configuration registers is memory-mapped and modifiable by at least one memory store instruction that is executable by the particular processing element.

20. The method of claim 17 , wherein at least one of the configuration registers is modifiable via a system interface of the particular processing element.

21. The method of claim 1 or claim 3 , wherein the execution by the particular processing element is implemented at least in part by a compute element that the particular processing element comprises.

22. The method of claim 3 , further comprising, transmitting to the fabric a copy of the particular packet, as one of the communicated packets, to another one of the processing elements, wherein the transmitting is irrespective of the queueing criteria and irrespective of the updating criteria.

23. The method of claim 1 or claim 3 , wherein the queued information comprises an integer data value and the instruction comprises an integer arithmetic instruction.

24. The method of claim 1 or claim 3 , wherein the queued information comprises a floating-point data value and the instruction comprises a floating-point arithmetic instruction.

25. The method of claim 1 or claim 3 , wherein the queued information comprises a plurality of values and the instruction comprises a single instruction multiple data instruction.

26. The method of claim 1, claim 2, or claim 3 , wherein the particular color value identifies one communication pathway of a plurality of communication pathways.

27. The method of claim 26 , wherein a plurality of fabric ports couples the particular processing element to the fabric and the identified communication pathway is implemented at least in part by transport via a particular fabric port of the plurality of fabric ports.

28. The method of claim 1, claim 2, or claim 3 , wherein the particular processing element comprises a compute element enabled to perform the execution and the compute element comprises at least a portion of the wavelet filter.

29. The method of claim 1, claim 2, or claim 3 , wherein the particular processing element comprises a router enabled to forward the particular packet to another of the processing elements and the router comprises at least a portion of the wavelet filter.

30. The method of claim 1, claim 2, or claim 3 , wherein the particular processing element comprises a compute element and a router, the compute element is enabled to perform the execution, and the router is enabled to forward the particular packet to the compute element.

31. The method of claim 1, claim 2, or claim 3 , wherein the particular packet comprises a data portion indicating one or more of an activation of a neural network, a partial sum of activations of a neural network, an error of a neural network, a gradient estimate of a neural network, and a weight of a neural network.

32. The method of claim 1, claim 2, or claim 3 , wherein a single wafer comprises the processing elements and the fabric.

Assignments (2)
SECURITY INTEREST Recorded Jun 18, 2026
From: CEREBRAS SYSTEMS INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS THE COLLATERAL AGENT
Reel/Frame 075845/0844 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2022
From: MORRISON, MICHAEL; JAMES, MICHAEL EDWIN; LIE, SEAN; AREKAPUDI, SRIKANTH; LAUTERBACH, GARY R.
To: CEREBRAS SYSTEMS INC.
Reel/Frame 060932/0272 →
Continuity (2)
Provisional Application 62915745 · Oct 16, 2019
Related Publication 20220343136A1 · Oct 27, 2022
References Cited (400)
US 5361334A · Cawley · 1994 [cited by applicant]
US 5481688A · Takagi · 1996 [cited by applicant]
US 5710549A · Horst et al. · 1998 [cited by applicant]
US 5761103A · Oakland et al. · 1998 [cited by applicant]
US 5835024A · Olnowich et al. · 1998 [cited by applicant]
US 5870396A · Abu-Amara et al. · 1999 [cited by applicant]
US 6199089B1 · Mansingh · 2001 [cited by applicant]
US 6212627B1 · Dulong et al. · 2001 [cited by applicant]
US 6542986B1 · White · 2003 [cited by applicant]
US 6788698B1 · Bandai et al. · 2004 [cited by applicant]
US 7293002B2 · Starzyk · 2007 [cited by applicant]
US 7359274B2 · Noguchi et al. · 2008 [cited by applicant]
US 7401333B2 · Vandeweerd · 2008 [cited by applicant]
US 7453810B2 · Zoranovic et al. · 2008 [cited by applicant]
US 7565657B1 · Leung et al. · 2009 [cited by applicant]
US 7701957B1 · Bicknell · 2010 [cited by applicant]
US 7814303B2 · Muff · 2010 [cited by applicant]
US 7986629B1 · Ferguson et al. · 2011 [cited by applicant]
US 8151088B1 · Bao et al. · 2012 [cited by applicant]
US 8194690B1 · Steele et al. · 2012 [cited by applicant]
US 8311057B1 · Attig et al. · 2012 [cited by applicant]
US 8583896B2 · Cadambi et al. · 2013 [cited by applicant]
US 8738860B1 · Griffin et al. · 2014 [cited by applicant]
US 8745626B1 · Sandstrom · 2014 [cited by applicant]
US 9009660B1 · Griffin et al. · 2015 [cited by applicant]
US 9038072B2 · Nollet et al. · 2015 [cited by applicant]
US 9117550B2 · Tran · 2015 [cited by applicant]
US 9152427B2 · Vorbach et al. · 2015 [cited by applicant]
US 9170812B2 · Vorbach et al. · 2015 [cited by applicant]
US 9348557B1 · Langhammer et al. · 2016 [cited by applicant]
US 9373073B2 · Arthur et al. · 2016 [cited by applicant]
US 9390461B1 · Jane et al. · 2016 [cited by applicant]
US 9423999B1 · Linzer · 2016 [cited by applicant]
US 9627095B1 · Xu et al. · 2017 [cited by applicant]
US 9946548B2 · Burger et al. · 2018 [cited by applicant]
US 10067796B1 · Metcalf · 2018 [cited by applicant]
US 10127043B2 · Sebexen et al. · 2018 [cited by applicant]
US 10268679B2 · Li et al. · 2019 [cited by applicant]
US 10289816B1 · Malassenet et al. · 2019 [cited by applicant]
US 10355975B2 · Sebexen et al. · 2019 [cited by applicant]
US 10515303B2 · Lie et al. · 2019 [cited by applicant]
US 10614357B2 · Lie et al. · 2020 [cited by applicant]
US 10657438B2 · Lie et al. · 2020 [cited by applicant]
US 10699189B2 · Lie et al. · 2020 [cited by applicant]
US 10700968B2 · Sebexen et al. · 2020 [cited by applicant]
US 10726329B2 · Lie et al. · 2020 [cited by applicant]
US 10762418B2 · Lie et al. · 2020 [cited by applicant]
US 10762420B2 · Teig et al. · 2020 [cited by applicant]
US 10963780B2 · Nowatzyk et al. · 2021 [cited by applicant]
US 11062200B2 · Lie et al. · 2021 [cited by applicant]
US 11062202B2 · James et al. · 2021 [cited by applicant]
US 11157806B2 · Lie et al. · 2021 [cited by applicant]
US 11232347B2 · Lie et al. · 2022 [cited by applicant]
US 11232348B2 · Lie · 2022 [cited by examiner]
US 11321087B2 · Morrison et al. · 2022 [cited by applicant]
US 11328207B2 · Lauterbach · 2022 [cited by examiner]
US 11328208B2 · Lie et al. · 2022 [cited by applicant]
US 11368588B1 · Johnston et al. · 2022 [cited by applicant]
US 11449574B2 · Lie et al. · 2022 [cited by applicant]
US 11475282B2 · Lie et al. · 2022 [cited by applicant]
US 11488004B2 · Lie et al. · 2022 [cited by applicant]
US 11580394B2 · Lie et al. · 2023 [cited by applicant]
US 11727254B2 · Lie et al. · 2023 [cited by applicant]
US 11727257B2 · Lie et al. · 2023 [cited by applicant]
US 11805025B1 · Wang et al. · 2023 [cited by applicant]
US 20020027813A1 · King et al. · 2002 [cited by applicant]
US 20020141427A1 · McAipine · 2002 [cited by applicant]
US 20020161986A1 · Kamigata et al. · 2002 [cited by applicant]
US 20040030712A1 · Sano et al. · 2004 [cited by applicant]
US 20040115995A1 · Sanders · 2004 [cited by applicant]
US 20040153623A1 · Buchty et al. · 2004 [cited by applicant]
US 20040160970A1 · Dally et al. · 2004 [cited by applicant]
US 20050131660A1 · Yadegar et al. · 2005 [cited by applicant]
US 20050220094A1 · Parker et al. · 2005 [cited by applicant]
US 20050257027A1 · Leijten · 2005 [cited by applicant]
US 20060069854A1 · Jain et al. · 2006 [cited by applicant]
US 20060179284A1 · Jensen et al. · 2006 [cited by applicant]
US 20060259713A1 · De Santis et al. · 2006 [cited by applicant]
US 20070058557A1 · Cuffaro et al. · 2007 [cited by applicant]
US 20070140240A1 · Dally et al. · 2007 [cited by applicant]
US 20080077926A1 · Jeter et al. · 2008 [cited by applicant]
US 20080107105A1 · Reilly et al. · 2008 [cited by applicant]
US 20080133889A1 · Glew · 2008 [cited by applicant]
US 20080186852A1 · Sami et al. · 2008 [cited by applicant]
US 20080222646A1 · Sigal et al. · 2008 [cited by applicant]
US 20090003827A1 · Kai et al. · 2009 [cited by applicant]
US 20090094436A1 · Deng et al. · 2009 [cited by applicant]
US 20090119489A1 · Pechanek et al. · 2009 [cited by applicant]
US 20090135739A1 · Hoover et al. · 2009 [cited by applicant]
US 20090248941A1 · Morein et al. · 2009 [cited by applicant]
US 20090259713A1 · Blumrich et al. · 2009 [cited by applicant]
US 20090259713A1 · Blumrich et al. · 2009 [cited by applicant]
US 20090306804A1 · Chao et al. · 2009 [cited by applicant]
US 20090313195A1 · McDaid et al. · 2009 [cited by applicant]
US 20100061390A1 · Godbole et al. · 2010 [cited by applicant]
US 20100095098A1 · Gschwind · 2010 [cited by applicant]
US 20100106940A1 · Muff et al. · 2010 [cited by applicant]
US 20100208317A1 · Bogoni et al. · 2010 [cited by applicant]
US 20110022821A1 · Fei et al. · 2011 [cited by applicant]
US 20110028293A1 · Atkin et al. · 2011 [cited by applicant]
US 20110161626A1 · Mangione-Smith · 2011 [cited by applicant]
US 20110213950A1 · Mathieson et al. · 2011 [cited by applicant]
US 20110235531A1 · Vangal et al. · 2011 [cited by applicant]
US 20110310739A1 · Aybay · 2011 [cited by applicant]
US 20110313961A1 · Toscano et al. · 2011 [cited by applicant]
US 20110314255A1 · Krishna et al. · 2011 [cited by applicant]
US 20120084533A1 · Sperber et al. · 2012 [cited by applicant]
US 20120131288A1 · Box et al. · 2012 [cited by applicant]
US 20120137119A1 · Doerr et al. · 2012 [cited by applicant]
US 20120210324A1 · Truschin et al. · 2012 [cited by applicant]
US 20130031040A1 · Modha · 2013 [cited by applicant]
US 20130070588A1 · Steele et al. · 2013 [cited by applicant]
US 20130073497A1 · Akopyan et al. · 2013 [cited by applicant]
US 20130073498A1 · Izhikevich et al. · 2013 [cited by applicant]
US 20130086367A1 · Gschwind et al. · 2013 [cited by applicant]
US 20130198488A1 · Pechanek · 2013 [cited by applicant]
US 20130322459A1 · Xu · 2013 [cited by applicant]
US 20140046882A1 · Wood · 2014 [cited by applicant]
US 20140115208A1 · Willey et al. · 2014 [cited by applicant]
US 20140143470A1 · Dobbs et al. · 2014 [cited by applicant]
US 20140181501A1 · Hicok et al. · 2014 [cited by applicant]
US 20140211630A1 · Cavanna et al. · 2014 [cited by applicant]
US 20140282560A1 · Hutton et al. · 2014 [cited by applicant]
US 20140282580A1 · Zeng et al. · 2014 [cited by applicant]
US 20140313972A1 · Kim · 2014 [cited by applicant]
US 20140324934A1 · Hrdy et al. · 2014 [cited by applicant]
US 20150074162A1 · Carter et al. · 2015 [cited by applicant]
US 20150089095A1 · Stark · 2015 [cited by applicant]
US 20150124828A1 · CJ et al. · 2015 [cited by applicant]
US 20150127925A1 · Follett et al. · 2015 [cited by applicant]
US 20150188847A1 · Chopra et al. · 2015 [cited by applicant]
US 20150195182A1 · Mathur et al. · 2015 [cited by applicant]
US 20150242463A1 · Lin et al. · 2015 [cited by applicant]
US 20150242741A1 · Campos et al. · 2015 [cited by applicant]
US 20150302295A1 · Rivera et al. · 2015 [cited by applicant]
US 20150304797A1 · Rhoads et al. · 2015 [cited by applicant]
US 20150324684A1 · Alvarez-Icaza Rivera · 2015 [cited by applicant]
US 20150324690A1 · Chilimbi et al. · 2015 [cited by applicant]
US 20150378734A1 · Hansen et al. · 2015 [cited by applicant]
US 20150379670A1 · Koker et al. · 2015 [cited by applicant]
US 20160014229A1 · Seedorf et al. · 2016 [cited by applicant]
US 20160019061A1 · Chatha et al. · 2016 [cited by applicant]
US 20160098296A1 · Ash · 2016 [cited by applicant]
US 20160182398A1 · Davis et al. · 2016 [cited by applicant]
US 20160182405A1 · Chen et al. · 2016 [cited by applicant]
US 20160203401A1 · Duranton et al. · 2016 [cited by applicant]
US 20160210381A1 · Singleton et al. · 2016 [cited by applicant]
US 20160224889A1 · Alvarez Icaza Rivera et al. · 2016 [cited by applicant]
US 20160239647A1 · Johnson et al. · 2016 [cited by applicant]
US 20160246337A1 · Colgan et al. · 2016 [cited by applicant]
US 20160301618A1 · Labonte et al. · 2016 [cited by applicant]
US 20160328239A1 · Iyer et al. · 2016 [cited by applicant]
US 20160328647A1 · Lin et al. · 2016 [cited by applicant]
US 20160330112A1 · Raindel et al. · 2016 [cited by applicant]
US 20160379115A1 · Burger et al. · 2016 [cited by applicant]
US 20160379137A1 · Burger et al. · 2016 [cited by applicant]
US 20170011288A1 · Brothers et al. · 2017 [cited by applicant]
US 20170061041A1 · Kumar et al. · 2017 [cited by applicant]
US 20170083315A1 · Burger et al. · 2017 [cited by applicant]
US 20170083335A1 · Burger et al. · 2017 [cited by applicant]
US 20170094527A1 · Shattil et al. · 2017 [cited by applicant]
US 20170102920A1 · Henry et al. · 2017 [cited by applicant]
US 20170102939A1 · Lutz et al. · 2017 [cited by applicant]
US 20170110968A1 · Shepard et al. · 2017 [cited by applicant]
US 20170118139A1 · Bandic et al. · 2017 [cited by applicant]
US 20170220342A1 · Bradbury et al. · 2017 [cited by applicant]
US 20170295061A1 · Wittenschlaeger · 2017 [cited by applicant]
US 20170295111A1 · Sadowski et al. · 2017 [cited by applicant]
US 20170300333A1 · Wang et al. · 2017 [cited by applicant]
US 20170316116A1 · Elliott · 2017 [cited by applicant]
US 20180013657A1 · Cantwell et al. · 2018 [cited by applicant]
US 20180046894A1 · Yao · 2018 [cited by applicant]
US 20180046906A1 · Dally et al. · 2018 [cited by applicant]
US 20180060244A1 · Godard · 2018 [cited by applicant]
US 20180077228A1 · Blagodurov · 2018 [cited by applicant]
US 20180088940A1 · Rubanovich et al. · 2018 [cited by applicant]
US 20180095751A1 · Aminot et al. · 2018 [cited by applicant]
US 20180132055A1 · Leedy · 2018 [cited by applicant]
US 20180157465A1 · Bittner et al. · 2018 [cited by applicant]
US 20180174041A1 · Imam et al. · 2018 [cited by applicant]
US 20180189056A1 · Turakhia et al. · 2018 [cited by applicant]
US 20180189063A1 · Fleming et al. · 2018 [cited by applicant]
US 20180189231A1 · Fleming, Jr. · 2018 [cited by applicant]
US 20180189633A1 · Henry et al. · 2018 [cited by applicant]
US 20180189642A1 · Boesch et al. · 2018 [cited by applicant]
US 20180189652A1 · Korthikanti et al. · 2018 [cited by applicant]
US 20180218257A1 · Xu et al. · 2018 [cited by applicant]
US 20180218518A1 · Yan et al. · 2018 [cited by applicant]
US 20180302306A1 · Carroll et al. · 2018 [cited by applicant]
US 20180314941A1 · Lie et al. · 2018 [cited by applicant]
US 20190042377A1 · Teig et al. · 2019 [cited by applicant]
US 20190130250A1 · Park et al. · 2019 [cited by applicant]
US 20190132928A1 · Rodinger et al. · 2019 [cited by applicant]
US 20190138423A1 · Agerstam et al. · 2019 [cited by applicant]
US 20190244058A1 · Franca-Neto et al. · 2019 [cited by applicant]
US 20190244933A1 · Or-Bach et al. · 2019 [cited by applicant]
US 20190258919A1 · Lie et al. · 2019 [cited by applicant]
US 20190258920A1 · Lie et al. · 2019 [cited by applicant]
US 20190258921A1 · Lie et al. · 2019 [cited by applicant]
US 20190286987A1 · Lie et al. · 2019 [cited by applicant]
US 20190303743A1 · Venkataramani et al. · 2019 [cited by applicant]
US 20190324759A1 · Yang et al. · 2019 [cited by applicant]
US 20190332926A1 · Lie et al. · 2019 [cited by applicant]
US 20190340064A1 · Sity et al. · 2019 [cited by applicant]
US 20190341091A1 · Sity et al. · 2019 [cited by applicant]
US 20190347555A1 · Park et al. · 2019 [cited by applicant]
US 20200005142A1 · Lie et al. · 2020 [cited by applicant]
US 20200125934A1 · Lie et al. · 2020 [cited by applicant]
US 20200133741A1 · Lie et al. · 2020 [cited by applicant]
US 20200336421A1 · Sebexen et al. · 2020 [cited by applicant]
US 20200364546A1 · Lie et al. · 2020 [cited by applicant]
US 20200380341A1 · Lie et al. · 2020 [cited by applicant]
US 20200380344A1 · Lie et al. · 2020 [cited by applicant]
US 20200380370A1 · Lie et al. · 2020 [cited by applicant]
US 20210004674A1 · Lie et al. · 2021 [cited by applicant]
US 20210056400A1 · Lie et al. · 2021 [cited by applicant]
US 20210072894A1 · Chawla et al. · 2021 [cited by applicant]
US 20210097376A1 · Lie · 2021 [cited by examiner]
US 20210142155A1 · James et al. · 2021 [cited by applicant]
US 20210142167A1 · Lie et al. · 2021 [cited by applicant]
US 20210166109A1 · Lie et al. · 2021 [cited by applicant]
US 20210224639A1 · Lie et al. · 2021 [cited by applicant]
US 20210248453A1 · Lauterbach · 2021 [cited by examiner]
US 20210255860A1 · Morrison et al. · 2021 [cited by applicant]
US 20210256362A1 · Lie et al. · 2021 [cited by applicant]
US 20220172030A1 · James · 2022 [cited by applicant]
US 20220172031A1 · Lie et al. · 2022 [cited by applicant]
US 20220284275A1 · Lie et al. · 2022 [cited by applicant]
US 20220343136A1 · Morrison et al. · 2022 [cited by applicant]
US 20220374288A1 · Kibardin et al. · 2022 [cited by applicant]
US 20220398443A1 · Lie et al. · 2022 [cited by applicant]
US 20230069536A1 · Morrison et al. · 2023 [cited by applicant]
US 20230071424A1 · Kibardin et al. · 2023 [cited by applicant]
US 20230125522A1 · Kibardin et al. · 2023 [cited by applicant]
US 20230162012A1 · Morrison et al. · 2023 [cited by applicant]
CN 101778049A · 2010 [cited by applicant]
EP 638867A2 · 1995 [cited by applicant]
EP 2051459A1 · 2009 [cited by applicant]
EP 3153996A2 · 2017 [cited by applicant]
JP H025173A · 1990 [cited by applicant]
JP 1991175548A · 1991 [cited by applicant]
JP H03175548A · 1991 [cited by applicant]
JP 1993265996A · 1993 [cited by applicant]
JP 668056A · 1994 [cited by applicant]
JP 6110864A · 1994 [cited by applicant]
JP 07152722A · 1995 [cited by applicant]
JP 1995234841A · 1995 [cited by applicant]
JP 2009129447A · 2009 [cited by applicant]
JP 2015535630A · 2015 [cited by applicant]
KR 1020170099848A · 2017 [cited by applicant]
WO 9716792A1 · 1997 [cited by applicant]
WO 2012044432A1 · 2012 [cited by applicant]
WO 2014081457A1 · 2014 [cited by applicant]
WO 2014081461A1 · 2014 [cited by applicant]
WO 2015126495A2 · 2015 [cited by applicant]
WO 2016186813A · 2016 [cited by applicant]
WO 2016210014A1 · 2016 [cited by applicant]
WO 2017003887A1 · 2017 [cited by applicant]
WO 2017048655A1 · 2017 [cited by applicant]
WO 2017129325A1 · 2017 [cited by applicant]
WO 2017214728A1 · 2017 [cited by applicant]
WO 2018154494A1 · 2018 [cited by applicant]
WO 2018189728A1 · 2018 [cited by applicant]
WO 2018193352A1 · 2018 [cited by applicant]
WO 2018193353A1 · 2018 [cited by applicant]
WO 2018193354A1 · 2018 [cited by applicant]
WO 2018193360A1 · 2018 [cited by applicant]
WO 2018193361A1 · 2018 [cited by applicant]
WO 2018193363A1 · 2018 [cited by applicant]
WO 2018193370A1 · 2018 [cited by applicant]
WO 2018193377A1 · 2018 [cited by applicant]
WO 2018193379A1 · 2018 [cited by applicant]
WO 2018193380A1 · 2018 [cited by applicant]
WO 2020021395A1 · 2020 [cited by applicant]
WO 2020044152A1 · 2020 [cited by applicant]
WO 2020044208A1 · 2020 [cited by applicant]
WO 2020044238A1 · 2020 [cited by applicant]
WO 2021074795A1 · 2021 [cited by applicant]
WO 2021074865A1 · 2021 [cited by applicant]
WO 2021074867A1 · 2021 [cited by applicant]
WO 2021084485A1 · 2021 [cited by applicant]
WO 2021084505A1 · 2021 [cited by applicant]
WO 2021084506A1 · 2021 [cited by applicant]
WO 2022034542 · 2022 [cited by applicant]
“Cosmic Cubism”, Engineering & Science, Mar. 1984, pp. 17-20, 4 sheets. [cited by applicant]
A. Agarwal, et al., “Survey of Network on Chip (NoC) Architectures & Contributions”, Journal of Engineering, Computing and Architecture, vol. 3, Issue 1, Scientific Journals International, a division of Global Commerce … [cited by applicant]
A. H. Benyamina, B.Beldjilali S. Eltar, K. Dellal, “Mapping Real Time Applications on NoC Architecture with Hybrid Multi-objective PSO Algorithm,” Actes du Septième Colloque sur l'Optimisation et les Systèmes d'informat… [cited by applicant]
Alex Krizhevsky et al, ImageNet Classification with Deep Convolutional Neural Networks, in Advances in Neural Information Processing Systems (NIPS), vol. 25, pp. 1106-1114, 2012, 9 pages. [cited by applicant]
Alireza Monemi et al, “Low latency network-on-chip router microarchitecture using request masking technique”, International Journal of Reconfigurable Computing, Jan. 1, 2015, Hindawi Publising Corportation, vol. 2015, 1… [cited by applicant]
Ardavan Pedram, William Lynch, Gary Lauterbach, “Accelerating Training in the Cloud”, a tutorial presented at Hot Chips: A Symposium on High Performance Chips, HC30 (2018), Cupertino, California, USA, Aug. 19-21, 2018, … [cited by applicant]
Ardavan Pedram, William Lynch, Gary Lauterbach, “Accelerating Training in the Cloud”, a tutorial presented at Hot Chips: A Symposium on High Performance Chips, HC30 (2018), Cupertino, California, USA, Aug. 19-21, 2018, … [cited by applicant]
C. Farabet, B. Martini, P. Akselrod, S. Talay, Y. LeCun, E. Culurciello, “Hardware Accelerated Convolutional Neural Networks for Synthetic Vision Systems”, Proc. of 2010 IEEE Int'l Symp. on Circuits and Systems, Paris, … [cited by applicant]
Canadian Intellectual Property Office, Canadian Patent Application No. 3,051,990, Office Action, Mar. 9, 2020, 5 pages. [cited by applicant]
Canadian Intellectual Property Office, Canadian Patent Application No. 3,060,350, Office Action, Apr. 14, 2021, 4 pages. [cited by applicant]
Canadian Intellectual Property Office, Canadian Patent Application No. 3,060,356, Office Action, Feb. 28, 2020, 7 pages. [cited by applicant]
Charles L. Seitz, “The Cosmic Cube”, Communications of the ACM, Jan. 1985, vol. 28 No. 2, 12 pages. [cited by applicant]
Christian Szegedy et al, Going deeper with convolutions, in arXiv.org (A Cornell University Library e-print service & repository) [online], Sep. 17, 2014, arXiv:1409.4842v1 [cs.CV] (arXiv identifier & primary classifica… [cited by applicant]
D. Moloney, “Embedded Deep Neural Networks: The Cost of Everything and the Value of Nothing”, Hot Chips: A Symposium on High Performance Chips, HC28 (2016), Cupertino, California, USA, Aug. 21-23, 2016, IEEE Technical C… [cited by applicant]
Daniel U. Becker, dissertation entitled “Efficient Microarchitecture for Network-on-Chip Routers”, Submitted to the Department of Electrical Engineering, Thesis (Ph.D.)—Stanford University, Aug. 2012, 193 pages. [cited by applicant]
Dominik Scherer , Hannes Schulz , Sven Behnke, “Accelerating Large-Scale Convolutional Neural Networks with Parallel Graphics Multiprocessors”, 20th International Conference on Artificial Neural Networks (ICANN 2010), P… [cited by applicant]
Dong Y et al: “High dependable implementation of Neural Networks with networks on chip architecture and a backtracking routing algorithm”, Jan. 19, 2009, (pp. 404-407), 4 pages. [cited by applicant]
European search report European Application No. 18786968.0, Sep. 18, 2020, 10 pages. [cited by applicant]
European search report European Application No. 18788046.3, Mar. 27, 2020, 10 pages. [cited by applicant]
European search report European Application No. 18788255.0, Apr. 1, 2020, 11 pages. [cited by applicant]
European search report European Application No. 18788260.0, Apr. 3, 2020, 10 pages. [cited by applicant]
European search report in the related case PCT/IB2018/051128, Jan. 7, 2020, 8 pages. [cited by applicant]
European search report, European Application No. 18787945.7, Feb. 3, 2021, 13 pages. [cited by applicant]
European search report, European Application No. 18788046.3, Feb. 22, 2021, 9 pages. [cited by applicant]
European search report, European Application No. 18788154.5 , Dec. 12, 2020, 6 pages. [cited by applicant]
European search report, European Application No. 18788154.5 , Mar. 16, 2020, 9 pages. [cited by applicant]
F. A. Samman, “Microarchitecture and Implementation of Networks-on-Chip with a Flexible Concept for Communication Media Sharing”, Dissertation (Doctoral Thesis), Technische Universität Darmstadt: Fachbereich Elektrotech… [cited by applicant]
G. Efland, S. Parkh, H. Sanghavi, and A. Farooqui. “High Performance DSP for Vision, Imaging and Neural Networks”, Hot Chips: A Symposium on High Performance Chips, HC28 (2016), Cupertino, California, USA, Aug. 21-23, 2… [cited by applicant]
Gadea, R., et al, Artificial Neural Network Implementation on a single FPGA of a Pipelined On-Line Backpropagation, In Proceedings of the 13th International Symposium on System Synthesis, Sep. 2000, pp. 225-230, IEEE, M… [cited by applicant]
Gaunt, A. L., et al, AMPNet: Asynchronous Model-Parallel Training for Dynamic Neural Networks, in arXiv.org (A Cornell University Library e-print service & repository) [online], Jun. 22, 2017, arXiv: 1705.09786v3 [cs.LG… [cited by applicant]
Girones, R. G., et al, Forward-Backward Parallelism in On-Line Backpropagation, in Engineering Applications of Bio-Inspired Artificial Neural Networks, Proceedings of the International Work-Conference on Artificial and … [cited by applicant]
Girones, R. G., et al, Systolic Implementation of a Pipelined On-Line Backpropagation, in Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems, Apr. 7-9, 199… [cited by applicant]
Heidi Pan et al, “Heads and Tails: A Variable-Length Instruction Format Supporting Parallel Fetch and Decode” Cases '01, Nov. 16-17, 2001, Atlanta, Georgia, USA. Copyright 2001 ACM 1-58113-399-5/01/0011, 8 sheets. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in PCT/IB2018/051128, Jun. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in PCT/IB2018/052606, Apr. 1, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in the related PCT/IB2018/052602, Aug. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in the related PCT/IB2018/052638, Aug. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in the related PCT/IB2018/052640, Aug. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in the related PCT/IB2018/052651, Aug. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Ch II) in the related PCT/IB2018/052667, Aug. 7, 2019, 4 pages. [cited by applicant]
International Preliminary Report on Patentability (Chapter II) in PCT/IB2018/052607 (the International stage of the instant case), Aug. 7, 2019, 4 pages. [cited by applicant]
International Search Report in PCT/IB2018/052607 (the international stage of the instant case), Jul. 27, 2018, 8 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/051128, Jun. 14, 2018, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052602, Jul. 31, 2018, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052606, Jul. 26, 2018, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052610, Jul. 30, 2018, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052638, Aug. 7, 2018, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052640, Aug. 7, 2018, 5 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052643, Aug. 7, 2018, 4 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052651, Jul. 31, 2018, 3 pages. [cited by applicant]
International Search Report in PCT/IB2020/059736 (the international stage of the instant case), Feb. 15, 2021, 3 pages. [cited by applicant]
Written Opinion of the International Searching Authority in PCT/IB2020/059736 (the international stage of the instant case), Feb. 15, 2021, 8 pages. [cited by applicant]
Fergal Cotter et al., Deep Learning in the Wavelet Domain, A arXiv:1811.06115v1 [cs.CV], pp. 1-5, Nov. 14, 2018 1-64 pp. 1-4. [cited by applicant]
International Search Report in the related case PCT/IB2018/052664, Aug. 13, 2018, 7 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052666, Aug. 10, 2018, 4 pages. [cited by applicant]
International Search Report in the related case PCT/IB2018/052667, Aug. 9, 2018, 7 pages. [cited by applicant]
International Search Report in the related case PCT/IB2019/056118, Dec. 20, 2019, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2019/056825, Jan. 28, 2020, 3 pages. [cited by applicant]
International Search Report in the related case PCT/IB2019/057172, Jan. 23, 2020, 3 pages. [cited by applicant]
J. Jin, V. Gokhale, A. Dundar, B. Krishnamurthy, B. Martini, and E. Culurciello. “An Efficient Implementation of Deep Convolutional Neural Networks on a Mobile Coprocessor”, 2014 IEEE 57th International Midwest Symposiu… [cited by applicant]
Japan Patent Office, Japanese Patent Application No. 2019-546879, Notice of reason for refusal, Mar. 10, 2020, 4 pages. [cited by applicant]
Japan Patent Office, Japanese Patent Application No. 2019-556705, Notice of reason for refusal, Transmittal Date Jun. 30, 2020, 4 pages. [cited by applicant]
Japan Patent Office, Japanese Patent Application No. 2019-556713, Notice of reason for refusal, Apr. 7, 2020, 14 pages. [cited by applicant]
Japanese Notice of Reasons for Refusal Application No. 2019-556709, Mar. 2, 2021, 9 pages. [cited by applicant]
Joel Emer, Vivienne Sze, Yu-Hsin Chen, Tien-Ju Yang, “Hardware Architectures for Deep Neural Networks”, a tutorial presented at the (44th) International Symposium on Computer Architecture (ISCA 2017), Jun. 24-28, 2017, … [cited by applicant]
Joel Emer, Vivienne Sze, Yu-Hsin Chen, “Hardware Architectures for Deep Neural Networks”, at tutorial presented at the (49th Annual) IEEE/ACM International Symposium on Microarchitecture (Micro-49), Oct. 15-19, 2016, Ta… [cited by applicant]
Johannes Schemmel, Johannes Fieres and Karlheinz Meier. “Wafer-Scale Integration of Analog Neural Networks”, 2008 International Joint Conference on Neural Networks (IJCNN 2008), pp. 431-438, 8 sheets. [cited by applicant]
Jouppi, N. P. et al. “In-Datacenter Performance Analysis of a Tensor Processing Unit”, in arXiv.org (A Cornell University Library e-print service & repository) [online], Apr. 16, 2017, arXiv:1704.04760 [cs.AR] (arXiv id… [cited by applicant]
K. Guo et al., “From Model to FPGA: Software-Hardware Co-Design for Efficient Neural Network Acceleration”, Hot Chips: A Symposium on High Performance Chips, HC28 (2016), Cupertino, California, USA, Aug. 21-23, 2016, IE… [cited by applicant]
K. Ovtcharov, O. Ruwase, J.Y. Kim, J. Fowers, K. Strauss, E.S. Chung, “Accelerating Deep Convolutional Neural Networks Using Specialized Hardware”, Microsoft Research Whitepaper [online], Feb. 22, 2015, Microsoft Corpor… [cited by applicant]
Ka-Ming Keung, ‘A study of on-chip FPGA system with 2D mesh network’, Iowa State University Digital Repository [online], Graduate Theses and Dissertations, 2010, pp. 1-131, [retrieved on Aug. 14, 2018]. Retrieved from t… [cited by applicant]
Karen Simonyan et al, Very Deep Convolutional Networks for Large-Scale Image Recognition, in arXiv.org (A Cornell University Library e-print service & repository) [online], Apr. 10, 2015, arXiv: arXiv:1409.1556v6 [cs.CV… [cited by applicant]
Kurt Shuler, “The Soc Interconnect Fabric: A Brief History”, Arteris IP, Aug. 6, 2013, 9 pages. [cited by applicant]
M.M. Khan, D.R. Lester, L.A. Plana, A. Rast, X. Jin, E. Painkras and S.B. Furber, “SpiNN aker: Mapping Neural Networks onto a Massively-Parallel Chip Multiprocessor”, 2008 International Joint Conference on Neural Networ… [cited by applicant]
Murtagh, P., et al., Bit-serial systolic array implementation of a multilayer perceptron, in IEE Proceedings-E (Computers and Digital Techniques), Sep. 1993, pp. 277-288, vol. 140, Issue 5, IEE. (12 sheets). [cited by applicant]
Narayanamurthy N et al: “Evolving bio plausible design with heterogeneous Noc”, The 15th International Conference on Advanced Communications Technology—ICACT2013, Jan. 27, 2013, (pp. 451-456), 6 pages. [cited by applicant]
National Intellectual Property Administration, PRC, PRC Patent Application No. 2018800135043, Notification of the First Office Action, Jul. 13, 2020, 10 pages. [cited by applicant]
Pande, S., “Design Exploration of EMBRACE Hardware Spiking Neural Network Architecture and Applications”. Dissertation (Doctoral Thesis), Feb. 5, 2014, National University of Ireland, Galway, Ireland, [retrieved on Mar.… [cited by applicant]
Paris Mesidis, “Mapping of Real-time Applications on Network-on-Chip based MPSOCS.” Dissertation (Masters Thesis), The University of York, Department of Computer Science, Heslington, York, UK, Dec. 2011, 105 pages. [cited by applicant]
S Han, X Liu, H Mao, J Pu, A Pedram, M Horowitz, B Dally, “Deep Compression and EIE: Efficient Inference Engine on Compressed Deep Neural Network”, Hot Chips: A Symposium on High Performance Chips, HC28 (2016), Cupertin… [cited by applicant]
S. Schmitt et al., “Neuromorphic Hardware in the Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System”, in arXiv.org (A Cornell University Library e-print service & repository) [online], Mar. 6, 2… [cited by applicant]
Salwa Said et al, ‘Deep Wavelet Network for Image Classification’, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC 2016), Budapest, Oct. 9-12, 2016, pp. 000922-000927, 6 pages. [cited by applicant]
Sam Fuller, “3.1 Processing Element Models”, an excerpt from “RapidIO—The Embedded System Interconnect,” Jan. 2005, John Wiley & Sons, Inc., 3 pages. [cited by applicant]
Seth Copen Goldstein et al, “PipeRench: A Coprocessor for Streaming Multimedia Acceleration”, Appeared in Proceedings of 26th International Symposium on Computer Architecture, ISCA 1999. 12 pages. [cited by applicant]
Soheil Shams and K. Wojtek Przytula, “Mapping of Neural Networks onto Programmable Parallel Machines”, Hughes Research Laboratories Malibu, California 90265, 1990 IEEE, pp. 2613-2617, 5 sheets. [cited by applicant]
V. Gokhale, J. Jin, A. Dundar, B. Martini, E. Culurciello, “A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks”, 2014 IEEE Conf. on Comput. Vis. and Pattern Recognit. Workshops (CVPRW), Columbus, OH, USA, Jun. 23… [cited by applicant]
V. Sze, Y.-H. Chen, T.-J. Yang, and J. Emer, “Efficient Processing of Deep Neural Networks: A Tutorial and Survey”, in arXiv.org (A Cornell University Library e-print service & repository) [online], Aug. 13, 2017, arXiv… [cited by applicant]
Van Der Laan, D. “The Structure and Performance of Optimal Routing Sequences”. Thomas Stieltjes Institute for Mathematics, Sep. 8, 1976 (Sep. 8, 1976), 208 pages. [cited by applicant]
Vinothkumar, M. et al, “Design and Implementation of Router Arbitration in Network on Chip” , Jan. 2014, SSRN Electronic Journal, 6 sheets. [cited by applicant]
Vivienne Sze et al. “Efficient Processing of Deep Neural Networks: A Tutorial and Survey”, Proceedings of the IEEE, vol. 105, No. 12, Dec. 2017, See pp. 2297-2298. 35 pages. [cited by applicant]
William J. Dally and Charles L. Seitz, “The Torus Routing Chip”, Computer Science Department, California Institute of Technology 5208:TR:86, Jan. 24, 1985, 19 pages. [cited by applicant]
William J. Dally et al, “Route packets, not wires: On-chip interconnection networks”, IEEE Xplore. Downloaded on Jan. 26, 2009 at 16:19 from IEEE Xplore, DAC 2001, Jun. 18-22, 2001, Las Vegas, Nevada, USA. pp. 684-689, … [cited by applicant]
Written Opinion of the International Searching Authority in PCT/IB2018/052607 (the international stage of the instant case), Jul. 27, 2018, 9 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/051128, Jun. 14, 2018, 8 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052602, Jul. 31, 2018, 11 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052606, Jul. 26, 2018, 9 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052610, Jul. 30, 2018, 5 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052638, Aug. 7, 2018, 8 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052640, Aug. 7, 2018, 10 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052643, Aug. 7, 2018, 9 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052651 Jul. 31, 2018, 8 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052664, Aug. 13, 2018, 6 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052666, Aug. 10, 2018, 4 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2018/052667, Aug. 9, 2018, 9 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2019/056118, Dec. 20, 2019, 13 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2019/056825, Jan. 28, 2020, 7 pages. [cited by applicant]
Written Opinion of the International Searching Authority in the related case PCT/IB2019/057172, Jan. 23, 2020, 6 pages. [cited by applicant]
Xiao-Wei Shen et al: “An Efficient Network-on-Chip Router for Dataflow Architecture”, Journal of Computer Science and Technology., vol. 32, No. 1, Jan. 1, 2017 (Jan. 1, 2017), pp. 11-25, XP055678469, 15 pages. [cited by applicant]
Xiao-Wei Shen et al., ‘An Efficient Network-on-Chip Router for Dataflow Architecture’, In: Journal of Computer Science and Technology [online & print], vol. 32, Jan. 2017, pp. 11-25, DOI 10.1007/s11390-017-1703-5 (Inter… [cited by applicant]
Yann Lecun et al., Deep learning, in Nature, May 28, 2015, pp. 436-444, vol. 521, Macmillan Publishers Limited, 9 pages. [cited by applicant]
Yiping Dong et al: “High dependable implementation of Neural Networks with networks on chip architecture and a backtracking routing algorithm”, 2009 Asia Pacific Conference on Postgraduate Research in Microelectronics &… [cited by applicant]
Yiping Dong et al: “Network on Chip architecture for BP neural network”, Communications, Circuits and Systems, 2008. ICCCAS 2008. International Conference on, IEEE, Piscataway, NJ, USA, May 25, 2008 (May 25, 2008), pp. … [cited by applicant]
International Search Report in PCT/IB2020/059736 (the international stage of the instant case), Feb. 15, 2021, 8 pages. [cited by applicant]
Written Opinion of the International Searching Authority in PCT/IB2020/059736 (the international stage of the instant case), Feb. 15, 2021, 3 pages. [cited by applicant]
Fergal Cotter et al., Deep Learning in the Wavelet Domain, A arXiv:1811.06115v1 [cs.CV], pp. 1-5, Nov. 14, 2018 1-64 pp. 1-4, 6 pages. [cited by applicant]
Canadian Patent Office, Patent Application No. 3,060,350, Notice of Reasons for Refusal, Jun. 1, 2022, 4 pages. [cited by applicant]