IP Library Granted Patent US 12,229,578
Granted Patent B2
US 12,229,578 · App. 17/560,142 · Granted Feb 18, 2025

Teaming of smart NICs

Inventors: Boon S. Ang (Saratoga, CA); Wenyi Jiang (Fremont, CA); Guolin Yang (San Jose, CA); Jin Heo (Los Altos, CA)
Assignee: VMware LLC
G06F9/45558G06F2009/45595
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,578
App. No.
17/560,142
Granted
Feb 18, 2025
Kind
B2
Abstract

Some embodiments provide a method for a first smart NIC of multiple smart NICs of a host computer. Each of the smart NICs executes a smart NIC operating system that performs virtual networking operations for a set of data compute machines executing on the host computer. The method receives a data message sent by one of the data compute machines executing on the host computer. The method performs virtual networking operations on the data message to determine that the data message is to be transmitted from a port of a second smart NIC of the multiple smart NICs. The method passes the data message to the second smart NIC via a private communication channel connecting the plurality of smart NICs.

Claims (52)

1. A method comprising:

at a first smart network interface controller (NIC) of a plurality of smart NICs of a host computer, each of the smart NICs executing a smart NIC operating system that performs virtual networking operations for a set of data compute machines executing on the host computer:

receiving a data message sent by one of the data compute machines executing on the host computer, the data message comprising a first data message;

performing virtual networking operations on the data message to determine that the data message is to be transmitted from a port of a second smart NIC of the plurality of smart NICs;

passing the data message to the second smart NIC via a private communication channel connecting the plurality of smart NICs;

receiving a second data message from the second smart NIC via the private communication channel, wherein the second smart NIC performed virtual networking operations on the second data message to determine that a destination for the second data message is the data compute machine; and

sending the second data message to the data compute machine through a port of the first smart NIC to which the data compute machine is bound.

2. The method of claim 1 , wherein performing virtual networking operations on the data message to determine that the data message is to be transmitted from a port of a second smart NIC comprises:

based on the virtual networking operations, determining a destination for the data message that is external to the host computer and reachable through a first physical port of the first smart NIC; and

determining that the first physical port of the first smart NIC is not currently operable and that the destination is reachable through a second physical port of the second smart NIC.

3. The method of claim 2 , wherein all of the physical ports of the first smart NIC that connect the host computer to physical networks are inoperable.

4. The method of claim 2 , wherein the data compute machine that sent the data message is bound to a port of the first smart NIC.

5. The method of claim 1 , wherein performing virtual networking operations on the data message comprises:

based on the virtual networking operations, determining a destination for the data message that is external to the host computer; and

performing load balancing to assign the data message to the port of the second smart NIC.

6. The method of claim 5 , wherein:

a set of physical ports of the first smart NIC and a set of physical ports of the second smart NIC are in a same link aggregate group across which data messages are load balanced; and

the data compute machine that sent the data message is bound to an interface of the first smart NIC.

7. The method of claim 1 , wherein:

the data compute machine is a first data compute machine that is bound to the first smart NIC; and

performing virtual networking operations on the data message comprises determining, based on the virtual networking operations, that a destination for the data message is a second data compute machine executing on the host computer that is bound to the second smart NIC.

8. The method of claim 1 , wherein the virtual networking operations comprise logical switching operations.

9. The method of claim 8 , wherein the virtual networking operations further comprise logical routing operations.

10. The method of claim 1 , the method further comprising:

receiving a second data message sent by the data compute machine;

performing virtual networking operations on the data message to determine that the data message is to be transmitted from a physical port of the first smart NIC; and

transmitting the data message from the physical port.

11. A non-transitory machine-readable medium storing a program for execution by at least one processing unit of a first smart network interface controller (NIC) of a plurality of smart NICs of a host computer, each of the smart NICs executing a smart NIC operating system that performs virtual networking operations for a set of data compute machines executing on the host computer, the program comprising sets of instructions for:

receiving a data message sent by one of the data compute machines executing on the host computer;

performing virtual networking operations on the data message to determine that the data message is to be transmitted from a port of a second smart NIC of the plurality of smart NICs; and

passing the data message to the second smart NIC via a private communication channel connecting the plurality of smart NICs;

wherein the set of instructions for performing virtual networking operations on the data message to determine that the data message is to be transmitted from a port of a second smart NIC comprises sets of instructions for:

based on the virtual networking operations, determining a destination for the data message that is external to the host computer and reachable through a first physical port of the first smart NIC; and

determining that the first physical port of the first smart NIC is not currently operable and that the destination is reachable through a second physical port of the second smart NIC.

12. The non-transitory machine-readable medium of claim 11 , wherein all of the physical ports of the first smart NIC that connect the host computer to physical networks are inoperable.

13. The non-transitory machine-readable medium of claim 11 , wherein the data compute machine that sent the data message is bound to a port of the first smart NIC.

14. The non-transitory machine-readable medium of claim 11 , wherein the set of instructions for performing virtual networking operations on the data message comprises sets of instructions for:

based on the virtual networking operations, determining a destination for the data message that is external to the host computer; and

performing load balancing to assign the data message to the port of the second smart NIC.

15. The non-transitory machine-readable medium of claim 14 , wherein:

a set of physical ports of the first smart NIC and a set of physical ports of the second smart NIC are in a same link aggregate group across which data messages are load balanced; and

the data compute machine that sent the data message is bound to an interface of the first smart NIC.

16. The non-transitory machine-readable medium of claim 11 , wherein:

the data compute machine is a first data compute machine that is bound to the first smart NIC; and

the set of instructions for performing virtual networking operations on the data message comprises a set of instructions for determining, based on the virtual networking operations, that a destination for the data message is a second data compute machine executing on the host computer that is bound to the second smart NIC.

17. The non-transitory machine-readable medium of claim 11 , wherein the data message is a first data message, the program further comprising sets of instructions for:

receiving a second data message from the second smart NIC via the private communication channel, wherein the second smart NIC performed virtual networking operations on the second data message to determine that a destination for the second data message is the data compute machine; and

sending the second data message to the data compute machine through a port of the first smart NIC to which the data compute machine is bound.

18. The non-transitory machine-readable medium of claim 17 , wherein the data message is a first data message, the program further comprising sets of instructions for:

receiving a second data message sent by the data compute machine;

performing virtual networking operations on the data message to determine that the data message is to be transmitted from a physical port of the first smart NIC; and

transmitting the data message from the physical port.

Assignments (2)
CHANGE OF NAME Recorded Feb 27, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 066692/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2022
From: ANG, BOON S.; JIANG, WENYI; YANG, GUOLIN; HEO, JIN
To: VMWARE, INC.
Reel/Frame 059627/0913 →
Continuity (1)
Related Publication 20230195488A1 · Jun 22, 2023
References Cited (400)
US 5884313A · Talluri et al. · 1999 [cited by applicant]
US 5887134A · Ebrahim · 1999 [cited by applicant]
US 5974547A · Klimenko · 1999 [cited by applicant]
US 6141749A · Coss et al. · 2000 [cited by applicant]
US 6219699B1 · McCloghrie et al. · 2001 [cited by applicant]
US 6393483B1 · Latif et al. · 2002 [cited by applicant]
US 6496935B1 · Fink et al. · 2002 [cited by applicant]
US 6594704B1 · Birenback et al. · 2003 [cited by applicant]
US 6738821B1 · Wilson et al. · 2004 [cited by applicant]
US 6856995B1 · Ibitayo et al. · 2005 [cited by applicant]
US 6880089B1 · Bommareddy et al. · 2005 [cited by applicant]
US 6963921B1 · Yang et al. · 2005 [cited by applicant]
US 7055173B1 · Chaganty et al. · 2006 [cited by applicant]
US 7079544B2 · Wakayama et al. · 2006 [cited by applicant]
US 7136926B1 · Iyer et al. · 2006 [cited by applicant]
US 7349382B2 · Marimuthu et al. · 2008 [cited by applicant]
US 7424710B1 · Nelson et al. · 2008 [cited by applicant]
US 7512071B2 · Goldschmidt et al. · 2009 [cited by applicant]
US 7606260B2 · Oguchi et al. · 2009 [cited by applicant]
US 7760733B1 · Eiriksson et al. · 2010 [cited by applicant]
US 7774502B2 · Murthy et al. · 2010 [cited by applicant]
US 7818452B2 · Matthews et al. · 2010 [cited by applicant]
US 7849168B2 · Utsunomiya et al. · 2010 [cited by applicant]
US 7853998B2 · Blaisdell et al. · 2010 [cited by applicant]
US 7913294B1 · Maufer et al. · 2011 [cited by applicant]
US 7948986B1 · Ghosh et al. · 2011 [cited by applicant]
US 8032933B2 · Turley et al. · 2011 [cited by applicant]
US 8108550B2 · Lahoti et al. · 2012 [cited by applicant]
US 8145768B1 · Hawthorne · 2012 [cited by applicant]
US 8190767B1 · Maufer et al. · 2012 [cited by applicant]
US 8194674B1 · Pagel et al. · 2012 [cited by applicant]
US 8365294B2 · Ross · 2013 [cited by applicant]
US 8442059B1 · Glesia et al. · 2013 [cited by applicant]
US 8615009B1 · Ramamoorthi et al. · 2013 [cited by applicant]
US 8660129B1 · Brendel et al. · 2014 [cited by applicant]
US 8825900B1 · Gross, IV et al. · 2014 [cited by applicant]
US 8856518B2 · Sridharan et al. · 2014 [cited by applicant]
US 8930529B1 · Wang et al. · 2015 [cited by applicant]
US 8931047B2 · Wanser et al. · 2015 [cited by applicant]
US 9008082B2 · Dyke · 2015 [cited by applicant]
US 9008085B2 · Kamble et al. · 2015 [cited by applicant]
US 9015823B2 · Koponen et al. · 2015 [cited by applicant]
US 9047109B1 · Wang et al. · 2015 [cited by applicant]
US 9116727B2 · Benny et al. · 2015 [cited by applicant]
US 9135044B2 · Maharana · 2015 [cited by applicant]
US 9143582B2 · Banavalikar et al. · 2015 [cited by applicant]
US 9148895B2 · PalChaudhuri et al. · 2015 [cited by applicant]
US 9152593B2 · Galles · 2015 [cited by applicant]
US 9154327B1 · Marino et al. · 2015 [cited by applicant]
US 9197551B2 · DeCusatis et al. · 2015 [cited by applicant]
US 9231849B2 · Hyoudou et al. · 2016 [cited by applicant]
US 9325739B1 · Roth et al. · 2016 [cited by applicant]
US 9378161B1 · Dalal et al. · 2016 [cited by applicant]
US 9380027B1 · Lian et al. · 2016 [cited by applicant]
US 9419897B2 · Cherian et al. · 2016 [cited by applicant]
US 9460031B1 · Dalal et al. · 2016 [cited by applicant]
US 9621516B2 · Basak et al. · 2017 [cited by applicant]
US 9634990B2 · Lee · 2017 [cited by applicant]
US 9692698B2 · Cherian et al. · 2017 [cited by applicant]
US 9729512B2 · Jain et al. · 2017 [cited by applicant]
US 9755903B2 · Masurekar et al. · 2017 [cited by applicant]
US 9806948B2 · Masurekar et al. · 2017 [cited by applicant]
US 9825913B2 · Jain et al. · 2017 [cited by applicant]
US 9916269B1 · Machulsky et al. · 2018 [cited by applicant]
US 10050884B1 · Dhanabalan et al. · 2018 [cited by applicant]
US 10142127B2 · Cherian et al. · 2018 [cited by applicant]
US 10162793B1 · BShara et al. · 2018 [cited by applicant]
US 10193771B2 · Koponen et al. · 2019 [cited by applicant]
US 10284478B2 · Yokota · 2019 [cited by applicant]
US 10341296B2 · Bhagwat et al. · 2019 [cited by applicant]
US 10534629B1 · Pierre et al. · 2020 [cited by applicant]
US 10567308B1 · Subbiah et al. · 2020 [cited by applicant]
US 10873566B2 · Han · 2020 [cited by applicant]
US 10997106B1 · Bandaru et al. · 2021 [cited by applicant]
US 11005755B2 · Yu et al. · 2021 [cited by applicant]
US 11019030B2 · Jain et al. · 2021 [cited by applicant]
US 11038845B2 · Han · 2021 [cited by applicant]
US 11108593B2 · Cherian et al. · 2021 [cited by applicant]
US 11221972B1 · Raman et al. · 2022 [cited by applicant]
US 11385981B1 · Silakov et al. · 2022 [cited by applicant]
US 11593278B2 · Kim et al. · 2023 [cited by applicant]
US 11606310B2 · Ang et al. · 2023 [cited by applicant]
US 11636053B2 · Kim et al. · 2023 [cited by applicant]
US 11677719B2 · Han · 2023 [cited by applicant]
US 11716383B2 · Kim et al. · 2023 [cited by applicant]
US 20020069245A1 · Kim · 2002 [cited by applicant]
US 20030005144A1 · Engel et al. · 2003 [cited by applicant]
US 20030093481A1 · Mitchell et al. · 2003 [cited by applicant]
US 20030097589A1 · Syvanne · 2003 [cited by applicant]
US 20030123452A1 · Cox et al. · 2003 [cited by applicant]
US 20030130833A1 · Brownell et al. · 2003 [cited by applicant]
US 20030140124A1 · Burns · 2003 [cited by applicant]
US 20030145114A1 · Gertner · 2003 [cited by applicant]
US 20030161272A1 · Teplitsky · 2003 [cited by applicant]
US 20030200290A1 · Zimmerman et al. · 2003 [cited by applicant]
US 20030212900A1 · Liu et al. · 2003 [cited by applicant]
US 20030217119A1 · Raman et al. · 2003 [cited by applicant]
US 20040022259A1 · Tuchow · 2004 [cited by applicant]
US 20040049701A1 · Pennec et al. · 2004 [cited by applicant]
US 20050053079A1 · Havala · 2005 [cited by applicant]
US 20050114337A1 · Lunteren · 2005 [cited by applicant]
US 20050198125A1 · Beck et al. · 2005 [cited by applicant]
US 20050229246A1 · Rajagopal et al. · 2005 [cited by applicant]
US 20050238022A1 · Panigrahy · 2005 [cited by applicant]
US 20060002386A1 · Yik et al. · 2006 [cited by applicant]
US 20060029056A1 · Perera et al. · 2006 [cited by applicant]
US 20060041894A1 · Cheng et al. · 2006 [cited by applicant]
US 20060191003A1 · Bahk et al. · 2006 [cited by applicant]
US 20060206603A1 · Rajan et al. · 2006 [cited by applicant]
US 20060206655A1 · Chappell et al. · 2006 [cited by applicant]
US 20060236054A1 · Kitamura · 2006 [cited by applicant]
US 20070011734A1 · Balakrishnan et al. · 2007 [cited by applicant]
US 20070056038A1 · Lok · 2007 [cited by applicant]
US 20070061492A1 · Riel · 2007 [cited by applicant]
US 20070174850A1 · Zur · 2007 [cited by applicant]
US 20080008202A1 · Terrell et al. · 2008 [cited by applicant]
US 20080028097A1 · Makela · 2008 [cited by applicant]
US 20080072305A1 · Casado et al. · 2008 [cited by applicant]
US 20080086620A1 · Morris · 2008 [cited by applicant]
US 20080163207A1 · Reumann et al. · 2008 [cited by applicant]
US 20080267177A1 · Johnson et al. · 2008 [cited by applicant]
US 20080289028A1 · Jansen et al. · 2008 [cited by applicant]
US 20080298274A1 · Takashige et al. · 2008 [cited by applicant]
US 20090007251A1 · Abzarian et al. · 2009 [cited by applicant]
US 20090089537A1 · Vick et al. · 2009 [cited by applicant]
US 20090119087A1 · Ang et al. · 2009 [cited by applicant]
US 20090129271A1 · Ramankutty et al. · 2009 [cited by applicant]
US 20090129394A1 · Bar-Kovetz et al. · 2009 [cited by applicant]
US 20090150521A1 · Tripathi · 2009 [cited by applicant]
US 20090161547A1 · Riddle et al. · 2009 [cited by applicant]
US 20090161673A1 · Breslau et al. · 2009 [cited by applicant]
US 20090235325A1 · Dimitrakos et al. · 2009 [cited by applicant]
US 20090249470A1 · Litvin et al. · 2009 [cited by applicant]
US 20090249472A1 · Litvin et al. · 2009 [cited by applicant]
US 20090327781A1 · Tripathi · 2009 [cited by applicant]
US 20100014526A1 · Chavan et al. · 2010 [cited by applicant]
US 20100037311A1 · He et al. · 2010 [cited by applicant]
US 20100070677A1 · Thakkar · 2010 [cited by applicant]
US 20100100616A1 · Bryson et al. · 2010 [cited by applicant]
US 20100115174A1 · Akyol et al. · 2010 [cited by applicant]
US 20100115208A1 · Logan · 2010 [cited by applicant]
US 20100125667A1 · Soundararajan · 2010 [cited by applicant]
US 20100165874A1 · Brown et al. · 2010 [cited by applicant]
US 20100257580A1 · Zhao · 2010 [cited by applicant]
US 20100275199A1 · Smith et al. · 2010 [cited by applicant]
US 20100287306A1 · Matsuda · 2010 [cited by applicant]
US 20110016467A1 · Kane · 2011 [cited by applicant]
US 20110022695A1 · Dalal et al. · 2011 [cited by applicant]
US 20110060859A1 · Shukla et al. · 2011 [cited by applicant]
US 20110072486A1 · Hadar et al. · 2011 [cited by applicant]
US 20110103259A1 · Aybay et al. · 2011 [cited by applicant]
US 20110113467A1 · Agarwal et al. · 2011 [cited by applicant]
US 20110134920A1 · Dyke · 2011 [cited by applicant]
US 20110219170A1 · Frost et al. · 2011 [cited by applicant]
US 20110225647A1 · Dilley et al. · 2011 [cited by applicant]
US 20110246637A1 · Murakami · 2011 [cited by applicant]
US 20120042138A1 · Eguchi et al. · 2012 [cited by applicant]
US 20120072909A1 · Malik et al. · 2012 [cited by applicant]
US 20120079478A1 · Galles et al. · 2012 [cited by applicant]
US 20120096459A1 · Miyazaki · 2012 [cited by applicant]
US 20120163388A1 · Goel et al. · 2012 [cited by applicant]
US 20120167082A1 · Kumar et al. · 2012 [cited by applicant]
US 20120207039A1 · Srinivasan et al. · 2012 [cited by applicant]
US 20120207174A1 · Shieh · 2012 [cited by applicant]
US 20120240182A1 · Narayanaswamy et al. · 2012 [cited by applicant]
US 20120259953A1 · Gertner · 2012 [cited by applicant]
US 20120278584A1 · Nagami et al. · 2012 [cited by applicant]
US 20120290703A1 · Barabash et al. · 2012 [cited by applicant]
US 20120320918A1 · Fomin et al. · 2012 [cited by applicant]
US 20130007740A1 · Kikuchi et al. · 2013 [cited by applicant]
US 20130033993A1 · Cardona et al. · 2013 [cited by applicant]
US 20130044631A1 · Biswas et al. · 2013 [cited by applicant]
US 20130058346A1 · Sridharan et al. · 2013 [cited by applicant]
US 20130061047A1 · Sridharan et al. · 2013 [cited by applicant]
US 20130073702A1 · Umbehocker · 2013 [cited by applicant]
US 20130073743A1 · Ramasamy et al. · 2013 [cited by applicant]
US 20130125122A1 · Hansen · 2013 [cited by applicant]
US 20130125230A1 · Koponen et al. · 2013 [cited by applicant]
US 20130145106A1 · Kan · 2013 [cited by applicant]
US 20130163594A1 · Sharma et al. · 2013 [cited by applicant]
US 20130227097A1 · Yasuda et al. · 2013 [cited by applicant]
US 20130227550A1 · Weinstein et al. · 2013 [cited by applicant]
US 20130265883A1 · Henry et al. · 2013 [cited by applicant]
US 20130311663A1 · Kamath et al. · 2013 [cited by applicant]
US 20130318219A1 · Kancherla · 2013 [cited by applicant]
US 20130318268A1 · Dalal et al. · 2013 [cited by applicant]
US 20130332983A1 · Koorevaar et al. · 2013 [cited by applicant]
US 20130346583A1 · Low et al. · 2013 [cited by applicant]
US 20140003442A1 · Hernandez et al. · 2014 [cited by applicant]
US 20140056151A1 · Petrus et al. · 2014 [cited by applicant]
US 20140067763A1 · Jorapurkar et al. · 2014 [cited by applicant]
US 20140068602A1 · Gember et al. · 2014 [cited by applicant]
US 20140074799A1 · Karampuri et al. · 2014 [cited by applicant]
US 20140098815A1 · Mishra et al. · 2014 [cited by applicant]
US 20140115578A1 · Cooper et al. · 2014 [cited by applicant]
US 20140123211A1 · Wanser et al. · 2014 [cited by applicant]
US 20140164595A1 · Bray et al. · 2014 [cited by applicant]
US 20140195666A1 · Dumitriu et al. · 2014 [cited by applicant]
US 20140201305A1 · Dalal et al. · 2014 [cited by applicant]
US 20140208075A1 · McCormick, Jr. · 2014 [cited by applicant]
US 20140215036A1 · Elzur · 2014 [cited by applicant]
US 20140244983A1 · McDonald et al. · 2014 [cited by applicant]
US 20140245296A1 · Sethuramalingam et al. · 2014 [cited by applicant]
US 20140245423A1 · Lee · 2014 [cited by applicant]
US 20140269712A1 · Kidambi · 2014 [cited by applicant]
US 20140269754A1 · Eguchi et al. · 2014 [cited by applicant]
US 20140281030A1 · Cui et al. · 2014 [cited by applicant]
US 20140282855A1 · Clark et al. · 2014 [cited by applicant]
US 20140330977A1 · Bemmel · 2014 [cited by applicant]
US 20140373148A1 · Nelms et al. · 2014 [cited by applicant]
US 20140376367A1 · Jain et al. · 2014 [cited by applicant]
US 20150007317A1 · Jain · 2015 [cited by applicant]
US 20150016300A1 · Devireddy et al. · 2015 [cited by applicant]
US 20150019748A1 · Gross, IV et al. · 2015 [cited by applicant]
US 20150020067A1 · Brant et al. · 2015 [cited by applicant]
US 20150033222A1 · Hussain et al. · 2015 [cited by applicant]
US 20150052280A1 · Lawson · 2015 [cited by applicant]
US 20150082417A1 · Bhagwat et al. · 2015 [cited by applicant]
US 20150117445A1 · Koponen et al. · 2015 [cited by applicant]
US 20150156250A1 · Varshney et al. · 2015 [cited by applicant]
US 20150172183A1 · DeCusatis et al. · 2015 [cited by applicant]
US 20150200808A1 · Gourlay et al. · 2015 [cited by applicant]
US 20150212892A1 · Li et al. · 2015 [cited by applicant]
US 20150215207A1 · Qin et al. · 2015 [cited by applicant]
US 20150222547A1 · Hayut et al. · 2015 [cited by applicant]
US 20150237013A1 · Bansal et al. · 2015 [cited by applicant]
US 20150242134A1 · Takada et al. · 2015 [cited by applicant]
US 20150261556A1 · Jain et al. · 2015 [cited by applicant]
US 20150261720A1 · Kagan et al. · 2015 [cited by applicant]
US 20150281178A1 · Raman et al. · 2015 [cited by applicant]
US 20150281179A1 · Raman et al. · 2015 [cited by applicant]
US 20150326532A1 · Grant et al. · 2015 [cited by applicant]
US 20150347231A1 · Gopal et al. · 2015 [cited by applicant]
US 20150358288A1 · Jain et al. · 2015 [cited by applicant]
US 20150358290A1 · Jain et al. · 2015 [cited by applicant]
US 20150381494A1 · Cherian et al. · 2015 [cited by applicant]
US 20150381495A1 · Cherian et al. · 2015 [cited by applicant]
US 20160006696A1 · Donley et al. · 2016 [cited by applicant]
US 20160092108A1 · Karaje et al. · 2016 [cited by applicant]
US 20160134702A1 · Gertner · 2016 [cited by applicant]
US 20160142320A1 · Gyllenhammer et al. · 2016 [cited by applicant]
US 20160156591A1 · Zhou et al. · 2016 [cited by applicant]
US 20160162302A1 · Warszawski et al. · 2016 [cited by applicant]
US 20160162438A1 · Hussain et al. · 2016 [cited by applicant]
US 20160179579A1 · Amann et al. · 2016 [cited by applicant]
US 20160182342A1 · Singaravelu et al. · 2016 [cited by applicant]
US 20160239330A1 · Bride et al. · 2016 [cited by applicant]
US 20160285913A1 · Itskin et al. · 2016 [cited by applicant]
US 20160294858A1 · Woolward et al. · 2016 [cited by applicant]
US 20160306648A1 · Deguillard et al. · 2016 [cited by applicant]
US 20170005986A1 · Bansal et al. · 2017 [cited by applicant]
US 20170024334A1 · Bergsten et al. · 2017 [cited by applicant]
US 20170075845A1 · Kopparthi · 2017 [cited by applicant]
US 20170093623A1 · Zheng · 2017 [cited by applicant]
US 20170099532A1 · Kakande · 2017 [cited by applicant]
US 20170104790A1 · Meyers et al. · 2017 [cited by applicant]
US 20170118173A1 · Arramreddy et al. · 2017 [cited by applicant]
US 20170134433A1 · Hugenbruch et al. · 2017 [cited by applicant]
US 20170161090A1 · Kodama · 2017 [cited by applicant]
US 20170161189A1 · Gertner · 2017 [cited by applicant]
US 20170180273A1 · Daly et al. · 2017 [cited by applicant]
US 20170180414A1 · Andrews et al. · 2017 [cited by applicant]
US 20170187679A1 · Basak et al. · 2017 [cited by applicant]
US 20170195454A1 · Shieh · 2017 [cited by applicant]
US 20170208100A1 · Lian et al. · 2017 [cited by applicant]
US 20170214549A1 · Yoshino et al. · 2017 [cited by applicant]
US 20170244671A1 · Kamalakantha et al. · 2017 [cited by applicant]
US 20170244673A1 · Han · 2017 [cited by applicant]
US 20170244674A1 · Han · 2017 [cited by applicant]
US 20170264622A1 · Cooper et al. · 2017 [cited by applicant]
US 20170295033A1 · Cherian et al. · 2017 [cited by applicant]
US 20180024775A1 · Miller · 2018 [cited by applicant]
US 20180024964A1 · Mao et al. · 2018 [cited by applicant]
US 20180032249A1 · Makhervaks et al. · 2018 [cited by applicant]
US 20180088978A1 · Li et al. · 2018 [cited by applicant]
US 20180095872A1 · Dreier et al. · 2018 [cited by applicant]
US 20180097778A1 · Jain et al. · 2018 [cited by applicant]
US 20180109471A1 · Chang et al. · 2018 [cited by applicant]
US 20180152540A1 · Niell et al. · 2018 [cited by applicant]
US 20180219770A1 · Wu · 2018 [cited by examiner]
US 20180260125A1 · Botes et al. · 2018 [cited by applicant]
US 20180262599A1 · Firestone · 2018 [cited by applicant]
US 20180278684A1 · Rashid et al. · 2018 [cited by applicant]
US 20180309641A1 · Wang et al. · 2018 [cited by applicant]
US 20180309718A1 · Zuo · 2018 [cited by applicant]
US 20180329743A1 · Pope et al. · 2018 [cited by applicant]
US 20180331976A1 · Pope et al. · 2018 [cited by applicant]
US 20180336346A1 · Guenther · 2018 [cited by applicant]
US 20180337991A1 · Kumar et al. · 2018 [cited by applicant]
US 20180349037A1 · Zhao et al. · 2018 [cited by applicant]
US 20180359215A1 · Khare et al. · 2018 [cited by applicant]
US 20190042506A1 · Devey et al. · 2019 [cited by applicant]
US 20190044809A1 · Willis et al. · 2019 [cited by applicant]
US 20190044866A1 · Chilikin et al. · 2019 [cited by applicant]
US 20190075063A1 · McDonnell et al. · 2019 [cited by applicant]
US 20190132296A1 · Jiang et al. · 2019 [cited by applicant]
US 20190158396A1 · Yu et al. · 2019 [cited by applicant]
US 20190173689A1 · Cherian et al. · 2019 [cited by applicant]
US 20190200105A1 · Cheng et al. · 2019 [cited by applicant]
US 20190235909A1 · Jin et al. · 2019 [cited by applicant]
US 20190278675A1 · Bolkhovitin et al. · 2019 [cited by applicant]
US 20190280980A1 · Hyoudou · 2019 [cited by applicant]
US 20190286373A1 · Karumbunathan et al. · 2019 [cited by applicant]
US 20190306083A1 · Shih et al. · 2019 [cited by applicant]
US 20200021532A1 · Borikar et al. · 2020 [cited by applicant]
US 20200028800A1 · Strathman et al. · 2020 [cited by applicant]
US 20200042234A1 · Krasner et al. · 2020 [cited by applicant]
US 20200042389A1 · Kulkarni et al. · 2020 [cited by applicant]
US 20200042412A1 · Kulkarni et al. · 2020 [cited by applicant]
US 20200133909A1 · Hefty et al. · 2020 [cited by applicant]
US 20200136996A1 · Li et al. · 2020 [cited by applicant]
US 20200213227A1 · Pianigiani et al. · 2020 [cited by applicant]
US 20200259731A1 · Sivaraman et al. · 2020 [cited by applicant]
US 20200278892A1 · Nainar et al. · 2020 [cited by applicant]
US 20200278893A1 · Niell et al. · 2020 [cited by applicant]
US 20200314011A1 · Deval et al. · 2020 [cited by applicant]
US 20200319812A1 · He et al. · 2020 [cited by applicant]
US 20200328192A1 · Zaman et al. · 2020 [cited by applicant]
US 20200382329A1 · Yuan · 2020 [cited by applicant]
US 20200401320A1 · Pyati et al. · 2020 [cited by applicant]
US 20200412659A1 · Ilitzky et al. · 2020 [cited by applicant]
US 20210019270A1 · Li et al. · 2021 [cited by applicant]
US 20210026670A1 · Krivenok et al. · 2021 [cited by applicant]
US 20210058342A1 · McBrearty · 2021 [cited by applicant]
US 20210176212A1 · Han · 2021 [cited by applicant]
US 20210226846A1 · Ballard et al. · 2021 [cited by applicant]
US 20210232528A1 · Kutch et al. · 2021 [cited by applicant]
US 20210266259A1 · Renner, III et al. · 2021 [cited by applicant]
US 20210273911A1 · Jain et al. · 2021 [cited by applicant]
US 20210314232A1 · Nainar et al. · 2021 [cited by applicant]
US 20210357242A1 · Ballard et al. · 2021 [cited by applicant]
US 20210377166A1 · Brar et al. · 2021 [cited by applicant]
US 20210377188A1 · Ghag et al. · 2021 [cited by applicant]
US 20210392017A1 · Cherian et al. · 2021 [cited by applicant]
US 20210409317A1 · Seshan et al. · 2021 [cited by applicant]
US 20220027147A1 · Maddukuri et al. · 2022 [cited by applicant]
US 20220043572A1 · Said et al. · 2022 [cited by applicant]
US 20220100432A1 · Kim et al. · 2022 [cited by applicant]
US 20220100491A1 · Voltz et al. · 2022 [cited by applicant]
US 20220100542A1 · Voltz · 2022 [cited by applicant]
US 20220100544A1 · Voltz · 2022 [cited by applicant]
US 20220100545A1 · Cherian et al. · 2022 [cited by applicant]
US 20220100546A1 · Cherian et al. · 2022 [cited by applicant]
US 20220103478A1 · Ang et al. · 2022 [cited by applicant]
US 20220103487A1 · Ang et al. · 2022 [cited by applicant]
US 20220103488A1 · Wang et al. · 2022 [cited by applicant]
US 20220103490A1 · Kim et al. · 2022 [cited by applicant]
US 20220103629A1 · Cherian et al. · 2022 [cited by applicant]
US 20220150055A1 · Cui et al. · 2022 [cited by applicant]
US 20220164451A1 · Bagwell · 2022 [cited by applicant]
US 20220197681A1 · Rajagopal · 2022 [cited by applicant]
US 20220206908A1 · Brar et al. · 2022 [cited by applicant]
US 20220206962A1 · Kim et al. · 2022 [cited by applicant]
US 20220206964A1 · Kim et al. · 2022 [cited by applicant]
US 20220210229A1 · Maddukuri et al. · 2022 [cited by applicant]
US 20220231968A1 · Rajagopal · 2022 [cited by applicant]
US 20220272039A1 · Cardona et al. · 2022 [cited by applicant]
US 20220335563A1 · Elzur · 2022 [cited by applicant]
US 20230004508A1 · Liu et al. · 2023 [cited by applicant]
US 20230195675A1 · Ang et al. · 2023 [cited by applicant]
US 20230198833A1 · Ang et al. · 2023 [cited by applicant]
CA 2672100A1 · 2008 [cited by applicant]
CA 2918551A1 · 2010 [cited by applicant]
CN 101258725A · 2008 [cited by applicant]
CN 101540826A · 2009 [cited by applicant]
DE 102018004046A1 · 2018 [cited by applicant]
EP 1482711A2 · 2004 [cited by applicant]
EP 2748750A1 · 2014 [cited by applicant]
EP 3598291A1 · 2020 [cited by applicant]
EP 4160424A2 · 2023 [cited by applicant]
TW 202107297A · 2021 [cited by applicant]
WO 2005099201A2 · 2005 [cited by applicant]
WO 2007036372A1 · 2007 [cited by applicant]
WO 2008095010A1 · 2008 [cited by applicant]
WO 2010008984A2 · 2010 [cited by applicant]
WO 2013074828A1 · 2013 [cited by applicant]
WO 2015187201A1 · 2015 [cited by applicant]
WO 2016003489A1 · 2016 [cited by applicant]
WO 2020027913A1 · 2020 [cited by applicant]
WO 2020211071A1 · 2020 [cited by applicant]
WO 2021030020A1 · 2021 [cited by applicant]
WO 2022066267A1 · 2022 [cited by applicant]
WO 2022066268A1 · 2022 [cited by applicant]
WO 2022066270A1 · 2022 [cited by applicant]
WO 2022066271A1 · 2022 [cited by applicant]
WO 2022066531A1 · 2022 [cited by applicant]
WO 2023121720A1 · 2023 [cited by applicant]
Author Unknown, “CISCO Identity-Based Firewall Security,” Month Unknown 2011, 2 pages, CISCO Systems, Inc. [cited by applicant]
Author Unknown, “Hypervisor,” Aug. 13, 2020, 1 page, VMware.com. [cited by applicant]
Author Unknown, “Transparent,” Free On-Line Dictionary of Computing (FOLDOC), Jun. 6, 1996, 1 page, retrieved from http://foldoc.org/transparent. [cited by applicant]
Author Unknown, “AppLogic Features,” Jul. 2007, 2 pages, 3TERA, Inc. [cited by applicant]
Author Unknown, “Enabling Service Chaining on Cisco Nexus 1000V Series,” Month Unknown, 2012, 25 pages, CISCO. [cited by applicant]
Author Unknown, “Next-Generation Firewalls,” Month Unknown 2013, 1 page, Palo Alto Networks. [cited by applicant]
Basak, Debashis, et al., “Virtualizing Networking and Security in the Cloud,” Month Unknown 2010, 9 pages, VMware, Inc., Palo Alto, CA. [cited by applicant]
Casado, Martin, et al., “SANE: A Protection Architecture for Enterprise Networks,” Proceedings of the 15th USENIX Security Symposium, Jul. 31-Aug. 4, 2006, 15 pages, USENIX, Vancouver, Canada. [cited by applicant]
Dixon, Colin, et al., “An End to the Middle,” Proceedings of the 12th Conference on Hot Topics in Operating Systems, May 2009, 5 pages, USENIX Association, Berkeley, CA, USA. [cited by applicant]
Dumitriu, Dan Mihai, et al., (U.S. Appl. No. 61/514,990), filed Aug. 4, 2011, 31 pages. [cited by applicant]
Guichard, J., et al., “Network Service Chaining Problem Statement,” Network Working Group, Jun. 13, 2013, 14 pages, Cisco Systems, Inc. [cited by applicant]
Ioannidis, Sotiris, et al., “Implementing a Distributed Firewall,” CCS '00, Month Unknown 2000, 10 pages, ACM, Athens, Greece. [cited by applicant]
Joseph, Dilip Anthony, et al., “A Policy-aware Switching Layer for Data Centers,” Jun. 24, 2008, 26 pages, Electrical Engineering and Computer Sciences, University of California, Berkeley, CA, USA. [cited by applicant]