IP Library › Granted Patent US 12,395,551
Granted Patent B2
US 12,395,551 · App. 18/777,469 · Granted Aug 19, 2025

Architecture for managing I/O and storage for a virtualization environment using executable containers and virtual machines

Inventors: Binny Sher Gill (San Jose, CA); Karan Gupta (San Jose, CA); Miao Cui (New York, NY)
Assignee: Nutanix, Inc.
H04L67/10G06F9/45558H04L67/1097G06F2009/45579H04L61/2514H04L61/2525
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,551
App. No.
18/777,469
Filed
Jul 18, 2024
Granted
Aug 19, 2025
Kind
B2
Art Unit
2446
USPC
709/223
Abstract

Systems for high-performance computing. A storage control architecture is implemented by a plurality of nodes, where a node comprises combinations of executable containers that execute in cooperation with virtual machines running above a hypervisor. The containers run in a virtual machine above a hypervisor, and/or can be integrated directly into the operating system of a host node. Sensitive information such as credit card information may be isolated from the containers in a separate virtual machine that is configured to be threat resistant, and which can be accessed through a threat resistant interface module. One of the virtual machines of the node may be a node-specific control virtual machine that is configured to operate as a dedicated storage controller for a node. One of the virtual machines of the node may be a node-specific container service machine that is configured to provide storage-related and other support to a hosted executable container.

Claims (50)

1. A non-transitory computer readable medium having stored thereon a sequence of instructions which, when execute a processor causes a set of acts comprising:

deploying an executable container in a first virtual machine, the first virtual machine includes an operating system that supports execution of executable containers;

operating the executable container in the first virtual machine;

receiving, in the first virtual machine, a storage access I/O command initiated by the executable container;

sending the storage access I/O command initiated by the executable container to a second virtual machine, the second virtual machine supports processing of storage access I/O commands from the executable containers on the first virtual machine; and

accessing a virtualized storage resource using the second virtual machine to service the storage access I/O command from the virtualized storage resource, wherein the virtualized storage resource comprises local storage from each of a plurality of nodes accessible by the second virtual machine.

2. The computer readable medium of claim 1 , wherein a deployment location for the executable container was determined by the second virtual machine and the executable container was deployed by the second virtual machine.

3. The computer readable medium of claim 1 , wherein multiple virtual machines operate executable containers, and two or more of the multiple virtual machines are on different computing nodes.

4. The computer readable medium of claim 1 , wherein each of a first set of virtual machines include an operating system that supports execution of executable containers and each of a second set of virtual machines support processing of storage access I/O commands initiated by the executable containers.

5. The computer readable medium of claim 1 , wherein the set of acts further comprise:

receiving, in the first virtual machine, a second storage access I/O command initiated by the executable container; and

accessing a storage resource that is local to a node having the executable container to service the second storage access I/O command.

6. The computer readable medium of claim 5 , wherein the storage resource is managed as part of the virtualized storage resource by the second virtual machine, and the first and second virtual machines operate on the same node.

7. The computer readable medium of claim 1 , wherein the storage access I/O command is sent over a network to the second virtual machine and the second virtual machine is on a different node from the first virtual machine and the virtualized storage resource further comprises a cloud storage.

8. The computer readable medium of claim 1 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the executable container is on a node of the plurality of nodes that form the hyperconverged environment.

9. The computer readable medium of claim 1 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the second virtual machine exposes a volume on the virtualized storage resource for use by the executable container.

10. A method comprising:

deploying an executable container in a first virtual machine, the first virtual machine includes an operating system that supports execution of executable containers;

operating the executable container in the first virtual machine;

receiving, in the first virtual machine, a storage access I/O command initiated by the executable container;

sending the storage access I/O command initiated by the executable container to a second virtual machine, the second virtual machine supports processing of storage access I/O commands from the executable containers on the first virtual machine; and

accessing a virtualized storage resource using the second virtual machine to service the storage access I/O command from the virtualized storage resource, wherein the virtualized storage resource comprises local storage from each of a plurality of nodes accessible by the second virtual machine.

11. The method of claim 10 , wherein a deployment location for the executable container was determined by the second virtual machine and the executable container was deployed by the second virtual machine.

12. The method of claim 10 , wherein multiple virtual machines operate executable containers, and two or more of the multiple virtual machines are on different computing nodes.

13. The method of claim 10 , wherein each of a first set of virtual machines include an operating system that supports execution of executable containers and each of a second set of virtual machines support processing of storage access I/O commands initiated by the executable containers.

14. The method of claim 10 , further comprising:

receiving, in the first virtual machine, a second storage access I/O command initiated by the executable container; and

accessing a storage resource that is local to a node having the executable container to service the second storage access I/O command.

15. The method of claim 14 , wherein the storage resource is managed as part of the virtualized storage resource by the second virtual machine, and the first and second virtual machines operate on the same node.

16. The method of claim 10 , wherein the storage access I/O command is sent over a network to the second virtual machine and the second virtual machine is on a different node from the first virtual machine and the virtualized storage resource further comprises a cloud storage.

17. The method of claim 10 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the executable container is on a node of the plurality of nodes that form the hyperconverged environment.

18. The method of claim 10 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the second virtual machine exposes a volume on the virtualized storage resource for use by the executable container.

19. A system comprising:

a storage medium having stored thereon a sequence of instructions; and

a processor that executes the sequence of instructions to perform a set of acts comprising:

deploying an executable container in a first virtual machine, the first virtual machine includes an operating system that supports execution of executable containers;

operating the executable container in the first virtual machine;

receiving, in the first virtual machine, a storage access I/O command initiated by the executable container;

sending the storage access I/O command initiated by the executable container to a second virtual machine, the second virtual machine supports processing of storage access I/O commands from the executable containers on the first virtual machine; and

accessing a virtualized storage resource using the second virtual machine to service the storage access I/O command from the virtualized storage resource, wherein the virtualized storage resource comprises local storage from each of a plurality of nodes accessible by the second virtual machine.

20. The system of claim 19 , wherein a deployment location for the executable container was determined by the second virtual machine and the executable container was deployed by the second virtual machine.

21. The system of claim 19 , wherein multiple virtual machines operate executable containers, and two or more of the multiple virtual machines are on different computing nodes.

22. The system of claim 19 , wherein each of a first set of virtual machines include an operating system that supports execution of executable containers, and each of a second set of virtual machines support processing of storage access I/O commands initiated by the executable containers.

23. The system of claim 19 , wherein the set of acts further comprise:

receiving, in the first virtual machine, a second storage access I/O command initiated by the executable container; and

accessing a storage resource that is local to a node having the executable container to service the second storage access I/O command.

24. The system of claim 23 , wherein the storage resource is managed as part of the virtualized storage resource by the second virtual machine, and the first and second virtual machines operate on the same node.

25. The system of claim 19 , wherein the storage access I/O command is sent over a network to the second virtual machine and the second virtual machine is on a different node from the first virtual machine and the virtualized storage resource further comprises a cloud storage.

26. The system of claim 19 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the executable container is on a node of the plurality of nodes that form the hyperconverged environment.

27. The system of claim 19 , wherein the plurality of nodes form a hyperconverged environment having the virtualized storage resource and the second virtual machine exposes a volume on the virtualized storage resource for use by the executable container.

Assignments (1)
SECURITY INTEREST Recorded Feb 13, 2025
From: NUTANIX, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 070206/0463 →
Continuity (5)
Continuation 17807708 · Jun 17, 2022
Continuation 16947098 · Jul 17, 2020
Continuation 15173577 · Jun 3, 2016
Provisional Application 62171990 · Jun 5, 2015
Related Publication 20250055905A1 · Feb 13, 2025
References Cited (243)
US 8140812B2 · Arroyo et al. · 2012 [cited by applicant]
US 8381231B2 · Kacin et al. · 2013 [cited by applicant]
US 8434081B2 · Cervantes et al. · 2013 [cited by applicant]
US 8549518B1 · Aron et al. · 2013 [cited by applicant]
US 8601473B1 · Aron et al. · 2013 [cited by applicant]
US 8649771B1 · Faaborg et al. · 2014 [cited by applicant]
US 8850130B1 · Aron et al. · 2014 [cited by applicant]
US 9223966B1 · Satish · 2015 [cited by examiner]
US 9342784B1 · Rajagopal · 2016 [cited by examiner]
US 9772866B1 · Aron et al. · 2017 [cited by applicant]
US 9778865B1 · Srinivasan et al. · 2017 [cited by applicant]
US 9800517B1 · Anderson · 2017 [cited by applicant]
US 9866433B1 · Fakhouri et al. · 2018 [cited by applicant]
US 10148751B1 · Natanzon · 2018 [cited by applicant]
US 10402217B2 · Shanley et al. · 2019 [cited by applicant]
US 10536518B1 · Streete et al. · 2020 [cited by applicant]
US 11194632B2 · Singhal et al. · 2021 [cited by applicant]
US 11269518B2 · Singh et al. · 2022 [cited by applicant]
US 12074937B2 · Gill et al. · 2024 [cited by applicant]
US 20050091213A1 · Schutz et al. · 2005 [cited by applicant]
US 20060059230A1 · Dykas et al. · 2006 [cited by applicant]
US 20070083512A1 · Pepin et al. · 2007 [cited by applicant]
US 20070198656A1 · Mazzaferri et al. · 2007 [cited by applicant]
US 20070260831A1 · Michael et al. · 2007 [cited by applicant]
US 20090217296A1 · Gebhart et al. · 2009 [cited by applicant]
US 20090300414A1 · Huang et al. · 2009 [cited by applicant]
US 20090307435A1 · Nevarez et al. · 2009 [cited by applicant]
US 20110078790A1 · Fazunenko et al. · 2011 [cited by applicant]
US 20110185292A1 · Chawla et al. · 2011 [cited by applicant]
US 20120005673A1 · Cervantes et al. · 2012 [cited by applicant]
US 20120110574A1 · Kumar · 2012 [cited by applicant]
US 20120117562A1 · Jess et al. · 2012 [cited by applicant]
US 20120151568A1 · Pieczul et al. · 2012 [cited by applicant]
US 20120167079A1 · Banerjee et al. · 2012 [cited by applicant]
US 20120191908A1 · North et al. · 2012 [cited by applicant]
US 20130185715A1 · Dunning et al. · 2013 [cited by applicant]
US 20130198828A1 · Pendergrass et al. · 2013 [cited by applicant]
US 20130275886A1 · Haswell et al. · 2013 [cited by applicant]
US 20130290399A1 · Gordon · 2013 [cited by applicant]
US 20140020043A1 · Anand et al. · 2014 [cited by applicant]
US 20140052864A1 · Van Der et al. · 2014 [cited by applicant]
US 20140075426A1 · West et al. · 2014 [cited by applicant]
US 20140082634A1 · Hickford et al. · 2014 [cited by applicant]
US 20140201317A1 · Nerieri · 2014 [cited by applicant]
US 20140222930A1 · Gangadharan et al. · 2014 [cited by applicant]
US 20140297713A1 · Meigen et al. · 2014 [cited by applicant]
US 20140304700A1 · Kim et al. · 2014 [cited by applicant]
US 20140359619A1 · Park et al. · 2014 [cited by applicant]
US 20150089577A1 · Beckman et al. · 2015 [cited by applicant]
US 20150121375A1 · Balasubramanyam et al. · 2015 [cited by applicant]
US 20150135338A1 · Moskal · 2015 [cited by applicant]
US 20150143091A1 · Brace et al. · 2015 [cited by applicant]
US 20150261951A1 · Abuelsaad et al. · 2015 [cited by applicant]
US 20150271256A1 · Pathak et al. · 2015 [cited by applicant]
US 20150331722A1 · Magro et al. · 2015 [cited by applicant]
US 20160105392A1 · Thakkar et al. · 2016 [cited by applicant]
US 20160147558A1 · Gaponenko et al. · 2016 [cited by applicant]
US 20160266913A1 · Achillopoulos et al. · 2016 [cited by applicant]
US 20160301680A1 · Main et al. · 2016 [cited by applicant]
US 20160342453A1 · Khan et al. · 2016 [cited by applicant]
US 20160350010A1 · Ryan et al. · 2016 [cited by applicant]
US 20160359955A1 · Gill et al. · 2016 [cited by applicant]
US 20160378518A1 · Antony et al. · 2016 [cited by applicant]
US 20160381080A1 · Reddem et al. · 2016 [cited by applicant]
US 20170046134A1 · Straub · 2017 [cited by applicant]
US 20170102925A1 · Ali et al. · 2017 [cited by applicant]
US 20170177171A1 · Won · 2017 [cited by applicant]
US 20170255890A1 · Palavalli et al. · 2017 [cited by applicant]
US 20170272472A1 · Adhar · 2017 [cited by applicant]
US 20180232142A1 · Shekar et al. · 2018 [cited by applicant]
US 20180314543A1 · Madampath · 2018 [cited by applicant]
US 20200319904A1 · Turner · 2020 [cited by applicant]
CN 105530306 · 2016 [cited by applicant]
Rosen, A., “VMware NSX for Docker, Containers & Mesos,” YouTube Video, URL: https://www.youtube.com/watch?v=-OZUJm_K4vc, video uploaded on Feb. 18, 2015. [cited by applicant]
Oikawa, S., “Virtualizing Storage as Memory for High Performance Storage Access,” 2014 IEEE International Symposium on Parallel and Distributed Processing with Applications, dated Aug. 26, 2014. [cited by applicant]
Cormac Hogan, “A closer look at SpringPath,” CormacHogan.com: Storage, Virtualization, Container Orchestration, URL: https://cormachogan.com/2015/02/18/a-closer-look-at-springpath/, dated Feb. 18, 2015. [cited by applicant]
“Containers, VMs, Kubernetes and Vmware,” Google Cloud Platform Blog, URL: https://cloudplatform.googleblog.com/2014/08/containers-vms-kubernetes-and-vmware.html, dated Aug. 25, 2014. [cited by applicant]
“Cloud Computing, SDDC and the hybridity concept explained,” VMWare by Broadcom, URL: https://blogs.vmware.com/management/2014/11/cloud-computing-sddc-hybridity-concept-explained.html, dated Nov. 13, 2014. [cited by applicant]
Bias, R., “Hyper-Converged Confusion,” cloudscaling, URL: https://cloudscaling.com/blog/cloud-computing/hyper-converged-confusion/, dated Feb. 24, 2015. [cited by applicant]
“Terry Cunningham Joins as CEO of Hyper-Converged Pioneer Springpath Inc,” Springpath, URL: https://www.businesswire.com/news/home/20150520005396/en/Terry-Cunningham-Joins-as-CEO-of-Hyper-Converged-Pioneer-Springpath-In… [cited by applicant]
“Springpath HALO Architecture Deep Dive” Tech Field Day, YouTube Video, URL: https://www.youtube.com/watch?v=krmkywnz970, uploaded on Mar. 13, 2015. [cited by applicant]
“What's the point of using Docker on top of a virtual machine?” StackOverflow, URL: https://stackoverflow.com/questions/24124903/whats-the-point-of-using-docker-on-top-of-a-virtual-machine, dated Jun. 9, 2014. [cited by applicant]
Rivera, R., “VMware Virtual SAN: File Services with NexentaConnect,” VMWare Virtual Blocks Blog, URL: https://blogs.vmware.com/virtualblocks/2015/01/30/vmware-virtual-san-file-services-with-nexentaconnect/, dated Jan. 3… [cited by applicant]
“A Better Solution for Docker Storage,” Buurst, URL: https://www.buurst.com/2014/11/11/better-solution-docker-storage/, date found via Google as Nov. 11, 2014. [cited by applicant]
Cook, J., “vSphere Storage Policy Based Management Overview (part 1),” VMWare vSphere Blog, URL: https://blogs.vmware.com/vsphere/2014/09/storage-policy-based-management-overview.html, dated Sep. 29, 2014. [cited by applicant]
Palmer, M., “Quickly Deliver Applications with Docker Container Technology,” NetApp Community, URL: https://community.netapp.com/t5/Tech-ONTAP-Articles/Quickly-Deliver-Applications-with-Docker-Container-Technology/ta-p/… [cited by applicant]
Balkan, A., “Deploying Your Own Private Docker Registry on Azure,” Microsoft, URL: https://azure.microsoft.com/de-de/blog/deploying-your-own-private-docker-registry-on-azure/, dated Nov. 11, 2014. [cited by applicant]
“Implementing SoftNAS Cloud® with Docker®,” SoftNas, docker, dated Nov. 2014. [cited by applicant]
Ali, Q., “Scaling Web 2.0 Applications using Docker containers on vSphere 6.0,” VMWare by Broadcom, URL: https://blogs.vmware.com/performance/2015/04/scaling-web-2-0-applications-using-docker-containers-vsphere-6-0.html… [cited by applicant]
“What's New in the VMware vSphere® 6.0 Platform,” VMWare, Version 1.1/Technical White Paper, dated Mar. 2015. [cited by applicant]
Agrawal, B., “Docker Containers Performance in VMware vSphere,” VMWare by Broadcom, URL: https://blogs.vmware.com/performance/2014/10/docker-containers-performance-vmware-vsphere.html, dated Oct. 15, 2014. [cited by applicant]
Sarathy, B., “Containerize Red Hat Enterprise Linux 6 Applications to Run on Red Hat Enterprise Linux 7,” RedHat, URL: https://www.redhat.com/en/blog/containerize-red-hat-enterprise-linux-6-applications-run-red-hat-ente… [cited by applicant]
“Red Hat Enterprise Virtualization 3.4 Beta Transforms the Journey to the Cloud,” RedHat, URL: https://www.redhat.com/en/blog/red-hat-enterprise-virtualization-3-4-beta-transforms-the-journey-to-the-cloud, dated Mar. 27… [cited by applicant]
“Google/docker-registry,” dockerhub, URL: https://hub.docker.com/r/google/docker-registry, date found via Google as Dec. 23, 2015. [cited by applicant]
“The Road to a Hyper-Converged OpenStack,” OpenInfra Foundation, YouTube Video, URL: https://www.youtube.com/watch?v=ytC1vTYMpZc, video uploaded on May 19, 2015. [cited by applicant]
“What makes a container cluster?,” Google Cloud Platform Blog, URL: https://cloudplatform.googleblog.com/2015/01/what-makes-a-container-cluster.html, dated Jan. 22, 2015. [cited by applicant]
Ward, K., “Opinion: The Infrastructure Continuum Continues,” ActualTech, URL: https://www.actualtechmedia.com/io/infrastructure-continuum-continues/, dated Mar. 31, 2014. [cited by applicant]
Olson, E., et al., “SoftNAS Architecture on AWS,” Amazon Web Services, dated May 2015. [cited by applicant]
Non-Final Office Action dated May 23, 2018 for related U.S. Appl. No. 15/173,577. [cited by applicant]
Non-Final Office Action dated May 31, 2018 for related U.S. Appl. No. 15/431,404. [cited by applicant]
Wikipedia. “Remote direct memory access”. Mar. 20, 2015. 2 pages. [cited by applicant]
International Search Report and Written Opinion dated Sep. 8, 2016 for corresponding PCT Patent Application No. PCT/US16/35929, 10 pages. [cited by applicant]
Non-Final Office Action dated Jan. 31, 2018 for related U.S. Appl. No. 15/173,577. [cited by applicant]
Wikipedia. “LXC”. Apr. 18, 2017. 3 pages. [cited by applicant]
Wikipedia. “HTML element”. Apr. 10, 2017. 7 pages. [cited by applicant]
U.S. Appl. No. 15/431,404, filed Feb. 13, 2017, 71 pages. [cited by applicant]
U.S. Appl. No. 15/665,079, filed Jul. 31, 2017, 76 pages. [cited by applicant]
European Search Report dated May 9, 2018 for EP Application No. 16804612.6, 7 pages. [cited by applicant]
Merkel, D. “Docker: Lightweight Linux Containers for Consistent Development and Deployment”. Mar. 2014. 16 pages. [cited by applicant]
Non-Final Office Action dated Jan. 19, 2018 for related U.S. Appl. No. 15/360,077. [cited by applicant]
Final Office Action dated Jun. 20, 2018 for related U.S. Appl. No. 15/360,077. [cited by applicant]
Non-Final Office Action dated Jul. 19, 2018 for related U.S. Appl. No. 15/665,079. [cited by applicant]
Final Office Action dated Sep. 24, 2018 for related U.S. Appl. No. 15/173,577, 16 pages. [cited by applicant]
Final Office Action dated Oct. 3, 2018 for related U.S. Appl. No. 15/431,404, 24 pages. [cited by applicant]
Non-Final Office Action dated Oct. 25, 2018 for related U.S. Appl. No. 15/360,077, 20 pages. [cited by applicant]
Non-Final Office Action dated Jan. 9, 2019 for related U.S. Appl. No. 15/173,577, 10 pages. [cited by applicant]
Final Office Action dated Jan. 23, 2019 for related U.S. Appl. No. 15/665,079, 16 pages. [cited by applicant]
Pahl, Claus. “Containers and Clusters for Edge Cloud Architectures—a Technology Review”. Oct. 26, 2015. 8 pages. [cited by applicant]
Rotter et al. “Using Linux Containers in Telecom Applications”. Mar. 3, 2016. 8 pages. [cited by applicant]
Bernstein, David. “Containers and Cloud: From LXC to Docker to Kubernetes”. [cited by applicant]
Gerlach et al. “Skyport—Container-Based Execution Environment Management for Multi-cloud Scientific Workflows”. Nov. 2014. 9 pages. [cited by applicant]
Burns et al. “Design patterns for container-based distributed systems”. [cited by applicant]
Marmol et al. “Networking in Containers and Container Clusters”. [cited by applicant]
Arnautov et al. “SCONE: Secure Linux Containers with Intel SGX”. Nov. 4, 2016. 17 pages. [cited by applicant]
Burns et al. “Borg, Omega, and Kubernetes”. [cited by applicant]
Singh, Satnam. “Cluster-level Logging of Containers with Containers”. [cited by applicant]
Non-Final Office Action dated Mar. 8, 2019 for related U.S. Appl. No. 15/674,923, 10 pages. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Oct. 15, 2013), from http://stevenpoitras.com/the-nutanix-bible/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 11, 2014), from http://stevenpoitras.com/the-nutanix-bible/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jun. 20, 2014), from http://stevenpoitras.com/the-nutanix-bible/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 7, 2015), from http://stevenpoitras.com/the-nutanix-bible/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jun. 9, 2015), from http://stevenpoitras.com/the-nutanix-bible/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Sep. 4, 2015), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 12, 2016), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jun. 9, 2016), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 3, 2017), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jun. 8, 2017), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 3, 2018), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jun. 25, 2018), from https://nutanixbible.com/. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 8, 2019), from https://nutanixbible.com/. [cited by applicant]
Non-Final Office Action dated Mar. 29, 2019 for related U.S. Appl. No. 15/620,486. [cited by applicant]
Non-Final Office Action dated Apr. 4, 2019 for related U.S. Appl. No. 15/431,404. [cited by applicant]
Srivastav, P. “What is Docker?” (Jan. 10, 2016) date identified by Google, from https://docker-curriculum.com/#give-feedback. [cited by applicant]
Evans, C. “Working With Containers #1: Getting Started with Docker” (Feb. 1, 2016) from https://blog.architecting.it/working-with-containers-1-getting-started-with-docker/. [cited by applicant]
Baldwin, M. “Configure a Docker Container to Automatically Pull From GitHub Using Oauth” (Feb. 19, 2015), from https://devops.ionos.com/tutorials/configure-a-docker-container-to-automatically-pull-from-github-using-oaut… [cited by applicant]
Hall, S. “Supergiant Builds on Kubernetes to Manage Multitenancy for Distributed Applications” (Sep. 21, 2016), from https://thenewstack.io/supergiant-builds-kubernetes-manage-multi-tenancy-distributed-applications/. [cited by applicant]
Hom, C. “Kubernetes Cluster Federation: Efficiently deploy and manage applications across the globe” (Jul. 21, 2016), from https://coreos.com/blog/kubernetes-cluster-federation.html. [cited by applicant]
Sanchez, G. “Drive a full lifecycle with Jenkins + Kubernetes” (Oct. 20, 2016), from https://elasticbox.com/blog/. [cited by applicant]
StackPointCloud: “Node Autoscaling, Docker to Kubernetes Onboarding Tools & Production Fabric8 for Developers” (Oct. 27, 2016), from https://blog.stackpoint.io/node-autoscaling-docker-to-kubernetes-onboarding-tools-prod… [cited by applicant]
Strachan, J. “the easiest way to get started with fabric8 on the public cloud is now StackPointCloud!” (Oct. 31, 2016), from https://blog.fabric8.io/the-easiest-way-to-get- started-with-fabric8-on-the-public-cloud-is-no… [cited by applicant]
Tost et al. “Build and extend Docker container images with middleware functions” (Aug. 22, 2016), from https://developer.ibm.com/tutorials/mw-1608-tost-trs/. [cited by applicant]
Kumar et al. “Creating and Managing Docker VM Extensions in Azure” (Oct. 15, 2015), from https://www.red-gate.com/simple-talk/cloud/platform-as-a-service/creating-and-managing-docker-vm-extensions-in-azure/. [cited by applicant]
“Working with Docker” (Apr. 4, 2019), from https://code.visualstudio.com/docs/azure/docker. [cited by applicant]
Sullivan, A. “NetApp Persistent Storage in Kubernetes: Using ONTAP and NFS” (May 11, 2016), from https://netapp.io/2016/05/11/netapp-persistent-storage-kubernetes-using-ontap-nfs/. [cited by applicant]
Sullivan, A. “Are Docker Containers Right for Your Enterprise Applications?” (Apr. 19, 2016), from https://blog.netapp.com/blogs/are-docker-containers-right-for-your-enterprise-applications/. [cited by applicant]
Younes, R. “Dockerizing a PHP Application” (Mar. 9, 2016), from https://semaphoreci.com/community/tutorials/dockerizing-a-php-application. [cited by applicant]
Final Office Action dated May 10, 2019 for related U.S. Appl. No. 15/360,077. [cited by applicant]
Final Office Action dated Jul. 5, 2019 for related U.S. Appl. No. 15/173,577. [cited by applicant]
Non-Final Office Action dated Aug. 6, 2019 for related U.S. Appl. No. 15/360,077. [cited by applicant]
Final Office Action dated Sep. 18, 2019 for related U.S. Appl. No. 15/674,923. [cited by applicant]
Final Office Action dated Oct. 10, 2019 for related U.S. Appl. No. 15/431,404. [cited by applicant]
Non-Final Office Action dated Oct. 23, 2019 for related U.S. Appl. No. 15/173,577. [cited by applicant]
Cano, I. et al., “Curator: Self-Managing Storage for Enterprise Clusters”, [cited by applicant]
Advisory Action dated Dec. 26, 2019 for related U.S. Appl. No. 15/431,404. [cited by applicant]
Notice of Allowance dated Jan. 8, 2020 for related U.S. Appl. No. 15/360,077. [cited by applicant]
Notice of Allowance dated Mar. 6, 2020 for related U.S. Appl. No. 15/431,404. [cited by applicant]
Notice of Allowance dated Mar. 9, 2020 for related U.S. Appl. No. 15/173,577. [cited by applicant]
Schwarzkopf, M. et al., “Omega: flexible, scalable schedulers for large compute clusters”, [cited by applicant]
Peinl, R. et al., “The Docker Ecosystem Needs Consolidation”, In [cited by applicant]
Kukral, T., “Migration of Virtual Machines in the Computing Cloud”, Master thesis, Czech Technical University in Prague, (Sep. 2014). [cited by applicant]
Rotter, C. et al., “Using Linux Containers in Telecom Applications”, [cited by applicant]
Cacciatore, K. et al., “Exploring Opportunities: Containers and OpenStack”, Openstack White Paper, (2015). [cited by applicant]
Truong, P. et al., “Architecture of the DOCTOR Virtualized Node”, Version 1.0, (Dec. 21, 2015). [cited by applicant]
Casalicchio, E., “Autonomic Orchestration of Containers: Problem Definition and Research Challenges”, [cited by applicant]
Intel, “Linux* Containers Streamline Virtualization and Complement Hypervisor-Based Virtual Machines”, White Paper, (Sep. 2014). [cited by applicant]
Lamourine, M., “Storage Options for Software Containers”, vol. 40, No. 1, [cited by applicant]
Burns, B., “How Kubernetes Changes Operations”, vol. 40, No. 5, [cited by applicant]
Farrow, R. et al., “Operating Systems and Sysadmin”, vol. 40, No. 5, [cited by applicant]
Saarinen, T., “Container-based video processing”, Master's Thesis, (May 6, 2015). [cited by applicant]
Moglia, L. “Control plane performance comparison in virtualized Base Station Controller”, Master of Science Thesis, (Mar. 2015). [cited by applicant]
Marmol, V. et al., “Networking in Containers and Container Clusters”, [cited by applicant]
Morgan, T. M., “Photon Container Platform Closer to Prime Time”, The Next Platform, (Mar. 21, 2016). [cited by applicant]
Steinholt, R., “A study of Linux Containers and their ability to quickly offer scalability for web services”, Master's Thesis, (May 18, 2015). [cited by applicant]
Hayden, M., “Securing Linux Containers”, (Jul. 26, 2015). [cited by applicant]
Jurenka, V., “Virtualization using Docker Platform”, Master's Thesis, (Jan. 2015). [cited by applicant]
Piraghaj, S. F. et al. “Efficient Virtual Machine Sizing For Hosting Containers as a Service”, [cited by applicant]
Morgan, T. P. “VMware Blunts Container Attack With Bonneville VM”, The Next Platform, (Jun. 23, 2015). [cited by applicant]
Warfield, A. et al., “Converging Enterprise Storage and Business Intelligence: A Reference Architecture for Data-Centric Infrastructure”, v1.0, Intel, (Aug. 2015). [cited by applicant]
European Office Action dated Aug. 3, 2021 for EP Application No. 16804612.6. [cited by applicant]
Non-Final Office Action dated Oct. 7, 2021 for related U.S. Appl. No. 16/947,098. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Sep. 9, 2022), from https://nutanixbible.com/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
“Citrix XenDesktop 7.1 on Microsoft Hyper-V Server 2012 R2 on Nutanix Virtual Computing Platform—Solution Design,” Citrix Validated Solutions, Prepared by: Citrix APAC Solutions, dated Jun. 25, 2014. [cited by applicant]
Foreign OA for EP Patent Appln. No. 16804612.6 dated Jun. 20, 2022. [cited by applicant]
Foreign OA for EP Patent Appln. No. 16804612.6 dated Oct. 22, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/947,098 dated Feb. 8, 2022. [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jul. 9, 2019), from https://nutanixbible.com/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Feb. 3, 2020), from https://nutanixbible.com/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Aug. 1, 2020), from https://nutanixbible.com/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Poitras, Steven. “The Nutanix Bible” (Jan. 31, 2021), from https://nutanixbible.com/ (Publication date based on indicated capture date by Archive.org; first publication date unknown). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/807,708 dated Feb. 2, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/807,708 dated Jun. 3, 2024. [cited by applicant]
Cziva, R, et al., “Container-based network function virtualization for software-defined networks,” 2015 IEEE Symposium on Computers and Communication (ISCC), Larnaca, Cyprus, dated Jul. 2015, pp. 415-420. [cited by applicant]
Colbert, K., “Announcing VMware vSphere with Tanzu: The Fastest Way to Get Started with Kubernetes,” VMWare vSphere Blog, URL: https://blogs.vmware.com/vsphere/2020/09/announcing-vsphere-with-tanzu.html, dated Sep. 15, … [cited by applicant]
Colbert, K., Introducing Project Pacific, Vmware vSphere Blog, URL: https://blogs.vmware.com/vsphere/2019/08/introducing-project-pacific.html, dated Aug. 26, 2019. [cited by applicant]
“Tanzu for Kubernetes Operations Reference Architecture 2.3,” Broadcom, URL: https://techdocs.broadcom.com/us/en/vmware-tanzu/reference-architectures/tanzu-for-kubernetes-operations-reference-architecture/2-3/tko-ref-ar… [cited by applicant]
“VMware Topics: Microservices,” VMWare by Broadcom, URL: https://www.vmware.com/topics/microservices, date found via Google as Aug. 2, 2019. [cited by applicant]
“12-Factor Containerized Microservices: Leveraging VMware Tanzu and the Best of Kubernetes,” VMWare by Broadcome, URL: https://blogs.vmware.com/tanzu/12-factor-microservices-vmware-tanzu-kubernetes/, dated Feb. 14, 2022. [cited by applicant]
“VSphere with Tanzu Architecture,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vSphere/7.0/vmware-vsphere-with-tanzu/GUID-3E4E6039-BD24-4C40-8575-5AA0EECBBBEC.html, dated Dec. 7, 2022. [cited by applicant]
“Understanding the VMware Tanzu Kubernetes Terminology,” VMWare Tanzu, URL: https://veducate.co.uk/tanzu-terminology/, dated Apr. 22, 2021. [cited by applicant]
“VMware vSAN Documentation,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vSAN/index.html, date found via Google as Jun. 24, 2017. [cited by applicant]
“Shared Storage,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vCloud-NFV-OpenStack-Edition/3.3/vmware-vcloud-nfv-openstack-edition-ra33/GUID-4EA2DA75-6FA4-44E1-BC0C-23D106345D08.html, dated Dec. 10, 2019. [cited by applicant]
“VMware Project Pacific—Making Kubernetes mainstream,” Datacenter Rookie, URL: https://datacenterrookie.wordpress.com/2020/01/06/vmware-project-pacific-making-kubernetes-mainstream/, date found via Google as Jan. 6, 202… [cited by applicant]
“What Is vSphere with Tanzu?,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vSphere/7.0/vmware-vsphere-with-tanzu/GUID-70CAF0BB-1722-4526-9CE7-D5C92C15D7D0.html#:˜:text=How%20Does%20vSphere%20with%20Tanzu,are%20p… [cited by applicant]
“How vSphere with Tanzu Integrates with vSphere Storage,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vSphere/7.0/vmware-vsphere-with-tanzu/GUID-D79D0D72-8172-4C97-AB24-F6A039BBA0FF.html, dated Aug. 24, 2022. [cited by applicant]
“What Is a vSphere Pod?,” VMWare Docs, URL: https://docs.vmware.com/en/VMware-vSphere/7.0/vmware-vsphere-with-tanzu/GUID-276F809D-2015-4FC6-92D8-8539D491815E.html#:˜:text=A%20vSphere%20Pod%20is%20a,for%20the%20workload%… [cited by applicant]
“A Deep Dive into the Kubernetes vSphere CSI Driver with TKGI and TKG,” VMWare Docs, URL: https://blogs.vmware.com/tanzu/a-deep-dive-into-the-kubernetes-vsphere-csi-driver-with-tkgi-and-tkg/, dated Jun. 15, 2020. [cited by applicant]
“Tanzu Kubernetes Cluster Design,” VNWare Docs, dated Mar. 10, 2022. [cited by applicant]
Phan, H., “Using local storage with Tanzu Kubernetes Grid Topology Aware Volume Provisioning,” VMWire, dated Feb. 24, 2022. [cited by applicant]
“VMware Tanzu for Kubernetes Operations on vSphere Reference Design,” VMWare, dated Sep. 30, 2022. [cited by applicant]
“VSphere with Tanzu Configuration and Management—Update 2,” VMWare, dated May 28, 2021. [cited by applicant]
“Performance Best Practices for Kubernetes with VMware Tanzu,” VMWare Performance Study, dated Mar. 15, 2021. [cited by applicant]
Rosso, J., “Storage Integration,” Kubernetes Architecture—Storage Integration, URL: https://web.archive.org/web/20231117142605/https://tanzu.vmware.com/developer/guides/storage-integration/, date found on Internet Archi… [cited by applicant]
West, M., “vSphere with Tanzu—Highly Available Kubernetes,” VMWare, dated Dec. 3, 2020. [cited by applicant]
Seo, K., et al., “Performance Comparison Analysis of Linux Container and Virtual Machine for Building Cloud,” Advanced Science and Technology Letters, vol. 66 (Networking and Communication 2014), pp. 105-111, dated Dec.… [cited by applicant]
Banthia, B., “How is Tessell able to offer comparatively very high IOPS?,” Tessell, URL: https://help.tessell.com/en/articles/6624922-how-is-tessell-able-to-offer-comparatively-very-high-iops, date found via Internet Ar… [cited by applicant]
“Deployment options,” Tessell, URL: https://docs.tessell.com/tessell/getting_started/deployment, date found via Internet Archive as Jun. 24, 2024. [cited by applicant]
Agrawal, B., “Running Transactional Workloads Using Docker Containers on vSphere 6.0,” vmware by Broadcom, dated May 26, 2015. [cited by applicant]
“VMware teams with Docker, Google and Pivotal to simplify enterprise adoption of containers ,” KIPOST, Url: https://www.kipost.net/news/articleView.html?idxno=99064, dated Aug. 27, 2014. [cited by applicant]
“VMworld 2014 Europe General Session—Tuesday, Oct. 14,” VMware Explore, YouTube Video, URL: https://www.youtube.com/watch?v=EqCAQfJ56mY, video uploaded on Oct. 14, 2014. [cited by applicant]
Epping, D., “Introduction to VMware vSphere Virtual SAN,” Yellow-Bricks, dated Aug. 26, 2013. [cited by applicant]
Ramachandran, V., “VMware Virtual SAN and Scale IO: Fundamentally Two Different Approaches to Software-Defined Storage,” VMWare by Broadcom, URL: https://blogs.vmware.com/virtualblocks/2014/12/19/vmware-virtual-san-and-… [cited by applicant]
Wahl, C., “In Which I Muse Over VMware's Virtual SAN Architecture,” Wahl Network, URL: https://wahlnetwork.com/2013/10/31/muse-vmwares-virtual-san-architecture/#more-8651, dated Oct. 31, 2013. [cited by applicant]
Gray, E., “vSphere Integrated Containers—Technology Walkthrough,” vmware by Broadcom, URL: https://blogs.vmware.com/vsphere/2015/10/vsphere-integrated-containers-technology-walkthrough.html, dated Oct. 1, 2015. [cited by applicant]
Chaubal, C., “VMware Announces General Availability of vSphere Integrated Containers,” vmware by Broadcom, URL: https://blogs.vmware.com/vsphere/2016/12/vmware-announces-general-availability-of-vsphere-integrated-contai… [cited by applicant]
Morgan, T., “VMware Embraces OpenStack Clouds, Docker Containers,” AI Wire, URL: https://www.aiwire.net/2014/08/25/vmware-embraces-openstack-clouds-docker-containers/, dated Aug. 15, 2014. [cited by applicant]
Beda, J., “What makes a container cluster?,” Google Cloud Platforming Blog, URL: https://cloudplatform.googleblog.com/2015/01/what-makes-a-container-cluster.html, dated Jan. 22, 2015. [cited by applicant]
“VMware, Pivotal and Google Cloud Collaborate to Unveil New Kubernetes-based Container Service—Pivotal Container Service (PKS),” vmware by Broadcom, URL: https://blogs.vmware.com/cloud/2017/08/29/vmware-pivotal-google-c… [cited by applicant]
Mechtri, M., et al., “Docker containers deployment with OpenStack Heat,” github, URL: https://github.com/MarouenMechtri/Docker-containers-deployment-with-OpenStack-Heat, dated Dec. 4, 2014. [cited by applicant]
“Stratoscale: Hyper-converging OpenStack: compute, storage and networking,” OpenInfra Foundation, YouTube Video, URL: https://www.youtube.com/watch?v=B57DbewKNOQ&t=213s, video uploaded on May 20, 2015. [cited by applicant]
Barr, J., “Amazon EC2 Container Service (ECS)—Container Management for the AWS Cloud,” AWS URL: https://aws.amazon.com/blogs/aws/cloud-container-management/, dated Nov. 13, 2014. [cited by applicant]
Petazzoni, J., “My notes on Amazon's ECS (EC2 Container Service), aka Docker on AWS,” github, URL: https://jpetazzo.github.io/2015/01/14/amazon-docker-ecs-ec2-container-service/, date found via Google as Jan. 2015. [cited by applicant]
“Shared File Systems between multiple AWS EC2 instances,” serverfault, URL: https://serverfault.com/questions/646293/shared-file-systems-between-multiple-aws-ec2-instances, original upload date Nov. 22, 2014 (page modif… [cited by applicant]
Roy, S., “Next-generation storage for the software-defined datacenter,” Microsoft Blog, URL: https://www.microsoft.com/en-us/windows-server/blog/2015/05/05/next-generation-storage-for-the-software-defined-datacenter/, d… [cited by applicant]