SYS-CON MEDIA Authors: Pat Romanski, Gary Arora, Zakia Bouachraoui, Yeshim Deniz, Liz McMillan

Blog Feed Post

“INTEGRATED” – YOU KEEP USING THAT WORD, I DO NOT THINK IT MEANS WHAT YOU THINK IT MEANS

http://www.plexxi.com/wp-content/uploads/2018/01/PrincessBride-Integrate... 330w, http://www.plexxi.com/wp-content/uploads/2018/01/PrincessBride-Integrate... 414w, http://www.plexxi.com/wp-content/uploads/2018/01/PrincessBride-Integrate... 620w" sizes="(max-width: 300px) 100vw, 300px" />Vendors, especially networking vendors, keep using the term “integrated” to imply that they work with other parts of the IT infrastructure ecosystem, generally the cloud management platform (i.e. VMware, OpenStack, Nutanix Prism). However, every vendor seems to have a different idea of what “integrated” actually means and the implications on the overall data center. So, let’s take a look at what we at Plexxi  consider a proper integration to be and why the nuances matter.

WHAT’S THE PROBLEM?

Before diving into the varying degrees of ”integrated-ness” a data center network platform can sport, let’s think about this from the customer perspective.

Customers trying to build a private (on-premise) cloud infrastructure generally want to get to the same level of experience for management and usability for their users that they would get if they used a Public Cloud service such as Amazon AWS, Microsoft Azure, or Google Cloud Platform. These Public Cloud platforms focus on the interface that allows the users to create, deploy, manage, and troubleshoot the resources necessary to deliver applications, versus the individual management and operational tasks associated with the individual resource domain. This means, a user can create/ modify/delete/expand their virtual machines or other “software-defined” compute constructs that have the storage and networking capabilities needed to allow the user to create an application. This contrasts to how a typical Enterprise IT infrastructure approach might create a server/compute, storage, and networking operational environment that is managed distinctly from each other with little relation to the overall application requirements.

Public Cloud providers have been able to provide this level of user experience mainly by creating a highly-integrated infrastructure environment where the “software-defined” aspects of compute, storage, and network infrastructure all talk to each other via APIs, exchanging data about their own systems state, health, and capabilities. In order for customers to successfully build these types of environments on-premises, they need to ensure that their building blocks for compute, storage, and networking have this level of ability to integrate. Sounds easy enough to duplicate, right? Not really. A lot of the larger Public Cloud companies build their own custom software to create this level of integration across the three SDI stacks, an option that is not feasible for all companies.

For the rest of the world, the network plays a special role since it is responsible for gluing together the compute and the storage resources in a way that matters to the applications. This puts the network at the center of a good Private Cloud strategy, and an especially important role in the area of integration. With this in mind, let’s look at what the network can provide and how it can help drive a better overall Private Cloud experience.

WHAT COMPRISES THE DEFINITION OF “INTEGRATED”?

Networking vendors make a variety of claims with respect to their level of ”integrated-ness” in the IT infrastructure ecosystem.  But integration has a number of facets that comprise a true integrated system. There are at least 3 levels of integration that should be understood – Bootstrap, Lifecycle, and Converged Management:

http://www.plexxi.com/wp-content/uploads/2018/01/Integrated-768x406.png 768w, http://www.plexxi.com/wp-content/uploads/2018/01/Integrated-1024x541.png 1024w, http://www.plexxi.com/wp-content/uploads/2018/01/Integrated-330x174.png 330w, http://www.plexxi.com/wp-content/uploads/2018/01/Integrated-736x389.png 736w, http://www.plexxi.com/wp-content/uploads/2018/01/Integrated-414x219.png 414w, http://www.plexxi.com/wp-content/uploads/2018/01/Integrated.png 1027w" sizes="(max-width: 300px) 100vw, 300px" />

  • Bootstrap
    Bootstrap integration allows the “day 0” problem to not be a complete “chicken and the egg” situation. Since a modern network relies on software for the control plane, and software relies on compute/storageinfrastructure to run, and compute/storage (at least the SD-type) infrastructure relies on a network to build itself into a working cluster, we have a complete circle of dependencies. There are various improvements to installations and bootstrapping that can be made by various integrated compute/storage offerings, and those improvements are drastically better when the network is also bootstrapped simultaneously. This means that whatever software is needed to operate the network is installed with initial working parameters coincident with the compute/storage installation.There are very few examples of integrated bootstrapping in the industry outside of pre-engineered converged systems. However, this is changing. As customers expect more ease-of-use, they are forcing vendors to provide easier installation for their components and to work together with other vendors to provide single installation and bootstrapping mechanisms that resolve the common chicken and the egg issues.
  • Lifecycle
    “Lifecycle” refers to the various phases a particular resource might go through. For example, a virtual machine needs to be created, modified or moved, and eventually destroyed. For storage a given data store might need to have similar type events and may also need to be “rebuilt” or “re-silvered” if the underlying drive system is changed. Increasingly, higher-speed “NVMe” based memory systems are being used as the underlying storage mechanism which can have explicit end-to-end lossless requirements for packet transport. The network needs to understand ALL of these events and situations to provide a fully integrated environment.For many events, the network simply needs to provide the right connectivity to a new entity creation or change the connectivity based on a move. A common example of this is how a new VM can automatically get its port and VLAN configuration when it is created or have it updated when it is moved. But there are other events that also require the network to respond in more complex ways. For example, a data store that is built from an SDI-based distributed cluster might need to ensure that the infra-cluster meta-data traffic is fully isolated and secured for the cluster to operate well. Or, imagine the user needs to evacuate an entire rack of VMs to upgrade the physical hardware. Here the network will be required to provide the addition of temporary bandwidth to ensure that the evacuation can finish as quickly as possible.Ultimately, we have lifecycle needs for compute and storage entities, and for each of those we have 2 broad types of integration needs – auto-configuration of network for connectivity purposes, and dynamic network response to events that need network resources such as bandwidth, low latency, or dedicated network paths.Most networking vendors, if they do any lifecycle integration, focus only on compute event, and typically only provide VLAN auto-configuration for new VMs or dynamic updates as VMs move. As discussed above, this is only a small set of the overall lifecycle that should be considered.
  • Converged Management
    Ultimately customers building Private Clouds should have as few management consoles required as possible, also known as Single-Pane of Glass Management. Many of the leading cloud management platforms provide the ability to create specific third-party plug-ins to allow the other systems to be managed from that platform. A fully integrated network should provide as much management integration into that platform as possible. This should not stop at the “read-only” viewing of network information, but extend into full operational control of the system.Since ultimately the cloud administrator or operator is responsible for the entire infrastructure, the focus on converged management should be their chosen management platform. This puts the onus on the network solution to “export” its visibility and configuration capabilities easily into third-party platforms.Many network vendors that claim integration provide only network CLI-based visibility. This “integration” takes VM level information (such as name and MAC address) and correlates it with network information (MAC address location such as physical port). This type of integration then allows the network administrator to view where a given VM is located, typically by typing a CLI command into the network console. While this type of integration provides some contextual value for a network administrator, it does not do anything for a cloud administrator trying to manage a complete infrastructure.

SO, IS IT REALLY “INTEGRATED”?

To achieve a true on-premise cloud, integration needs to evolve. It needs to be fully bi-directional information exchange, and it needs to cover all three layers of integrated networking requirements:

  • Bootstrap:
    • Integrated Day 0 Installation and Process
  • Lifecycle:
    • Compute Events → Network Auto-Configuration
    • Compute Events → Network Dynamic Response
    • Storage Events → Network Auto-Configuration
    • Storage Events → Network Dynamic Response
  • Converged Management:
    • Integrated Visibility (in Cloud Management Platform)
    • Integrated Configuration (in Cloud Management Platform)

Most vendors really only focus on network auto-configuration for compute events. Ultimately, as the vendors realize that enterprises need better than that, they will start to work together to provide a more complete solution across the various compute, storage, and networking software-defined stacks.

When evaluating vendors for your own enterprise data center, be sure to look for network vendors that are leading that discussion with their compute and storage partners. Ask the tough questions and dig deep into their definition of “integrated”. You may discover it does not necessarily mean what they think it means, or what you need.

The post “INTEGRATED” – YOU KEEP USING THAT WORD, I DO NOT THINK IT MEANS WHAT YOU THINK IT MEANS appeared first on Plexxi.

Read the original blog entry...

More Stories By Mat Mathews

Visionary solutions are built by visionary leaders. Plexxi co-founder and Vice President of Product Management Mat Mathews has spent 20 years in the networking industry observing, experimenting and ultimately honing his technology vision. The resulting product — a combination of traditional networking, software-defined networking and photonic switching — represents the best of Mat's career experiences. Prior to Plexxi, Mat held VP of Product Management roles at Arbor Networks and Crossbeam Systems. Mat began his career as a software engineer for Wellfleet Communications, building high speed Frame Relay Switches for the carrier market. Mat holds a Bachelors of Science in Computer Systems Engineering from the University of Massachusetts at Amherst.

Latest Stories
While a hybrid cloud can ease that transition, designing and deploy that hybrid cloud still offers challenges for organizations concerned about lack of available cloud skillsets within their organization. Managed service providers offer a unique opportunity to fill those gaps and get organizations of all sizes on a hybrid cloud that meets their comfort level, while delivering enhanced benefits for cost, efficiency, agility, mobility, and elasticity.
Isomorphic Software is the global leader in high-end, web-based business applications. We develop, market, and support the SmartClient & Smart GWT HTML5/Ajax platform, combining the productivity and performance of traditional desktop software with the simplicity and reach of the open web. With staff in 10 timezones, Isomorphic provides a global network of services related to our technology, with offerings ranging from turnkey application development to SLA-backed enterprise support. Leadin...
DevOps has long focused on reinventing the SDLC (e.g. with CI/CD, ARA, pipeline automation etc.), while reinvention of IT Ops has lagged. However, new approaches like Site Reliability Engineering, Observability, Containerization, Operations Analytics, and ML/AI are driving a resurgence of IT Ops. In this session our expert panel will focus on how these new ideas are [putting the Ops back in DevOps orbringing modern IT Ops to DevOps].
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
Enterprises are striving to become digital businesses for differentiated innovation and customer-centricity. Traditionally, they focused on digitizing processes and paper workflow. To be a disruptor and compete against new players, they need to gain insight into business data and innovate at scale. Cloud and cognitive technologies can help them leverage hidden data in SAP/ERP systems to fuel their businesses to accelerate digital transformation success.
Concerns about security, downtime and latency, budgets, and general unfamiliarity with cloud technologies continue to create hesitation for many organizations that truly need to be developing a cloud strategy. Hybrid cloud solutions are helping to elevate those concerns by enabling the combination or orchestration of two or more platforms, including on-premise infrastructure, private clouds and/or third-party, public cloud services. This gives organizations more comfort to begin their digital tr...
Most organizations are awash today in data and IT systems, yet they're still struggling mightily to use these invaluable assets to meet the rising demand for new digital solutions and customer experiences that drive innovation and growth. What's lacking are potent and effective ways to rapidly combine together on-premises IT and the numerous commercial clouds that the average organization has in place today into effective new business solutions.
Keeping an application running at scale can be a daunting task. When do you need to add more capacity? Larger databases? Additional servers? These questions get harder as the complexity of your application grows. Microservice based architectures and cloud-based dynamic infrastructures are technologies that help you keep your application running with high availability, even during times of extreme scaling. But real cloud success, at scale, requires much more than a basic lift-and-shift migrati...
David Friend is the co-founder and CEO of Wasabi, the hot cloud storage company that delivers fast, low-cost, and reliable cloud storage. Prior to Wasabi, David co-founded Carbonite, one of the world's leading cloud backup companies. A successful tech entrepreneur for more than 30 years, David got his start at ARP Instruments, a manufacturer of synthesizers for rock bands, where he worked with leading musicians of the day like Stevie Wonder, Pete Townsend of The Who, and Led Zeppelin. David has ...
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understa...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Addteq is a leader in providing business solutions to Enterprise clients. Addteq has been in the business for more than 10 years. Through the use of DevOps automation, Addteq strives on creating innovative solutions to solve business processes. Clients depend on Addteq to modernize the software delivery process by providing Atlassian solutions, create custom add-ons, conduct training, offer hosting, perform DevOps services, and provide overall support services.
Contino is a global technical consultancy that helps highly-regulated enterprises transform faster, modernizing their way of working through DevOps and cloud computing. They focus on building capability and assisting our clients to in-source strategic technology capability so they get to market quickly and build their own innovation engine.
When applications are hosted on servers, they produce immense quantities of logging data. Quality engineers should verify that apps are producing log data that is existent, correct, consumable, and complete. Otherwise, apps in production are not easily monitored, have issues that are difficult to detect, and cannot be corrected quickly. Tom Chavez presents the four steps that quality engineers should include in every test plan for apps that produce log output or other machine data. Learn the ste...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...