SYS-CON MEDIA Authors: Yeshim Deniz, Zakia Bouachraoui, Liz McMillan, Elizabeth White, Maria C. Horton

Blog Feed Post

Achieving Command and Control through Requests and Responses

I’ve been talking about layer 7 load balancing (L7 LB) since, well, for a long time. From the first inception of it back in the day when someone decided that routing requests using URIs and host headers was a pretty innovative thing to do. bifurcated-network-stateful-statelessIf you must know, that was back in 2001.

And it was innovative then. Because at the time, load balancing and routing was something addressed at layers 3 and 4 – that’s TCP/IP – in the network using routers and switches and load balancers and network architecture.  You didn’t commonly see network devices operating at L7. You just didn’t, except in the app infrastructure.  

Today you see it all the time in the network. That virtual server definition in httpd.conf that relies on HTTP host header? That’s part of L7 LB. Rewriting URLs? Part of L7 LB. Persistent (sticky) sessions? You got this, right? Right. L7 LB.

So basically I’ve spent most of this century preaching about L7 LB.

One Monday morning in May I was reading the Internet (cause I do that on Mondays) and came across a lengthy discussion of microservices and L7 LB.

Guys, I must tell you I was totally excited by this blog. I was excited by the content, by the focus on the role of L7 LB in microservices and emerging app architectures (he mentions canary deployments), and by the words the author used to seamlessly move what has been a traditionally network-focused technology into an ops-focused technology. This is, without a doubt, one of the best (and most concise) descriptions of L7 LB I’ve read on the Internet:

It’s this experience that motivated linkerd (pronounced “linker dee”), a proxy designed to give service operators command & control over traffic between services. This encompasses a variety of features including transport security, load balancing, multiplexing, timeouts, retries, and routing.

In this post, I’ll discuss linkerd’s approach to routing. Classically, routing is one of the problems that is addressed at Layers 3 and 4—TCP/IP—with hardware load balancers, BGP, DNS, iptables, etc. While these tools still have a place in the world, they’re difficult to extend to modern multi-service software systems. Instead of operating on connections and packets, we want to operate on requests and responses. Instead of IP addressees and ports, we want to operate on services and instances.

I highlighted that one part because man, there’s just so much wrapped up in that single statement I can’t even. Literally.

The concept of operating on requests and responses is the foundation of entire solution sets across security, scale, and performance. A proxy capable of inspecting requests and responses is able to note only deal with transport security (TLS/SSL offload) and load balancing, but app security, as well. Request and response inspection is a critical component of app security, scanning and scrubbing of content deep down in the payload (the JSON, the HTML, the XML) to find exploits and malicious content is the premise of a web application firewall.

And then there’s access control, which increasingly cannot simply rely on IP addresses and user names. The proliferation of cloud and roaming, mobile employees and users alike means a greater focus on controlling access to applications based on context. Which means operating on requests and being able to extract a variety of information from it that will provide richer access policies able to cross the chasm from users to things (devices).

And of course there’s scale. Scale today is not about load balancing algorithms, it’s about architecture. Application and operational architecture alike. The use of DevOps-driven deployment patterns like canary and blue-green deployments as well as sharding and partitioning architectures are critical to achieving not just the seamless scale required today but the efficacy of those architectures. L7 LB is key to these endeavors, enabling fine-grained control over the routing of requests and handling of responses between apps (micro or monolith) and users (thing and human). 

And that’s really what the aforementioned (did I mention it was awesome, already?) is talking about: L7 LB. Whether it’s hardware or software, in the cloud or on-premises, isn’t really all that important. That’s an operational detail that is (or should be) irrelevant when we’re talking about architecting a scalable application composed of “services and instances.”

I cannot reiterate often enough the importance of L7 LB as part of modern application architectures. And it’s exciting to see the dev and ops side of the world starting to shout the same thing as they encounter the operational challenges of scale and routing amidst a highly interconnected and interdependent set of services that are the foundation for apps (and business) today.

Read the original blog entry...

More Stories By Lori MacVittie

Lori MacVittie is responsible for education and evangelism of application services available across F5’s entire product suite. Her role includes authorship of technical materials and participation in a number of community-based forums and industry standards organizations, among other efforts. MacVittie has extensive programming experience as an application architect, as well as network and systems development and administration expertise. Prior to joining F5, MacVittie was an award-winning Senior Technology Editor at Network Computing Magazine, where she conducted product research and evaluation focused on integration with application and network architectures, and authored articles on a variety of topics aimed at IT professionals. Her most recent area of focus included SOA-related products and architectures. She holds a B.S. in Information and Computing Science from the University of Wisconsin at Green Bay, and an M.S. in Computer Science from Nova Southeastern University.

Latest Stories
Blockchain has shifted from hype to reality across many industries including Financial Services, Supply Chain, Retail, Healthcare and Government. While traditional tech and crypto organizations are generally male dominated, women have embraced blockchain technology from its inception. This is no more evident than at companies where women occupy many of the blockchain roles and leadership positions. Join this panel to hear three women in blockchain share their experience and their POV on the futu...
"At the keynote this morning we spoke about the value proposition of Nutanix, of having a DevOps culture and a mindset, and the business outcomes of achieving agility and scale, which everybody here is trying to accomplish," noted Mark Lavi, DevOps Solution Architect at Nutanix, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
BMC has unmatched experience in IT management, supporting 92 of the Forbes Global 100, and earning recognition as an ITSM Gartner Magic Quadrant Leader for five years running. Our solutions offer speed, agility, and efficiency to tackle business challenges in the areas of service management, automation, operations, and the mainframe.
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
Docker and Kubernetes are key elements of modern cloud native deployment automations. After building your microservices, common practice is to create docker images and create YAML files to automate the deployment with Docker and Kubernetes. Writing these YAMLs, Dockerfile descriptors are really painful and error prone.Ballerina is a new cloud-native programing language which understands the architecture around it - the compiler is environment aware of microservices directly deployable into infra...
Apptio fuels digital business transformation. Technology leaders use Apptio's machine learning to analyze and plan their technology spend so they can invest in products that increase the speed of business and deliver innovation. With Apptio, they translate raw costs, utilization, and billing data into business-centric views that help their organization optimize spending, plan strategically, and drive digital strategy that funds growth of the business. Technology leaders can gather instant recomm...
In an age of borderless networks, security for the cloud and security for the corporate network can no longer be separated. Security teams are now presented with the challenge of monitoring and controlling access to these cloud environments, at the same time that developers quickly spin up new cloud instances and executives push forwards new initiatives. The vulnerabilities created by migration to the cloud, such as misconfigurations and compromised credentials, require that security teams t...
Serverless Architecture is the new paradigm shift in cloud application development. It has potential to take the fundamental benefit of cloud platform leverage to another level. "Focus on your application code, not the infrastructure" All the leading cloud platform provide services to implement Serverless architecture : AWS Lambda, Azure Functions, Google Cloud Functions, IBM Openwhisk, Oracle Fn Project.
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In their Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, and Mark Lav...
AI and machine learning disruption for Enterprises started happening in the areas such as IT operations management (ITOPs) and Cloud management and SaaS apps. In 2019 CIOs will see disruptive solutions for Cloud & Devops, AI/ML driven IT Ops and Cloud Ops. Customers want AI-driven multi-cloud operations for monitoring, detection, prevention of disruptions. Disruptions cause revenue loss, unhappy users, impacts brand reputation etc.
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected pat...
Serverless Computing or Functions as a Service (FaaS) is gaining momentum. Amazon is fueling the innovation by expanding Lambda to edge devices and content distribution network. IBM, Microsoft, and Google have their own FaaS offerings in the public cloud. There are over half-a-dozen open source serverless projects that are getting the attention of developers.
CloudEXPO has been the M&A capital for Cloud companies for more than a decade with memorable acquisition news stories which came out of CloudEXPO expo floor. DevOpsSUMMIT New York faculty member Greg Bledsoe shared his views on IBM's Red Hat acquisition live from NASDAQ floor. Acquisition news was announced during CloudEXPO New York which took place November 12-13, 2019 in New York City.
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential. DevOpsSUMMIT at CloudEXPO expands the DevOps community, enable a wide sharing of knowledge, and educate delegates and technology providers alike.