SYS-CON MEDIA Authors: Liz McMillan, Carmen Gonzalez, Elizabeth White, Pat Romanski, Gary Arora

Article

Applying DevOps to Deliver Quality at Speed

Applying DevOps to Deliver Quality at Speed

Fannie Mae operates in the already heavily regulated financial services/mortgage markets. Add to that it is a government sponsored entity, which means it is laden with many of the policies and regulations of federal government agencies. Plus, they have 6,000 employees and annual revenue of $22 billion. So, they could be a poster child for, "You can't implement DevOps there."

Barry Snyder, DevOps Manager, Developer Platforms at Fannie Mae, begs to differ, which is what he did in his 2016 All Day DevOps talk, How Fannie Mae Applied DevOps to Deliver Quality at Speed. He looks at:

  • Agile and DevOps transformation
  • Doing more with less with greater quality
  • Lessons learned

Fannie Mae started implementing DevOps in 2014, and Barry was in the middle of it from the start. He gave his talk at the end of 2016, and, as he said, they still aren't fully adopted (are you ever), but he gave a status and a comparison between where they were and where they are now.

2012

2016

10 projects using modified-Agile. Essentially waterfall with terminology/concepts from Agile

155 using Scrum/SAFe and growing

9 to 18 months to release to production

Projects releasing every month

9 governance gates/inspect 100% before release to production

1 working group, 1 CAB, inspect 10% after release to production

2-4 months to provision dev and test servers

Minutes to provision dev and test servers

300-400 builds per month; 900-1200 deployments per month

3-4K builds per month; 12-15K deployments per month

Testing took 50% the time it took to construct the solution

80% savings in testing time and executed within the sprint

No means to measure and evaluate the productivity from release to release

Productivity increasing by an average of 30%-40% with costs going down by 30%

barry1.png

According Barry, these results are being sustained - they are not just a blip. To get there, they had to get an appetite for risk. Overcoming that hurdle required them to realize when you do 100% risk mitigation, you are going to spend more time avoiding risk than it would take to mitigate something.

They are also executing Application Lifecycle Management (ALM), a step up from CI/CD. They look at all of the tools and processes along the lifecycyle, peer reviews, automated building, testing, etc. They are implementing automated processes with a variety of tools to achieve this.

As an example, at Fannie Mae, it previously took 5-6 weeks to request a library, now it is immediate because it is automated through Sonatype's Nexus.

barry2.png

As we hear from all practitioners, it is a journey, not a sprint (pun intended). Fannie Mae started at the end of 2014, and they are still in progress. They went from 9-18 months per deployment to a month on a consistent basis. They are close to always deploying during sprints, and are working towards having an idea, writing code, and releasing it into production.

Barry presented lessons learned:

Leverage what they had while shifting left:

    • Release Management Infrastructure (evolved into our CI/CD)
    • VM provisioning infrastructure (evolved into our RapidIT)
    • Test Automation
    • Code Quality
  • Recognize it is a culture shift in how work is performed:
    • Agile Adoption "You do this for the people, not do the people.""We started on the IT side, then the business side saw the value add."
    • Automate Oversight/Transparency - You can't do this manually. With 120 apps, there were 8,000 libraries not accounted for.
    • Portfolio Analysis (Risk Reduction, Quality, ROI, Cost Reduction)
    • Application Quality is a Supply Chain
    • Trust developers and get out of the way
  • Measure Results
    • Shifts in quality
    • Adoption rate
    • Accelerated delivery
    • Benchmark productivity and associated productivity cost

You can watch Barry's entire talk online here. If you missed any of the other 30-minute long presentations from All Day DevOps, they are easy to find and available free-of-charge here.  Finally, be sure to register you and the rest of your team for the 2017 All Day DevOps conference here.  This year's event will offer 96 practitioner-led sessions (no vendor pitches allowed).  It's all free and online on October 24th.

More Stories By Derek Weeks

In 2015, Derek Weeks led the largest and most comprehensive analysis of software supply chain practices to date across 160,000 development organizations. He is a huge advocate of applying proven supply chain management principles into DevOps practices to improve efficiencies, reduce costs, and sustain long-lasting competitive advantages.

As a 20+ year veteran of the software industry, he has advised leading businesses on IT performance improvement practices covering continuous delivery, business process management, systems and network operations, service management, capacity planning and storage management. As the VP and DevOps Advocate for Sonatype, he is passionate about changing the way people think about software supply chains and improving public safety through improved software integrity. Follow him here @weekstweets, find me here www.linkedin.com/in/derekeweeks, and read me here http://blog.sonatype.com/author/weeks/.

Latest Stories
As the digitization of business accelerates the move of critical applications and content to the cloud, the network has never been as critical to business success. Consuming everything ‘as-a-service' requires new levels of network automation, agility and security. Discover how Enterprises can take advantage of Digital Platforms, directly connecting to an extensive ecosystem of digital partners and flex their service at the click of a button.
Blockchain has shifted from hype to reality across many industries including Financial Services, Supply Chain, Retail, Healthcare and Government. While traditional tech and crypto organizations are generally male dominated, women have embraced blockchain technology from its inception. This is no more evident than at companies where women occupy many of the blockchain roles and leadership positions. Join this panel to hear three women in blockchain share their experience and their POV on the futu...
Concerns about security, downtime and latency, budgets, and general unfamiliarity with cloud technologies continue to create hesitation for many organizations that truly need to be developing a cloud strategy. Hybrid cloud solutions are helping to elevate those concerns by enabling the combination or orchestration of two or more platforms, including on-premise infrastructure, private clouds and/or third-party, public cloud services. This gives organizations more comfort to begin their digital tr...
Cloud Storage 2.0 has brought many innovations, including the availability of cloud storage services that are less expensive and much faster than previous generations of cloud storage. Cloud Storage 2.0 has also delivered new and faster methods for migrating your premises storage environment to the cloud and the concept of multi-cloud. This session will provide technical details on Cloud Storage 2.0 and the methods used to efficiently migrate from premises-to-cloud storage. This session will als...
In very short order, the term "Blockchain" has lost an incredible amount of meaning. With too many jumping on the bandwagon, the market is inundated with projects and use cases that miss the real potential of the technology. We have to begin removing Blockchain from the conversation and ground ourselves in the motivating principles of the technology itself; whether it is consumer privacy, data ownership, trust or even participation in the global economy, the world is faced with serious problems ...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It's clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Th...
For enterprises to maintain business competitiveness in the digital economy, IT modernization is required. And cloud, with its on-demand, elastic and scalable principles has resoundingly been identified as the infrastructure model capable of supporting fast-changing business requirements that enterprises are challenged with, as a result of our increasingly connected world. In fact, Gartner states that by 2022, 28% of enterprise IT spending will have shifted to cloud. But enterprises still must d...
Cloud-Native thinking and Serverless Computing are now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that pro...
The level of trust we have with individuals, businesses, and technology affects our lives daily. This is important to remember when discussing new technologies. For example, our level of trust is a critical factor when evaluating a new technology as a potential solution for providing business value. Given the importance of trust, imagine one's reaction upon hearing that blockchain is a "trustless trust" system. On the surface, that does sound like an oxymoron. This paper discusses how "trustless...
Public clouds dominate IT conversations but the next phase of cloud evolutions are "multi" hybrid cloud environments. The winners in the cloud services industry will be those organizations that understand how to leverage these technologies as complete service solutions for specific customer verticals. In turn, both business and IT actors throughout the enterprise will need to increase their engagement with multi-cloud deployments today while planning a technology strategy that will constitute a ...
Data center, on-premise, public-cloud, private-cloud, multi-cloud, hybrid-cloud, IoT, AI, edge, SaaS, PaaS... it's an availability, security, performance and integration nightmare even for the best of the best IT experts. Organizations realize the tremendous benefits of everything the digital transformation has to offer. Cloud adoption rates are increasing significantly, and IT budgets are morphing to follow suit. But distributing applications and infrastructure around increases risk, introdu...
Moving to Azure is the path to digital transformation, but not every journey is effective. Organizations that start with a cohesive, well-planned migration strategy can avoid common mistakes and stay a step ahead of the competition. Learn from Atmosera CEO, Jon Thomsen about the opportunities and challenges found in three pivotal phases of the journey to the cloud: Evaluation and Architecting, Migration and Management, and Optimization & Innovation. In each phase, there are distinct insights tha...
Most modern computer languages embed a lot of metadata in their application. We show how this goldmine of data from a runtime environment like production or staging can be used to increase profits. Adi conceptualized the Crosscode platform after spending over 25 years working for large enterprise companies like HP, Cisco, IBM, UHG and personally experiencing the challenges that prevent companies from quickly making changes to their technology, due to the complexity of their enterprise. An accomp...
Every organization is facing their own Digital Transformation as they attempt to stay ahead of the competition, or worse, just keep up. Each new opportunity, whether embracing machine learning, IoT, or a cloud migration, seems to bring new development, deployment, and management models. The results are more diverse and federated computing models than any time in our history.
Andrew Keys is co-founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereum.