HOW TO MEASURE DEVOPS PERFORMANCE TO INCREASE ENTERPRISE AGILITY HOW TO MEASURE DEVOPS PERFORMANCE WHY SHOULD YOU MEASURE DEVOPS PERFORMANCE? Measuring DevOps performance is essential to improving overall enterprise agility. Your velocity is constrained to your most constricted bottleneck. In many enterprise organizations, the planning and development phases have been significantly optimized, leaving the delivery phase as the greatest opportunity for further optimization. Measuring DevOps performance provides highly precise feedback describing the flow of business value in the form of new software features. Understanding precisely how your DevOps value streams perform helps identify the bottlenecks and wait-states that slow the flow of new software between developers and end users. WWW.VERSIONONE.COM Deploying new software quickly can be technically achieved with relative ease. However, delivering faster is not the only goal of DevOps. As you increase delivery speed, you’ll need to continuously evaluate and monitor delivery risk, software quality, and process compliance. Measuring DevOps performance helps you better prioritize opportunities and quantify performance results with each incremental investment in automation or process redesign. This is how you get Continuous Delivery with confidence and continuous confidence requires continuous measurement. 1 HOW TO MEASURE DEVOPS PERFORMANCE 4 Benefits of MEASURING DEVOPS PERFORMANCE 1 ACCELERATE DELIVERY Identify and remove bottlenecks, reducing the time software spends waiting in delivery phases. 0.1% of source code generates over 50% of the business risk. 3 Detect potential deployment risks before they cause your initiative to fail or be delayed. Discover defects earlier and determine the root cause of the defect faster, reducing the cost of repair and increasing the quality of the software you are delivering. 2 Defects are twice as expensive to fix when detected during downstream delivery and ten times as expensive to fix post-production. IMPROVE COMPLIANCE Practicing real-time compliance cuts days, weeks, and sometimes months from each deployment cycle. WWW.VERSIONONE.COM REDUCE RISK INCREASE QUALITY /////////////////////////////////////////////////////////////////////////////////////////////////// 95% of time business value spends in delivery is in a wait state. Document adherence to process controls as the software is going through the actual step, greatly reducing the cost, time, and rework associated with traditional, latestage compliance audits. 4 2 HOW TO MEASURE DEVOPS PERFORMANCE What is MEASURING DEVOPS PERFORMANCE Measuring DevOps performance is the practice of evaluating the execution of DevOps in context of your software organization’s entire value stream. The foundational element of measuring DevOps performance is tracing delivery outputs to the agile strategy and development work items they are associated with to enable you to measure the delivery velocity, deployment risk, release quality, and process compliance of the business value you are delivering to customers. WWW.VERSIONONE.COM STRATEGY & DEVELOPMENT WORK ITEMS DELIVERY OUTPUTS Initiatives Builds Epics Artifacts Features Packages Stories Releases Defects Deployments 3 HOW TO MEASURE DEVOPS PERFORMANCE WHAT IS A VALUE STREAM? A value stream is all of the steps required to create and deliver something of value, such as a feature or product. Your value stream starts at ideation, continues through development as value is created, and ends when the feature, product, or service has been delivered to your customers. WHAT IS A FRAGMENTED VALUE STREAM? WHAT IS A UNIFIED VALUE STREAM? Most enterprise organizations’ value streams are fragmented into three main phases: strategy, development, and delivery. In a fragmented value stream, each phase evolves into its own teams, processes, tools, and information that are not fully integrated with the rest of the value stream, resulting in lower enterprise agility. To improve DevOps and enterprise agility to their full potential, you must integrate all the people, process, tools, and information across the organization into a unified value stream, providing stakeholders across all phases with the information and management insight needed to make better decisions. WWW.VERSIONONE.COM 4 HOW TO MEASURE DEVOPS PERFORMANCE 4 MEASURES OF DEVOPS VELOCITY Measuring your delivery velocity helps you identify your biggest bottlenecks, alleviate those bottlenecks, and ensure that value is moving at peak efficiency. WWW.VERSIONONE.COM How value flows thru a value stream map Wait-time at each step Cumulative value in each deployment event Time elapsed between deployments 5 HOW TO MEASURE DEVOPS PERFORMANCE 3 MEASURES OF DEVOPS RISK Measuring delivery risk helps you avoid unanticipated delays, highlight riskier deployments, and keep from releasing anything into production before it is complete. WWW.VERSIONONE.COM Fragility of new code Backlog item dependencies Change set complexity 6 HOW TO MEASURE DEVOPS PERFORMANCE 3 MEASURES OF DEVOPS QUALITY Measuring delivery quality helps you detect defects before they are released, reduce the cost of repair, and increase the quality of software being delivered. WWW.VERSIONONE.COM Time elapsed between commit and issue discovery Frequency of broken builds Ratio of manual and automated tests 7 HOW TO MEASURE DEVOPS PERFORMANCE 4 MEASURES OF DEVOPS COMPLIANCE Process compliance for each step of a value stream map Measuring delivery compliance helps you increase the efficiency of compliance, decrease rework, and reduce costs. Control pass/fail events at each stage of delivery Step by step audit trail for each backlog item Inventory of business value in each release event WWW.VERSIONONE.COM 8 HOW TO MEASURE DEVOPS PERFORMANCE VERSIONONE CONTINUUM MEASURES //////////////////////////////////////////////////////////////////////////////////////// START MEASURING DEVOPS PERFORMANCE WITH VERSIONONE CONTINUUM™ DELIVERY VELOCITY DEPLOYMENT RISK RELEASE QUALITY PROCESS COMPLIANCE VersionOne Continuum is an enterprise continuous delivery solution for accelerating the velocity, reducing the risk, improving the compliance, and ensuring the quality of each software deployment. WWW.VERSIONONE.COM 9 HOW TO MEASURE DEVOPS PERFORMANCE See how VersionOne Continuum helps you measure DevOps performance and track business value from the first commit through production deployment. SEE IT IN ACTION Copyright © 2017. All rights reserved. VersionOne is a registered trademark of VersionOne Inc. 01-2017
