{"id":6348,"date":"2024-02-02T16:50:20","date_gmt":"2024-02-02T06:50:20","guid":{"rendered":"https:\/\/sysmit.com\/cf22\/?p=6348"},"modified":"2024-02-02T23:05:59","modified_gmt":"2024-02-02T13:05:59","slug":"dora-metrics-engineering-excellence","status":"publish","type":"post","link":"https:\/\/sysmit.com\/cf22\/dora-metrics-engineering-excellence\/","title":{"rendered":"#25 &#8211; DORA and the Pursuit of Engineering Excellence (with Tim Wheeler)"},"content":{"rendered":"\n<p><strong><span class=\"stk-highlight\" style=\"color: var(--base-3);background-color: var(--contrast-3)\">Episode 25 [SREpath Podcast]<\/span><\/strong><\/p>\n\n\n<div class=\"gb-grid-wrapper gb-grid-wrapper-0de1a18b\">\n<div class=\"gb-grid-column gb-grid-column-fe753567\"><div class=\"gb-container gb-container-fe753567\">\n\n<iframe style=\"border-radius:12px\" src=\"https:\/\/open.spotify.com\/embed\/episode\/5376DUY1C5WZkqvSRqakn0?utm_source=generator&#038;t=0\" width=\"100%\" height=\"152\" frameBorder=\"0\" allowfullscreen=\"\" allow=\"autoplay; clipboard-write; encrypted-media; fullscreen; picture-in-picture\" loading=\"lazy\"><\/iframe>\n\n<\/div><\/div>\n<\/div>\n\n<h2 class=\"wp-block-heading\" id=\"show-notes\">Show notes<\/h2>\n\n\n\n<p>Tim Wheeler is not shy to skip past all-too-common platitudes and describe what it takes to build a solid developer experience and engineering culture. <\/p>\n\n\n\n<p>Tim is the Director of Engineering Excellence at SquaredUp, which is in the observability dashboard space. <\/p>\n\n\n\n<p>To him, DORA metrics are the supporting act for engineering excellence, not the headlining act. <\/p>\n\n\n\n<p>If that term is not familiar to you, DORA metrics are a model designed to help improve engineering productivity. They were developed by DevOps thought leaders, Nicole Forsgren and Jez Humble.<\/p>\n\n\n\n<p>I&#8217;ve outlined the 4 key metrics of DORA below:<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"712\" src=\"https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/dora-key-metrics-1024x712.png\" alt=\"\" class=\"wp-image-6377\" srcset=\"https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/dora-key-metrics-1024x712.png 1024w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/dora-key-metrics-300x209.png 300w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/dora-key-metrics-768x534.png 768w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/dora-key-metrics.png 1260w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n\n<p>I developed a much stronger grounding on the concepts behind effective teams and culture from talking with Tim. <\/p>\n\n\n\n<p>You also will benefit from our chat by picking up actionable tips on DORA metrics, handling team workloads, and more. <\/p>\n\n\n\n<p>You can <a href=\"https:\/\/www.linkedin.com\/in\/timjameswheeler\/\">connect with Tim via LinkedIn <\/a><\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"more-about-our-conversation\">More about our conversation<\/h2>\n\n\n<p>This episode is <strong><em>very\u00a0<\/em><\/strong>different from my usual about SRE. It&#8217;s a topic that spans an entire engineering organization, but funnily enough, it can affect SREs in a deep and meaningful way.\u00a0<\/p>\n\n\n\n<p>Remember that a large chunk of your time as an&nbsp;\ufeffSRE should be spent on doing proactive work i.e. projects. That means engineering work, which just like developers have, is prone to being measured.<\/p>\n\n\n\n<p>Tim has a strong maths and statistics background, which explains his prior career experience in software testing in banking and capital markets. <\/p>\n\n\n\n<p>With all of this in mind, I feel assured that Tim has more than a fair grasp of DORA metrics and their impact on engineering performance (or excellence). <\/p>\n\n\n\n<p>Our conversation touched on fascinating areas like:<\/p>\n\n\n\n<p>\u27a1\ufe0f How Tim uses a <strong>data mesh to gain insights on team health &amp; performance <\/strong><\/p>\n\n\n\n<p>\u27a1\ufe0f The <strong>need for a clear purpose behind the metrics you use <\/strong>to drive engineering work, to prevent metric sprawl<\/p>\n\n\n\n<p>\u27a1\ufe0f <strong>Avoiding perverse incentives <\/strong>that can arise from tying individual performance directly to metrics <\/p>\n\n\n\n<p>Let&#8217;s unpack each of these:<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"using-data-mesh-to-gain-insights-into-team-health-amp-performance\">Using data mesh to gain insights into team health &amp; performance<\/h2>\n\n\n<p>Tim emphasizes the significance of data meshes in building comprehensive dashboards at SquaredUp. <\/p>\n\n\n\n<p>It seems to me like they do this to bring together fragmented team data onto a singular dashboard. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><a href=\"https:\/\/www.linkedin.com\/posts\/timjameswheeler_engineeringexcellence-dashboards-metrics-activity-7138868650987380737-x7Mf?utm_source=share&amp;utm_medium=member_desktop\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"459\" src=\"https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/engineering-team-workload-comparison-dashboard-1024x459.jpeg\" alt=\"Engineering team workload comparison by Tim Wheeler (SquaredUp) - originally posted on LinkedIn \" class=\"wp-image-6370\" style=\"width:743px;height:auto\" srcset=\"https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/engineering-team-workload-comparison-dashboard-1024x459.jpeg 1024w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/engineering-team-workload-comparison-dashboard-300x134.jpeg 300w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/engineering-team-workload-comparison-dashboard-768x344.jpeg 768w, https:\/\/sysmit.com\/cf22\/wp-content\/uploads\/engineering-team-workload-comparison-dashboard.jpeg 1056w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><figcaption class=\"wp-element-caption\">Image by Tim Wheeler of a dashboard on comparison of team workloads <br>(click image to see Tim&#8217;s original post on LinkedIn)<\/figcaption><\/figure>\n\n\n\n<p>Tim put it like this:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>In terms of the tooling, we use what we call a data mesh to bring data from different sources to create a dashboard, but then we want to be able to roll it up so that at different levels within a company, you get the view that you need.<\/p>\n<\/blockquote>\n\n\n\n<p>This makes a lot of sense because it enables different organizational levels to access tailored insights.<\/p>\n\n\n\n<p> I like the idea because it can help:<\/p>\n\n\n\n<ul>\n<li>bust siloes among teams<\/li>\n\n\n\n<li>drive more transparency across the organization <em>and<\/em><\/li>\n\n\n\n<li>support more informed decision-making<\/li>\n<\/ul>\n\n\n\n<p>In a way, it&#8217;s a showcase of a pragmatic application of data meshes in an engineering context. A decentralized data architecture is not an easy task!<\/p>\n\n\n\n<p>I think it&#8217;s an important goal for engineering leaders to create <em>meaningful <\/em>dashboards that truly reflect what&#8217;s going on across the organization with accurate data.  <\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n<h2 class=\"wp-block-heading\" id=\"having-a-clear-purpose-behind-the-metrics-driving-team-performance\">Having a clear purpose behind the metrics driving team performance<\/h2>\n\n\n<p>In our discussion, Tim emphasized the critical importance of a clear purpose behind <em>every <\/em>metric.<\/p>\n\n\n\n<p>Rather than drowning in an excess of metrics, he advocates for a thoughtful selection, ensuring each metric serves a purpose and drives actionable insights. <\/p>\n\n\n\n<p>Tim&#8217;s stance on this boils down to <strong><em>&#8220;If I can&#8217;t say what it&#8217;s for, just delete it.&#8221;. <\/em><\/strong><\/p>\n\n\n\n<p>Here&#8217;s a direct quote from our chat:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>So a large part of what you do in terms of building these dashboards is actually having teams define their own status&#8230; What means that you&#8217;re healthy? What means that the team is on track and in a good place and what should be a warning&#8230; If I can&#8217;t say what it&#8217;s for, just delete it.<\/p>\n<\/blockquote>\n\n\n\n<p>We spoke about the idea of having a balance between quantitative and qualitative data, steering away from overreliance on metrics alone. <\/p>\n\n\n\n<p>This approach prevents &#8220;metric sprawl&#8221; and encourages meaningful conversations within teams. <\/p>\n\n\n\n<p>All this underscores the need for metrics to align with the team&#8217;s goals. Only then can we foster a healthier work environment that steers teams and individuals clear of counterproductive incentives.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n<h2 class=\"wp-block-heading\" id=\"avoiding-perverse-incentives-from-tying-performance-to-metrics\">Avoiding perverse incentives from tying performance to metrics<\/h2>\n\n\n<p>Drawing from experience, Tim emphasizes that once people are aware of the metric determining their performance, it becomes counterproductive. <\/p>\n\n\n\n<p>He stresses the potential misuse of metrics like deployment frequency, highlighting the risk of incentivizing speed over quality. <\/p>\n\n\n\n<p>Here&#8217;s the quote:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>One of the DORA metrics being deployment frequency can be a really misleading statistic. Because, yeah, give me the keys to the kingdom and let me just merge whatever I want. I can give you any deployment frequency you like. I can do it every minute, I can write the script. All metrics are open to abuse and can encourage the wrong behavior.<\/p>\n<\/blockquote>\n\n\n\n<p>Instead, Tim advocates for a blend of metrics applied at a higher level, avoiding individual targeting. <\/p>\n\n\n\n<p>He underscores the importance of combining quantitative and qualitative data.<\/p>\n\n\n\n<p>The key here is to maintain a balance to prevent skewed behaviors. Only then can we ensure a holistic approach to performance evaluation.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>In&nbsp;<a href=\"https:\/\/open.spotify.com\/episode\/5376DUY1C5WZkqvSRqakn0?si=141fb5002346472a\" target=\"_blank\" rel=\"noreferrer noopener\">Episode #25 of the SREpath podcast,&nbsp;Tim tells us about DORA and the pursuit of engineering excellence<\/a>&nbsp;[Spotify link]<\/p>\n\n\n\n<p>I&#8217;m sure you will gain some interesting ideas to take back to your team about using DORA metrics better. <\/p>\n\n\n\n<p>At the very least, you can take inspiration for a more generative engineering culture.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Episode 25 [SREpath Podcast] Show notes Tim Wheeler is not shy to skip past all-too-common platitudes and describe what it takes to build a solid developer experience and engineering culture. Tim is the Director of Engineering Excellence at SquaredUp, which is in the observability dashboard space. To him, DORA metrics are the supporting act for [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[48],"tags":[82,78],"_links":{"self":[{"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/posts\/6348"}],"collection":[{"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/comments?post=6348"}],"version-history":[{"count":7,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/posts\/6348\/revisions"}],"predecessor-version":[{"id":6378,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/posts\/6348\/revisions\/6378"}],"wp:attachment":[{"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/media?parent=6348"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/categories?post=6348"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sysmit.com\/cf22\/wp-json\/wp\/v2\/tags?post=6348"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}