<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Non-Standard Deviations]]></title><description><![CDATA[Exploring ideas in clinical psychology research & practice]]></description><link>https://www.non-standarddeviations.com</link><image><url>https://substackcdn.com/image/fetch/$s_!p9xX!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc2bb2a7-4b40-4b5a-bfac-3f51c22baf77_236x236.png</url><title>Non-Standard Deviations</title><link>https://www.non-standarddeviations.com</link></image><generator>Substack</generator><lastBuildDate>Mon, 07 Sep 2026 16:30:08 GMT</lastBuildDate><atom:link href="https://www.non-standarddeviations.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Joel]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[nsdeviations@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[nsdeviations@substack.com]]></itunes:email><itunes:name><![CDATA[Joel Lewin]]></itunes:name></itunes:owner><itunes:author><![CDATA[Joel Lewin]]></itunes:author><googleplay:owner><![CDATA[nsdeviations@substack.com]]></googleplay:owner><googleplay:email><![CDATA[nsdeviations@substack.com]]></googleplay:email><googleplay:author><![CDATA[Joel Lewin]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Why do therapists not improve with experience?]]></title><description><![CDATA[Several factors make it hard for therapists to translate experience into better outcomes. Understanding these issues is the first step to overcoming them. This is part two of a three part series.]]></description><link>https://www.non-standarddeviations.com/p/why-do-therapists-not-improve-with</link><guid isPermaLink="false">https://www.non-standarddeviations.com/p/why-do-therapists-not-improve-with</guid><dc:creator><![CDATA[Joel Lewin]]></dc:creator><pubDate>Thu, 27 Aug 2026 22:42:05 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!PV0c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PV0c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PV0c!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 424w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 848w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PV0c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg" width="1456" height="794" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:794,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3630591,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.non-standarddeviations.com/i/212988034?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PV0c!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 424w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 848w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!PV0c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbb6a31d3-0a91-4381-b28b-46a5e5b75b4a_2816x1536.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Therapists, on average, <a href="https://www.non-standarddeviations.com/p/therapists-do-not-improve-with-experience">do not improve with experience alone</a>. Their outcomes stagnate or deteriorate. But they do not all follow the same trajectory. Some therapists do improve over time. Some deteriorate dramatically. Many stay at the same level they reached part way through their training.</p><p>Various factors contribute to this phenomenon. They can broadly be categorised as:&nbsp;</p><ol><li><p>The nature of therapy;</p></li><li><p>The nature of therapists;</p></li><li><p>The nature of humans.</p></li></ol><p></p><p>Each one is in some ways conducive to the gradual erosion of therapist performance over time. But each of these factors also offers clues as to how experience can translate into improved, rather than gradually deteriorating, outcomes. In this post I&#8217;ll lay out each of these factors and the research that supports them. In the next post, I&#8217;ll explore some possible solutions.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.non-standarddeviations.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Non-Standard Deviations! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p><strong>The nature of therapy</strong></p><p>Therapy unfolds in a noisy environment in which the relationship between the therapist&#8217;s actions and client outcomes is hard to intuit (<a href="https://psycnet.apa.org/record/2013-45602-001">Tracey et al., 2014</a>).</p><p>As such, therapy is not the sort of endeavour that is readily conducive to the acquisition of expertise, which requires timely, accurate feedback in response to one&#8217;s actions. A basketball player practicing free throws can immediately and somewhat objectively perceive the effects of an adjustment to their foot position, and know whether it is an improvement to retain. In a few hours they can gather a sample of hundreds of outcomes on which to base this, whilst holding other variables steady. For a therapist, feedback is less immediate (typically weekly at best), and any adjustment they make to their practice is one independent variable among innumerable.</p><p>So many factors influence client outcomes beyond the therapist, including client factors (age, motivation etc.) and extratherapeutic factors (events in the client&#8217;s life). Did the therapist&#8217;s particular focus on accurate empathy contribute to the client&#8217;s recovery, or did the client just feel better because they got a new job or the Strait of Hormuz reopened? Did the therapist&#8217;s implementation of the Compassion Focused Therapy skills they learned during a recent workshop make the difference for this client, or would the client have simply got better anyway, due to the natural cycle of their mood? In fact, research shows therapist factors (e.g. empathic ability and facilitative interpersonal skills) account for only ~5% of variance in client outcomes (<a href="https://eprints.whiterose.ac.uk/id/eprint/138182/1/Johns%20et%20al.%20A%20systematic%20review%20of%20therapist%20effects%20-%20author%27s%20copy%20311018.pdf">Johns et al., 2019</a>).</p><p>There are complex and unpredictable interactions between the therapist&#8217;s actions and the unique individual client. What works with one person may not with another. In other words,<em> </em>anything &#8220;learned&#8221; from working with one client may not be relevant to the next one, which makes it hard to accumulate expertise across clients, although this may occur in very specific circumstances. <a href="https://www.academia.edu/download/48811048/The_effect_of_therapist_experience_on_ps20160913-6267-a6wngk.pdf">Leon and colleagues</a> (2005), for example, found that, when clients on a therapist&#8217;s caseload were matched in pairs based on demographic and clinical characteristics, the second client in the pair attained better outcomes, but only if they started therapy less than 75 days after the first. This very tentatively suggests some evidence of accumulated expertise, but only between similar clients, and only when they are treated in very close temporal proximity. These conditions are often not met in clinical practice.</p><p>Indeed, &#8220;outcomes&#8221; in themselves are hard to intuit, and therapists are surprisingly poor at perceiving and predicting them from their subjective judgement alone. This may sound implausible, given therapists&#8217; reputation for attunement, but without tracking outcomes, they often struggle to infer their client&#8217;s trajectory of change.</p><p>In one study, 49 therapists were asked to predict which of their clients (n=550) would deteriorate at the end of treatment (<a href="https://d1wqtxts1xzle7.cloudfront.net/41706576/A_lab_test_and_algorithms_for_identifyin20160128-9285-16ypkk9-libre.pdf?1454037325=&amp;response-content-disposition=inline%3B+filename%3DA_lab_test_and_algorithms_for_identifyin.pdf&amp;Expires=1785779918&amp;Signature=BRbSIQXcrFC0HrpnFlulqip91VWr2UbuFpbjdOI5wwVUg5AuLJU6du8VI8gDshSLd7c0~IkJWKEngpsVZFBAYBP~2lRE5WRTqQxw7u1R9~3T2evQ4Z0u98hzOW~Nzu7xEFp2pHK1e6WI05LoCoqoDNjoFyE6nC1ALeNpmsjfTWr4QFYtIodRzi~Gd1iQiGiNKAcjfzP8TVQv92z1VSAf5s75uXZ5OndqgnRfhQdQWGRBRcSG6mCHHrmvzRiB15xmndJEoaOLmNBKkAwkoE3BsaOSuT1hF249d-yNOLroEoNyZVGdiJhA48aTje1SFQswJPwB9k~4cfrbgLHirdPFfg__&amp;Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA">Hannan et al., 2005</a>). They were told that the deterioration base rate is roughly 8%. The sample predicted that 0.1% of their clients (3/550) would deteriorate, compared with 7.2% (40/550) who did.</p><p>In another study, <a href="https://onlinelibrary.wiley.com/doi/full/10.1002/cpp.70015">&#216;sterg&#229;rd and colleagues</a> (2024), asked therapists to predict, after each session, whether their clients&#8217; CORE-10 score would improve/ deteriorate/ stay the same by the end of therapy. Before making predictions, participants were informed that 5-14% of clients typically deteriorate during treatment. The participants made 1140 predictions, out of which they made only eight (0.7%) predictions of deterioration. All of these were made for clients who actually showed no change. Not a single one of the clients who did deteriorate was predicted to do so. In predicting deterioration, <strong>the therapists performed no better than chance</strong>.</p><p>More remarkable still, after each session, therapists were asked whether they believed their client had improved/ deteriorated/ stayed the same (on the CORE-10) <strong>based on what they had seen during the session. The therapists still performed no better than chance.</strong> Clients showed deterioration in 83/1015 sessions. Therapists identified 6 (7.2%) of these accurately. They misidentified 50 (60.2%) as &#8220;no change&#8221;, and misidentified 27 (32.5%) as improved. A tipsy aardvark with limited psychotherapy training, reclining by a pool, blindfolded by cucumber slices and guessing with his tongue could have performed similarly.</p><p>Without outcome measures, therapeutic change is clearly hard to accurately infer. And if therapists can&#8217;t accurately infer change, how can they adjust suitably in response? Unhelpful adjustments may be reinforced by inaccurate inferences about their effects.</p><p>Notably, these inaccurate inferences are all one way. The studies above demonstrate a systematic overoptimism bias&#8212;an erroneous belief that barely any clients will deteriorate, and indeed that clients have not deteriorated, even when they have.</p><p>Yet despite all these challenges, all this uncertainty, and all the limitations of their intuition, therapists are often very confident about the effects of their interventions.</p><p><strong>The nature of humans</strong></p><p>But what&#8217;s wrong with confidence? Surely confidence reflects the gradual (and hard-earned) accumulation of competence over time? In fact, there is often a mismatch between confidence and competence. In therapy, as in medicine and driving and knowledge of firearms (<a href="https://journals.sagepub.com/doi/abs/10.1111/1467-8721.01235">Dunning et al., 2003</a>), people exhibit a tendency to overestimate their performance. Donald Trump is a very confident man. The most confident.</p><p>Therapists, similarly to other humans, exhibit a strong bias towards overrating their effectiveness. <a href="https://clinica.ispa.pt/sites/default/files/7_-_an_investigation_of_self-assessment_bias_in_mental_health_providers.pdf">Walfish and colleagues</a> (2012) asked a sample of American therapists to rate their performance relative to other clinicians. <strong>Every single therapist rated themselves above average.</strong> On average, the therapists rated themselves in the top 20%. Only 8.4% of the sample rated themselves below the top 25%.</p><p>A similar study with a British sample found similar, albeit more moderate distortions, with therapists rating themselves, on average, in the top 35% (<a href="https://eprints.whiterose.ac.uk/id/eprint/89328/3/Self-assessment.pdf">Parker et al., 2015</a>). In a study that compared therapist self-ratings of a session recording with the ratings of an independent rater, <a href="https://www.cambridge.org/core/journals/behavioural-and-cognitive-psychotherapy/article/abs/selfevaluation-of-cognitive-therapy-performance-do-therapists-know-how-competent-they-are/58AB17DE3AE9889109E37C0A4374F73F">Brosan and colleagues</a> (2008) found that the <strong>the less competent therapists were more prone to overestimate their abilities.</strong></p><p>Given this tendency of humans, and of therapists, to overestimate our competence, it is important to get independent feedback on one&#8217;s performance. However, this is exactly what therapists stop doing post-qualification. For example, 80.5% of a sample (n=72) of UK clinical and counselling psychologists said they rely exclusively on self-report during supervision (<a href="https://ejcop.scholasticahq.com/article/22014-supervision-of-a-sample-of-clinical-and-counselling-psychologists-in-the-uk-a-descriptive-study-of-their-practices-processes-and-perceived-benefits">Nicholas &amp; Goodyear, 2021</a>), meaning no video or audio recordings played, meaning no direct feedback on their actual performance as therapists.</p><p>This is a huge missed opportunity, because direct feedback on one&#8217;s actual performance offers a possible pathway to improvement. Worse still, the absence of direct feedback may create the conditions in which performance can deteriorate over time. Given the pervasiveness of overconfidence and overoptimism biases, this is likely to occur beyond the limits of one&#8217;s awareness.</p><p>This overconfidence matters. <a href="https://drive.google.com/file/d/1Sp61MlNlZ-DHFZSEnpLC1Z96wAa0flyC/view">Constantino and colleagues</a> (2023), found that overestimation of one&#8217;s competence is associated with worse outcomes for one&#8217;s clients. Conversely, a more accurate self-evaluation, or an underestimation of one&#8217;s competence, was associated with better outcomes. Some research suggests professional self-doubt may be conducive to better patient outcomes in some domains (e.g. <a href="https://www.tandfonline.com/doi/abs/10.1080/10503307.2012.735775">Nissen-Lie et al., 2013</a>), although findings have been mixed (e.g. <a href="https://www.tandfonline.com/doi/full/10.1080/10503307.2025.2506650">Jacobsen et al., 2026</a>).</p><p>The longer therapists have been qualified, the better they rate themselves relative to other therapists (<a href="https://eprints.whiterose.ac.uk/id/eprint/89328/3/Self-assessment.pdf">Parker et al., 2015</a>). This would make sense if therapist outcomes improved with experience. <a href="https://www.non-standarddeviations.com/p/therapists-do-not-improve-with-experience">But they don&#8217;t</a>. As such, it could be hypothesised from this that therapists&#8217; increasingly <em>overrate</em> themselves relative to others as they gain more experience.</p><p>Very few longitudinal studies have looked at the relationship between experience and self-evaluation. <a href="https://onlinelibrary.wiley.com/doi/full/10.1002/jclp.23590">Gonsalvez and colleagues</a> (2023) examined the difference between trainee clinical psychologists&#8217; self-evaluation of their performance, and their supervisors&#8217; evaluations at three points in the training journey. Initially, trainees substantially underestimated their performance relative to their supervisors&#8217; evaluations. However, this discrepancy diminished at the second stage and reversed into an overestimation at the final stage, just before graduation. Would this shift towards overestimating one&#8217;s clinical skills continue to become more pronounced post-qualification? Given studies that have recruited qualified therapists show substantial overestimation of skills, this seems possible.</p><p><strong>The nature of therapists and drifty drift</strong></p><p>One possible link between experience, confidence and gradually deteriorating outcomes is &#8220;therapist drift&#8221;.</p><p>This is the tendency to drift away from the evidence based practices one was trained in. It is a phenomenon that has been noted across multiple contexts and modalities (e.g. <a href="https://www.sciencedirect.com/science/article/pii/S0190740912003660">Borntrager et al., 2013</a>; <a href="https://opus.lib.uts.edu.au/bitstream/10453/162150/3/Correlates%20of%20therapist%20drift%20in%20psychological%20practice%20A%20systematic%20review%20of%20therapist%20characteristics.pdf">Speers et al., 2022</a>). There has been debate about how to define drift. One simple definition characterises it as deviation from evidence based <em>protocols</em>. However, research increasingly suggests that personalisation of treatment improves outcomes (e.g. <a href="https://pubmed.ncbi.nlm.nih.gov/37166831/">Nye et al., 2023</a>). As such, this narrow definition of drift has been reframed by some authors as a reflection of &#8220;good clinical judgment and a commitment to personalized patient care&#8221; (<a href="https://link.springer.com/article/10.1007/s10879-024-09638-6">Yonatan-Leus &amp; Tishby, 2025</a>). But therapy can be personalised and remain evidence based (e.g. <a href="https://journals.sagepub.com/doi/full/10.1177/20438087231152848">Moskow et al., 2023</a>).</p><p>As such, I&#8217;m going to refer here to &#8220;drifty drift&#8221;, which I&#8217;ll define as deviation from evidence-based <em>principles</em>, not <em>protocols</em>. Examples of &#8220;drifty drift&#8221; would be a psychodynamic psychotherapist avoiding the exploration of transference patterns, or a CBT therapist not implementing exposure for anxiety-related problems, due to beliefs that it will be uncomfortable for clients (<a href="https://www.tandfonline.com/doi/abs/10.1080/16506073.2025.2518424">Scheveneels et al., 2025</a>), or that one can simply rely on intuition to come up with something better (<a href="https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1365-2753.2010.01508.x">Gaudiano et al., 2011</a>).</p><p>There is some, albeit limited, evidence that therapist experience is linked with drift (<a href="https://opus.lib.uts.edu.au/bitstream/10453/162150/3/Correlates%20of%20therapist%20drift%20in%20psychological%20practice%20A%20systematic%20review%20of%20therapist%20characteristics.pdf">Speers et al., 2022</a>). For example, the recency of one&#8217;s degree was associated with greater use of evidence-based treatment in youth mental healthcare in the US (<a href="https://pmc.ncbi.nlm.nih.gov/articles/PMC7357714/pdf/nihms-1604057.pdf">Cho et al., 2019</a>), and across a range of psychologists in Australia (<a href="https://aps.onlinelibrary.wiley.com/doi/abs/10.1111/ap.12342">Hamill &amp; Wiener, 2018</a>). <a href="https://psycnet.apa.org/record/2011-28275-001">Waller and colleagues</a> (2012) found that older, and more experienced therapists were less adherent to evidence based practice in CBT for eating disorders. A meta-analysis found that older therapists are less likely to utilise exposure therapy (<a href="https://www.tandfonline.com/doi/abs/10.1080/16506073.2023.2191824">Langthorne et al., 2023</a>). The authors hypothesised that this could be related to older therapists being more confident and more reliant on clinical judgement than on the evidence base.</p><p>Several studies have suggested that experienced therapists are slower to learn new approaches. For example, <a href="https://link.springer.com/article/10.1007/s10488-013-0529-x">Beidas and colleagues</a> (2014) found that more experienced clinicians showed poorer fidelity to CBT for youth anxiety after training in the approach. Years of experience (and age) have also been associated with requiring extra training to reach necessary standards in motivational interviewing (<a href="https://www.sciencedirect.com/science/article/pii/S0740547211000055">Martino et al., 2011</a>).</p><p>But a link between greater experience and slower learning of new approaches does not necessarily explain why therapists don&#8217;t improve with experience. An experienced therapist could, in theory, continue to improve in their original modality, even if it takes them longer to learn new approaches.</p><p>Another possibility is that, as time elapses after one&#8217;s training, knowledge fades. This is borne out by a study that found experienced therapists (10 years of clinical experience or more) performed significantly worse than trainees on tests of knowledge, case conceptualisation and treatment planning (<a href="https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2013.00141/full">Vollmer et al., 2013</a>).</p><p>Taking this a step further, is it possible that, as one undertakes more CPD, and picks up new models throughout one&#8217;s career, this new knowledge inhibits the retrieval of the old knowledge and training. For example, could it be that my head is so full of recent CFT and DBT and EFT and CAT trainings that it does not consistently and comprehensively, across treatment, retrieve and deploy exposure, for example, in its full and glorious simplicity? Maybe I can&#8217;t see the wood for all the -Ts. Maybe I am so intent on making my garden look great that I spend all my time and effort accumulating fancy new gnomes at the expense of attending to the plants that made it a garden in the first place.</p><p><strong>Conclusion</strong></p><p>Improving therapeutic outcomes is hard. Therapists who wish to do so face many challenges. To summarise&#8230;</p><p>It is difficult to infer outcomes. In the absence of measures, therapists are overoptimistic about change, both prospectively and retrospectively. They tend to be overconfident about their effectiveness, and this overconfidence potentially grows with experience. Overconfidence can lead to drifty drifting away from evidence based principles, towards watered down, less effective interventions. These issues can gradually erode therapist performance over time. But this doesn&#8217;t have to be the case.</p><p>Although much remains to be understood about why therapists don&#8217;t improve with experience, much is already understood about how they <em>can</em> improve with experience. That will be the topic of the next post.</p><p>Did I miss anything?? Share your thoughts in the comments!</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.non-standarddeviations.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Non-Standard Deviations! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Therapists do not improve with experience alone.]]></title><description><![CDATA[On average, they stagnate or deteriorate. This is a curious phenomenon and we need to understand it. Here is part one of  a three part series.]]></description><link>https://www.non-standarddeviations.com/p/therapists-do-not-improve-with-experience</link><guid isPermaLink="false">https://www.non-standarddeviations.com/p/therapists-do-not-improve-with-experience</guid><dc:creator><![CDATA[Joel Lewin]]></dc:creator><pubDate>Fri, 07 Aug 2026 22:33:00 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/85637bc2-fded-4fe5-957c-659d254f7828_2816x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>&#8220;Experienced therapist.&#8221; It has a certain ring to it. A certain appeal. Almost certainly more appeal than &#8220;inexperienced trainee therapist&#8221;, if you&#8217;re in the market for help. But maybe it shouldn&#8217;t. Why? Because therapists are not fine wines that mature over time. They are not hard cheeses. They are not cast iron skillets seasoned by use.</span></p><p><span>Therapists, in their developmental trajectories, are, on average, more like countryside cottages. The roses climb the walls and bloom. The fancy garden gnomes proliferate. So quaint. So appealing. So cottagey. Yet all the while the plaster cracks and the window frames warp and the damp creeps in and there is a gradual (so gradual as to be barely perceptible but it&#8217;s there nonetheless) decline in its performance of the primary functions of a house. But there are so many gnomes&#8230;.</span></p><p><span>Research suggests that therapists, on average, do not improve with experience and time, and those with more experience do not perform better than those with less.</span></p><p><span>When I first came across this, I was astonished. I clutched my head in my hands and I rubbed my eyes and I asked: how the hell does experience not lead to better outcomes?</span></p><p><span>I had always assumed the relationship was positive and mostly linear, with returns diminishing only gradually over time. I had some kind of innate faith in the ability of human beings to learn from experience simply by having that experience. Every experienced therapist I met sounded so good, and so much better than me. They had so many gnomes in their garden. I had assumed that if I kept practicing (as in doing therapy), I would inevitably keep improving. But therapeutic experience does not necessarily bring improvement, and in many cases it coincides with deterioration.</span></p><p><span>These findings are so important, because they lay the foundations for understanding how therapist outcomes can deteriorate with accumulated experience, and what can be done to help experience contribute to improvement instead.</span></p><p><span>In this post, I&#8217;ll lay out the research that examines the relationship between experience and outcomes. In the next one, I&#8217;ll outline some of the possible reasons why experience can be associated with a deterioration in outcomes. In the third post, I&#8217;ll explore some of the things that might help to translate experience into better outcomes.</span></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.non-standarddeviations.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.non-standarddeviations.com/subscribe?"><span>Subscribe now</span></a></p><p></p><p><span>The effect of therapist experience has long been of interest to researchers. In 1955, </span><a href="https://onlinelibrary.wiley.com/doi/10.1002/1097-4679(195501)11:1%3C51::AID-JCLP2270110112%3E3.0.CO;2-0"><span>Myers and Auld</span></a><span> conducted a study examining the psychotherapy outcomes of patients in a psychiatric outpatient clinic, who saw either a resident psychiatrist (less experienced) or a staff psychiatrist (more experienced). The study has tremendous limitations, to the extent the results are barely worth interpreting, but they will be interpreted anyway. The limitations in themselves are quite interesting, and underscore just how far psychotherapy research has come.</span></p><p><span>This was seemingly before the days of outcome measures, or any attempt to measure outcomes with a veneer of objectivity. Instead, outcomes were determined by looking through therapy notes and inferring an outcome, then categorising it as patient quit/ patient unimproved/ patient improved/ therapy continued elsewhere. For example, the following therapy note was categorised as &#8220;patient unimproved&#8221;: &#8220;In view of the very difficult circumstances in which the patient lives, it seemed that psychotherapy would not have much chance.&#8221; The next note earned a &#8220;patient improved&#8221; label: &#8220;I feel she can handle her problems with considerably more freedom than when she came. She seems to have benefited from therapy.&#8221;</span></p><p><span>In this sample of 39 case outcomes across 12 therapists, the authors inferred that the more experienced staff psychiatrists had &#8220;more successful terminations and fewer failures than the residents&#8221;, suggesting more experienced clinicians attained better outcomes.</span></p><p><span>However, the authors note, &#8220;the differences in the manner of termination between the senior staff and residents may be due to different conceptions of improvement based on differential experience and training&#8221;. So there is no sense of a common definition of improvement. Perhaps the more experienced therapists defined improvement more liberally.</span></p><p><span>The authors offer this beautifully candid caveat:</span></p><blockquote><p><span>&#8220;</span><strong><span>We did not make any check on the reliability of our classifications, since it would give a  spurious impression of objectivity</span></strong><span> to study reliability of classification when we have no way of testing the reliability of the raw record.&#8221;</span></p></blockquote><p><span>I glimpse a flash of red in my garden. I classify it as an orchid, but I don&#8217;t look again to double check, because there is </span><em><span>absolutely no way</span></em><span> of testing whether I might have actually seen a poppy or a dahlia or a ready salted crisp packet pulled from a bin bag by a fox.</span></p><p><span>There was also something strange going on with case allocation in this service. It seems to be the polar opposite of every service I have ever worked in. In my experience, more senior clinicians take on the seemingly more &#8220;challenging&#8221; cases, and trainees are allocated seemingly less &#8220;complex&#8221; cases.</span></p><p><span>But in this study, the authors write:</span></p><blockquote><p><span>&#8220;There may also be differences between senior staff and residents in the selection of cases. For instance,</span><strong><span> it is possible that the senior staff on the basis of clinical experience select cases more likely to be successful and leave the &#8220;poor&#8221; cases for the residents</span></strong><span>&#8221;.</span></p></blockquote><p><span>What a place to train.</span></p><p><span>As the topic garnered more attention, and was approached with methodologies that offer some impression of objectivity, spurious or not, findings began to coalesce around an absence of improvement with experience.</span></p><p><a href="https://www.researchgate.net/publication/228748883_Preliminary_Evidence_on_the_Effectiveness_of_Psychological_Treatments_Delivered_at_a_University_Counseling_Center"><span>Minami and colleagues</span></a><span> (2009) examined eight years worth of outcome data (measured on the Outcome Questionnaire-45; OQ-45) from a university counselling service. They included data from 2,672 service users seen by 148 different therapists of various orientations, including psychodynamic, cognitive behavioural, interpersonal, humanistic, existential, feminist, and multicultural. These therapists spanned a range of training and qualification levels, which the researchers grouped into &#8220;staff&#8221; (clinicians who have completed graduate training), &#8220;interns&#8221; (predoctoral psychology interns or masters of social work/ counselling interns) and &#8220;other trainees&#8221; (doctoral practicum students on their first clinical placement). The most qualified clinicians (staff) showed inferior effect sizes (</span><em><span>d</span></em><span> = 0.131 per session</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span>) compared with the interns (</span><em><span>d</span></em><span> = 0.208 per session) and other trainees (</span><em><span>d</span></em><span> = 0.218 per session).</span></p><p><span>However, assignment was not random. The most complex cases were assigned to staff clinicians, so it is reasonable to hypothesise that at least some of the disparity is accounted for by this imbalance.</span></p><p><span>However, a similar study by </span><a href="https://psycnet.apa.org/record/2012-27634-001"><span>Budge and colleagues</span></a><span> (2013) with 1318 patients seen by 64 therapists (modality not specified) found similar results even after controlling for clients&#8217; pre-therapy functioning. The interns/post docs achieved more significant change in terms of life functioning and symptom reduction compared with qualified psychologists, measured with the Behavioral Health Measure. In terms of the well-being subscale, there was no significant difference. </span><strong><span>Trainees achieved similar, or better outcomes, than qualified psychologists.</span></strong></p><p><span>A smaller study (282 patients seen by 34 therapists) conducted in a specialist, CBT-focused anxiety disorders service found no overall difference in outcomes between trainees and qualified therapists (</span><a href="https://www.researchgate.net/publication/272517924_My_Therapist_is_a_Student_The_Impact_of_Therapist_Experience_and_Client_Severity_on_Cognitive_Behavioural_Therapy_Outcomes_for_People_with_Anxiety_Disorders"><span>Mason et al., 2015</span></a><span>), although there was an interaction such that qualified therapists attained significantly better outcomes with more severely anxious patients. Notably, the trainees utilised 2.3 fewer sessions than qualified therapists (10.3 vs 12.6). Both Mason and Budge suggested that the level of supervision received by trainees may have contributed to their favourable outcomes. Mason and colleagues (2015) also highlight the freshness of trainees&#8217; theoretical knowledge.</span></p><p><span>When I was in training, I used to dread asking service users if they would be willing to work with a trainee. I felt like I was asking them if they would accept an inferior service.</span></p><p><span>But I was always pleasantly surprised (and relieved) by how many people agreed to see a trainee. I don&#8217;t recall anyone declining. I wondered whether I would have been so willing to work with a trainee myself. But it seems the service users were wiser than I was. These studies suggest that it would sometimes perhaps make sense to request a trainee instead of a qualified clinician.</span></p><p><span>Another study found that greater therapist experience (measured as years working in a specialist mental health service) was associated with reduced recovery odds, and less symptom improvement in anxious youth (</span><a href="https://onlinelibrary.wiley.com/doi/abs/10.1002/cpp.2321"><span>Fauskanger Bjaastad et al., 2018</span></a><span>).</span></p><p><span>However, a limitation of the studies described so far is their cross-sectional nature. The therapists grouped together could differ on other variables. They could have substantially different levels of prior experience, for example. Later studies have rectified these limitations with longitudinal designs, in which changes in outcomes can be examined within individual therapists as their experience increases, or as they move through successive stages of training.</span></p><p><a href="https://psycnet.apa.org/record/2015-58774-001"><span>Goldberg, Rousmaniere and colleagues</span></a><span> (</span><a href="https://clinica.ispa.pt/sites/default/files/52._do_psychotherapists_improve_with_time_and_experience_0.pdf"><span>2016</span></a><span>) analysed data from 6591 service users seen by 170 therapists (mostly integrated/ eclectic). On average, a therapist&#8217;s data spanned 4.73 years. They found that therapist outcomes (on the OQ-45) deteriorated as experience (measured as chronological time or as number of cases) increased. The effects remained even when controlling for a range of therapist, patient and caseload variables. For each additional year of practice, on average, a therapist&#8217;s effect size would drop by </span><em><span>d</span></em><span> = 0.012. That is a very small effect, and would amount to, each year, one fewer successful outcome out of 148 patients seen. Yet, over a large population of therapists, that starts to rack up. There was notable variation between therapists. 39.41% of therapists&#8217; outcomes improved over time, while 60.59% deteriorated. This heterogeneity is substantial at the extremes. Some therapists showed dramatic improvement, and some showed mindboggling deterioration. Understanding what causes these differences is crucial, and will be the topic of the next two posts.</span></p><p><a href="https://psycnet.apa.org/record/2022-41007-001"><span>Germer and colleagues </span></a><span>(2022) replicated this study in the German healthcare system, and found no significant relationship between therapist experience and therapy outcomes.</span></p><p><a href="https://psycnet.apa.org/record/2017-46640-006"><span>Erekson and colleagues</span></a><span> (2017) conducted a study with similar longitudinal, within-therapist analyses, but focused on change in outcomes as therapists progressed through different stages of training. They found that the amount, and the rate of change therapists were able to achieve either stayed the same (when both stage of training and cumulative number of cases were included in the model), or deteriorated (when only one of the variables was included).</span></p><p><span>The authors wrote: &#8220;Findings suggest that as therapists progress through formal stages of training, they do not improve in their ability to effect change in their clients.&#8221;</span></p><p><span>They add:</span></p><blockquote><p><span>&#8220;Although this and other studies have implications for experience in general, our study provides persuasive evidence that completion of training over time does not imply improved client outcomes for individual therapists. </span><strong><span>This indicates a potentially radical implication of these study results&#8212;that existing structures for training psychologists, including formal graduate training, internship, postdoctoral appointments, and licensure, do not appear to be connected to improvement in client outcomes or therapy efficiency</span></strong><span>.&#8221;</span></p></blockquote><p><span>In another longitudinal study, </span><a href="https://psycnet.apa.org/record/2025-22478-001"><span>Coleman and colleagues</span></a><span> (2024) looked at outcomes for 42,690 service users seen by 613 therapists across 12 years. The study broke outcomes down into four domains: general distress, life functioning, anxiety and alcohol/ drug use. Therapist outcomes deteriorated across time in terms of general distress, life functioning and anxiety. There was no significant change in terms of alcohol/ drug use outcomes.</span></p><p><span>Taken together, these studies present a rather curious picture. Therapists, seemingly, do not improve with experience, and do not even improve with the completion of their training. </span><strong><span>On average</span></strong><span>, at a certain point in their training, therapists hit a peak which they don&#8217;t progress beyond.</span></p><p><span>However, there are two notable exceptions in the literature (this does not include Myers and Auld and their honorable decision not to &#8220;give a spurious impression of objectivity&#8221;). Two merciful exceptions that offer an escape from the kind of bleak picture built up so far. These studies created very specific service contexts geared towards therapist improvement. I&#8217;ll talk about them more in part three. But I&#8217;ll tell you now&#8211;there are no gnomes involved.</span></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>Cohen&#8217;s d effect sizes are described as small (d = 0.2), medium (d = 0.5), and large (d &#8805; 0.8)</p></div></div>]]></content:encoded></item></channel></rss>