{"id":35722,"date":"2025-09-16T10:12:55","date_gmt":"2025-09-16T10:12:55","guid":{"rendered":"https:\/\/financialrush.com\/?p=35722"},"modified":"2025-09-16T10:12:55","modified_gmt":"2025-09-16T10:12:55","slug":"debunking-the-persistence-scorecard-debunking","status":"publish","type":"post","link":"https:\/\/financialrush.com\/?p=35722","title":{"rendered":"Debunking the \u2018Persistence Scorecard\u2019 debunking"},"content":{"rendered":"<p> \n<\/p>\n<div id=\"article-body\">\n<p>Back in 1960, the <em>Financial Analyst Journal<\/em> ran a <a href=\"https:\/\/d1e00ek4ebabms.cloudfront.net\/production\/uploaded-files\/faj.v16.n3.33-120d4c3c-c53f-4ed8-a5b3-1a3deb677d4a.pdf\" data-trackable=\"link\">paper<\/a> by a financier called John B. Armstrong lambasting research that implied most fund managers did a bad job, and mocking the suggestion that simply buying the whole stock market might be better.<\/p>\n<p>To do so, <em>The Case for Mutual Fund Management<\/em> examined the results of the four biggest equity mutual funds in America \u2014 showing how they had easily beaten the Dow Jones Industrial Average between 1930 and 1959 \u2014 and concluded: <\/p>\n<blockquote class=\"n-content-blockquote o3-editorial-typography-blockquote\">\n<p>It is clear that even the most assiduous analysis of yesterday\u2019s figures cannot foretell what tomorrow may bring \u2014 whether the problem is selecting a mutual fund or an individual investment, or forecasting the action of the stock market, or indeed of predicting any event dependent upon the human element. However, the Financial Analyst \u2014 and the mutual fund shareholder \u2014 can gain confidence from the fact that mutual funds in general have met the test of time, and performed in keeping with their stated policies and goals.<\/p>\n<\/blockquote>\n<p>As it turned out, John B. Armstrong was a pseudonym for Jack Bogle, then the president of Wellington, one of the oldest and biggest US mutual fund groups. And as you probably know, Bogle would go on to found Vanguard, the <a href=\"https:\/\/www.ft.com\/passive-investing\" data-trackable=\"link\">passive investing<\/a> behemoth. <\/p>\n<p>In fact, when he was arguing with Vanguard\u2019s board to let him set up the group\u2019s very first index fund \u2014 today\u2019s $1.3tn <a href=\"https:\/\/investor.vanguard.com\/investment-products\/mutual-funds\/profile\/vfiax#portfolio-composition\" data-trackable=\"link\">Vanguard 500 <\/a>\u2014 Bogle basically redid the exact same mathematical work as he had done under his Armstrong pen name. But this time he didn\u2019t cherry-pick the data and the benchmark, and came up with very different results. As Bogle recalled in his autobiography:<\/p>\n<blockquote class=\"n-content-blockquote o3-editorial-typography-blockquote\">\n<p>The average annual return of the S&amp;P 500 Index was 11.3% versus 9.7% for the average equity fund, an annual advantage of 1.6 percentage points per year for indexing. Here was hard statistical evidence \u2014 \u201cbrute evidence,\u201d if you will \u2014 of the superiority of the returns of the passive index over active funds.<\/p>\n<\/blockquote>\n<figure class=\"n-content-image n-content-image--full\" data-component=\"image-set\"><picture><source media=\"(min-width: 700px)\" srcset=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/ftcms%3Ac04dbbf6-1d43-4d23-9ae6-6336a6fa4227?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1 1x\" width=\"967\" height=\"586\"\/><\/picture><\/figure>\n<p>This anecdote came to mind when reading a <a href=\"https:\/\/www.investmentadviser.org\/amc\/persistence-scorecard-doesnt-predict-investor-success-2\/\" data-trackable=\"link\">recent (ish) report <\/a>by the investment Adviser Association on why S&amp;P Dow Jones Indices\u2019 so-called Persistence Scorecard deserved \u201cshort thrift\u201d (<a href=\"https:\/\/www.linkedin.com\/posts\/alex-matturri-cfa-07b2828_persistence-scorecard-doesnt-predict-investor-activity-7371617170625077248-CR71\/?rcm=ACoAAAShISUBd2tZUTMC6K9zSfN6-EnIyv7CHV4\" data-trackable=\"link\">HT former S&amp;PDJI CEO Alex Matturri<\/a>):<\/p>\n<blockquote class=\"n-content-blockquote o3-editorial-typography-blockquote\">\n<p>It\u2019s time to stop and ask a fundamental question: does the Persistence Scorecard add value for investors?<\/p>\n<p>The answer is \u201cno.\u201d<\/p>\n<\/blockquote>\n<p>What is this Persistence Scorecard? It\u2019s an annual report compiled by S&amp;P Dow Jones Indices \u2014 one of the financial benchmarking world\u2019s \u201cBig Three\u201d alongside FTSE Russell and MSCI \u2014 and less well known cousin of the index company\u2019s active-vs-passive <a href=\"https:\/\/www.spglobal.com\/spdji\/en\/education\/article\/spiva-scorecards-an-overview\/\" data-trackable=\"link\">SPIVA Scorecard<\/a>. <\/p>\n<p>While SPIVA regularly measures the proportion of funds that outperform the market in any given year or time period, the Persistence Scorecard tries to measure whether historical outperformance is predictive of future outperformance, by looking at whether funds with top-quartile returns stay there. <\/p>\n<p>The <a href=\"https:\/\/www.spglobal.com\/spdji\/en\/spiva\/article\/us-persistence-scorecard\/\" data-trackable=\"link\">latest report<\/a> indicates that of not a single one of the top-quartile funds as of 2020 remains in the top quartile by the end of 2024. Even random chance would suggest that at least one would, but no.<\/p>\n<p>However, the IAA is unhappy with S&amp;P DJI\u2019s methodology because \u201clong-term performance matters, not short-term persistence\u201d:<\/p>\n<blockquote class=\"n-content-blockquote o3-editorial-typography-blockquote\">\n<p>The funds with the best returns over the long term almost all experience shorter periods of underperformance.<\/p>\n<p>To illustrate, we looked at the performance of the 170+ actively managed large-cap blend funds (both open-end and exchange-traded) with 20-year track records as of the end of July 2025. We used the lowest-cost share class to develop this list. We then zeroed in on the 25 funds with the <em>best <\/em>performance history.<\/p>\n<p>These 25 funds have done a great job for shareholders. An investor putting $1,000 into these funds 20 years ago would have somewhat over $8,500 in their account after holding them for 20 years, an annual return of 11.3%. By contrast, investors in the S&amp;P 500 would have earned only 10.7% per year, ending up with over $7,500 after 20 years.<\/p>\n<p>However, while these funds generated outstanding results over the long haul, results varied quite a bit over the short term. In fact, these funds were almost as likely to underperform as they were to outperform; on average, they trailed the S&amp;P 500 in 9 of the 20 years. Even top-ranked funds have periods at the bottom.<\/p>\n<\/blockquote>\n<p>Look, it\u2019s completely true that investors shouldn\u2019t only invest in fund managers that have never had a down year, or to ditch one just because of a bad spell. That would be mad. If you want to do better than average you by definition have to do something different from everyone else. That can lead to periods where you look like a dunce. <\/p>\n<p><a href=\"https:\/\/www.ft.com\/content\/47b49fd1-48fb-4855-9c34-d32348c6df37\" data-trackable=\"link\">Investors lose out on a lot of returns<\/a> because they constantly churn fund managers that have performed badly in favour of the hot new kid on the block. That old story about the best investors at Fidelity being the dead ones is <a href=\"https:\/\/finance.yahoo.com\/news\/archives-praise-dead-investors-060000235.html\" data-trackable=\"link\">apparently wrong<\/a>, but it persists because it contains the kernel of an important truth: investor hyperactivity does a lot of financial self-harm.<\/p>\n<p>However, the IAA\u2019s work here is a bit silly to begin with, and they then try to build a comically dumb conclusion on top of the resulting truism. <\/p>\n<p>The IAA\u2019s methodology is a bit like selecting the 25 highest-scoring strikers in the world today, noticing that they don\u2019t score in <em>every<\/em> game and triumphantly declaring that you should you never lose faith in your own club\u2019s misfiring striker, even if you don\u2019t actually know whether he\u2019s a future star or donkey.<\/p>\n<p>The point of the Persistence Scorecard is simply to try to differentiate skill from luck, and to warn investors against relying too much on past performance. A fund manager can get lucky for a year or two thanks to just one massive risky bet. Sometimes that turns out to be <a href=\"https:\/\/www.ifa.com\/articles\/impact_geico_benjamin_graham_warren_buffett_luck_gecko\" data-trackable=\"link\">GEICO<\/a>, and other times that\u2019s <a href=\"https:\/\/finbox.com\/blog\/the-rise-and-fall-of-bruce-berkowitz-fairholme-capital\/\" data-trackable=\"link\">Sears<\/a>.<\/p>\n<p>The IAA says that \u201cactively managed funds don\u2019t need year after year outperformance to generate long-term value for investors\u201d. Which is completely true, but beside the point. Because\u2009.\u2009.\u2009.\u2009<\/p>\n<figure class=\"n-content-image n-content-image--inline\" style=\"width:350px;max-width:100%\" data-component=\"image-set\"><picture><source media=\"(min-width: 700px)\" srcset=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/ftcms%3A4de915b5-6d4c-4c00-ab95-e442d37a8f4e?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=350&amp;dpr=1 1x\" width=\"500\" height=\"504\"\/><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/https%3A%2F%2Fd1e00ek4ebabms.cloudfront.net%2Fproduction%2F4de915b5-6d4c-4c00-ab95-e442d37a8f4e.png?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1\" alt=\"\" data-image-type=\"image\" width=\"500\" height=\"504\" loading=\"lazy\"\/><\/picture><\/figure>\n<p>Even the 25 best-performing funds selected by the IAA to make its point only managed to beat the S&amp;P 500 by 60 basis points a year over the past 20 years! Sure, that can add up over two decades, but really isn\u2019t much to brag about.<\/p>\n<p>Moreover, these were selected from the roughly 170 large-cap US equity funds that have a record of at least 20 years. This is already a pretty self-selecting pool of success stories, as roughly two-thirds of all US investment funds that existed 20 years ago have folded since then. We\u2019re not even told whether the IAA data is asset weighted, to see if its own already weak findings are also skewed by a handful of tiny unrepresentative funds. This is simply blatant data mining. <\/p>\n<p>So what does the average active US equity fund performance look like, once you adjust for the survivorship bias? Well, this may shock you to your very core but\u2009.\u2009.\u2009.\u2009<\/p>\n<figure class=\"n-content-image n-content-image--full\" data-component=\"image-set\"><picture><source media=\"(min-width: 700px)\" srcset=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/ftcms%3Af817996f-f2e0-474d-a054-262baf688dea?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1 1x\" width=\"893\" height=\"730\"\/><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/https%3A%2F%2Fd1e00ek4ebabms.cloudfront.net%2Fproduction%2Ff817996f-f2e0-474d-a054-262baf688dea.png?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1\" alt=\"\" data-image-type=\"image\" width=\"893\" height=\"730\" loading=\"lazy\"\/><\/picture><\/figure>\n<p>This is the latest mid-year SPIVA Scorecard for US fund managers (<a href=\"https:\/\/d1e00ek4ebabms.cloudfront.net\/production\/uploaded-files\/2-89971c89-0265-401e-aa76-d3119b997472.png\" data-trackable=\"link\">zoomable<\/a> version of the image here, and here\u2019s the <a href=\"https:\/\/d1e00ek4ebabms.cloudfront.net\/production\/uploaded-files\/spiva-us-mid-year-2025-bc7a7f61-4b27-48b0-b20a-856cc87521d0.pdf\" data-trackable=\"link\">full report<\/a>). Things aren\u2019t any better in <a href=\"https:\/\/www.spglobal.com\/spdji\/en\/documents\/spiva\/spiva-europe-mid-year-2025.pdf\" data-trackable=\"link\">Europe<\/a> either, in case you were curious, though S&amp;P DJI only does 10-year performance data in the region. <\/p>\n<figure class=\"n-content-image n-content-image--full\" data-component=\"image-set\"><picture><source media=\"(min-width: 700px)\" srcset=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/ftcms%3A1c7f4416-89dc-4972-92ab-a4aa72a0d44d?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1 1x\" width=\"715\" height=\"674\"\/><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/https%3A%2F%2Fd1e00ek4ebabms.cloudfront.net%2Fproduction%2F1c7f4416-89dc-4972-92ab-a4aa72a0d44d.png?source=next-article&amp;fit=scale-down&amp;quality=highest&amp;width=700&amp;dpr=1\" alt=\"\" data-image-type=\"image\" width=\"715\" height=\"674\" loading=\"lazy\"\/><\/picture><\/figure>\n<p>The IAA is narrowly correct in saying that people shouldn\u2019t obsess about the Persistence Scorecard. But no one is. <\/p>\n<p>A quick <a href=\"https:\/\/www.ft.com\/search?q=%22Persistence+Scorecard%22\" data-trackable=\"link\">FT search <\/a>reveals just two mentions since our web archives began. A search of the <a href=\"https:\/\/www.wsj.com\/search?query=%22Persistence+Scorecard%22&amp;dateRange=all&amp;products=wsj%2Cvideo%2Caudio%2Clivecoverage%2Cbuyside&amp;sort=desc\" data-trackable=\"link\">WSJ<\/a> yields all of eight mentions \u2014 and several of them stress that persistence is not actually that important to overall long term returns. Sure, there will be some other <a href=\"https:\/\/www.ft.com\/content\/aa3f3570-e691-49a9-8ccb-17d00749ede2\" data-trackable=\"link\">oblique mentions<\/a> that don\u2019t explicitly mention the \u201cpersistence scorecard\u201d, but this simply isn\u2019t the major report that the IAA pretends.<\/p>\n<p>Alphaville is admittedly committing a similar sin, by spending more words making fun of an anonymous bit of pro-active marketing than the original report contained. But this <a href=\"https:\/\/www.investmentadviser.org\/amc\/persistence-scorecard-doesnt-predict-investor-success-2\/\" data-trackable=\"link\">report<\/a> was just really annoying. <\/p>\n<p>The IAA has done a grossly data mined non-debunking of a little-followed report, and has heavily implied that this somehow strengthens the case for active management as a whole. We\u2019re going to out on a limb and predict that this isn\u2019t going to turn back the passive tide. <\/p>\n<p><strong>Further reading:<\/strong><\/p>\n<p>\u2014 <a href=\"https:\/\/www.ft.com\/content\/aa3f3570-e691-49a9-8ccb-17d00749ede2\" data-trackable=\"link\">Super passive goes ballistic; active is atrocious<\/a> (FTAV)<\/p>\n<p>\u2014<a href=\"https:\/\/www.ft.com\/content\/478c2b99-0727-4594-a90c-745d4915f640\" data-trackable=\"link\"> Once more unto the \u2018active comeback\u2019 breach<\/a> (FTAV)<\/p>\n<p>\u2014 <a href=\"https:\/\/www.ft.com\/content\/3f449299-318c-4c8f-ab7a-bb3fa7221f9c\" data-trackable=\"link\">Buffett\u2019s bet of the century<\/a> (FTAV)<\/p>\n<\/div>\n\n<br \/><a href=\"https:\/\/www.ft.com\/content\/e5bba46f-2a56-4026-9bfa-ee8de719d3e5\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Back in 1960, the Financial Analyst Journal ran a paper by a financier called John B. Armstrong lambasting&hellip;\n","protected":false},"author":5,"featured_media":35723,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23],"tags":[],"class_list":["post-35722","post","type-post","status-publish","format-standard","has-post-thumbnail","category-us","cs-entry","cs-video-wrap"],"_links":{"self":[{"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/posts\/35722","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/financialrush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=35722"}],"version-history":[{"count":0,"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/posts\/35722\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/financialrush.com\/index.php?rest_route=\/wp\/v2\/media\/35723"}],"wp:attachment":[{"href":"https:\/\/financialrush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=35722"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/financialrush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=35722"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/financialrush.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=35722"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}