{"id":5697,"date":"2022-01-31T19:21:26","date_gmt":"2022-02-01T00:21:26","guid":{"rendered":"https:\/\/prichard-backup.com\/July\/2022\/01\/31\/tennessee-preschool-results-some-puzzling\/"},"modified":"2022-12-06T11:36:27","modified_gmt":"2022-12-06T16:36:27","slug":"tennessee-preschool-results-some-puzzling","status":"publish","type":"post","link":"https:\/\/prichard-backup.com\/July\/tennessee-preschool-results-some-puzzling\/","title":{"rendered":"Tennessee Preschool Results: Some Puzzling"},"content":{"rendered":"<p>[vc_row][vc_column][vc_empty_space][vc_column_text]In a newly-published study, children admitted to the Tennessee state-funded preschool program by lottery did less well than those who were not admitted, based on data for sixth grade:<\/p>\n<ul>\n<li>assessments results<\/li>\n<li>disciplinary infractions<\/li>\n<li>attendance<\/li>\n<li>identification for special education services (excluding those for physical disabilities)<\/li>\n<\/ul>\n<p>This is not what we expect to see. The studies of <a href=\"https:\/\/highscope.org\/perry-preschool-project\/\">Perry Preschool<\/a>\u00a0and the <a href=\"https:\/\/abc.fpg.unc.edu\/abecedarian-project\">Abcedarian project<\/a>\u00a0show that high quality early childhood programs have positive lifetime impacts. Similarly, Professor <a href=\"https:\/\/heckmanequation.org\">James Heckman\u2019s work<\/a> offers a compelling demonstration of \u201cthe great gains to be had by investing in the early and equal development of human potential.\u201d So why is this data from Tennessee showing something so different? This post will wrestle with that question.<\/p>\n<p>The research report from Kelley Durkin, Mark Lipsey, Dale Farran, and Sarah Wiesen (all based at Vanderbilt) is available from <em>Developmental Psychology<\/em>, a peer-reviewed academic journal published by the American Psychological Association. This work continues 2018 analysis of preschool impacts through grade 3, adding evidence through grade 6. The journal article is <a href=\"https:\/\/doi.apa.org\/doiLanding?doi=10.1037%2Fdev0001301\">available here (paywall)<\/a> and analyzed in thi<a href=\"https:\/\/hechingerreport.org\/a-state-funded-pre-k-program-led-to-significantly-negative-effects-for-kids-in-tennessee\/?s=09\">s Hechinger reporting.<\/a><\/p>\n<p>The study design is careful enough to deserve attention. While no research design is perfect, this one has at least moderately careful controls. The students being compared are all from low-income families and all from families that applied to be in the preschool program. Getting admitted was a lottery-decision, not a matter of doing a better job of applying or pressing the system for an opportunity. Similarly, this study looked at most of the evidence Kentucky considers in school report cards. In addition to data on assessments, discipline, attendance, and disability identification, the study considered retention in grade and found no significant differences between groups for that outcome. Someday it could be great to have data on participants\u2019 later education, careers, health family life, and other indicators of their flourishing, but these learners have not yet finished high school.<\/p>\n<p>So again, what\u2019s happening? Here are some thoughts on what to explore.<\/p>\n<p>First, what\u2019s happening on easily measured indicators of quality, like group size and teacher qualifications and pay? The authors cite some evidence on that, writing:<\/p>\n<blockquote><p>As we report, the statewide scale up of TN-VPK began in 2005 after nearly 10 years of pilot testing and met nine of the 10 NIEER benchmarks (Barnett et al., 2009). A recent review of statewide programs by the NIEER group (Friedman-Krauss et al., 2019) praised the program in Tennessee for being among those in 27 states that paid its pre-K teachers at parity with elementary teachers, one of only 26 states to offer pre-K teachers retirement benefits, health care and paid time off, and one of only 25 to require its teachers to have a bachelor&#8217;s degree plus certification. Among state-funded pre-K programs, the TN program is above average and arguably in the top tier on characteristics many believe mark high quality (Sharpe et al., 2017).<\/p><\/blockquote>\n<p>That suggests that the simpler forms of evidence may not be good clues to the problem.<\/p>\n<p>Next, what\u2019s happening on deeper, harder-to-track indicators of quality, like the activities students are offered and the ways they interact with teachers? On those richer features, the Prichard Committee\u2019s <a href=\"https:\/\/prichard-backup.com\/July\/wp-content\/uploads\/2016\/01\/ECE-Study-Group-Report-2015.pdf\">Early Childhood Education Study Group<\/a> offered a powerful vision of what we should hope to see in preschool and related programs:<\/p>\n<blockquote><p>All Kentucky children, birth to age 8, will have intellectually engaging, imaginative, and culturally responsive learning experiences that extend their curiosity and support social and emotional health and well-being. Developmentally appropriate early childhood experiences will immerse children in hands-on inquiry, sensory- and language-rich environments that support their potential to be creative and critical thinkers. As a result, all children will be well prepared for success in kindergarten and proficient in math and reading by the end of third grade.<\/p><\/blockquote>\n<p>What if Tennessee preschools aren&#8217;t consistently providing that caliber of experience? What if those programs are far enough from those strengths that participants ended up with a weaker start than those who spent their days another way?<\/p>\n<p>The authors of the study raise the possibility that preschools could be focusing intently on what the authors call \u201cconstrained skills\u201d which are \u201cdirectly teachable skills in a finite domain (e.g., 26 letters of the alphabet)\u201d where there\u2019s a ceiling or maximum to what learners can learn and 100% mastery is possible. Those skills are easy to measure and are valued on commonly-used assessments. \u00a0It really is possible to imagine programs deciding to put extra emphasis on those skills and insufficient focus on other capacities. The authors cite research indicating that students\u2019 long-term success may depend more on \u201cunconstrained skills\u201d like vocabulary, listening comprehension, background knowledge, problem solving mathematical reasoning, attention, and working memory. The study does not say that is happening: it raises the possibility as needing further research.<\/p>\n<p>Notice that this possibility might also explain why the outcomes differ from the Perry Preschool and Abecedarian demonstration projects. If Tennessee preschools are doing a different kind of work with children, they could indeed have a different kind of impact on those young learners\u2019 futures.<\/p>\n<p>For Kentucky, that possibility is also worth considering. When we report kindergarten readiness, we\u2019re measuring a short list of quite constrained skills. If we want to offer young Kentuckians a broad, deep set of early childhood experiences, designed to nurture a richer set of capacities for our rising generation, we need to be sure that we are valuing and building toward that vision.<\/p>\n<p>Of course, something quite different may also be going on. It maybe something else in the design of the state preschool or some specific local versions of preschool, or may something about the options that were available to the children who didn\u2019t \u201cwin\u201d the lottery in those years. It may be features that are still part of the program or elements that have been changed in the years since these 2009 and 2010 preschoolers were enrolled.<\/p>\n<p>The Tennessee study doesn\u2019t suggest to me that \u201cpreschool doesn\u2019t work.\u201d It does suggest that we need to be clear and steady in wanting preschool to engage young children fully, building their imaginations, curiosity, language capacities, number awareness, cultural strengths and social and emotional flourishing. In all Kentucky\u2019s early childhood investments, we need to keep our eye on <em><strong>that<\/strong><\/em> prize.[\/vc_column_text][\/vc_column][\/vc_row]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In a newly-published study, children admitted to the Tennessee state-funded preschool program by lottery did less well than those who were not admitted, based on data for sixth grade:<\/p>\n<p>assessments results<br \/>\ndisciplinary infractions<br \/>\nattendance<br \/>\nidentification for special education services (excluding those for physical disabilities)<\/p>\n","protected":false},"author":4,"featured_media":5698,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"passster_activate_protection":false,"passster_protect_child_pages":"","passster_protection_type":"password","passster_password":"","passster_activate_overwrite_defaults":"","passster_headline":"","passster_instruction":"","passster_placeholder":"","passster_button":"","passster_id":"","passster_activate_misc_settings":"","passster_redirect_url":"","passster_hide":"no","passster_area_shortcode":"","footnotes":""},"categories":[76,106],"tags":[],"class_list":["post-5697","post","type-post","status-publish","format-standard","has-post-thumbnail","category-ed","category-kindergarten-readiness-toolbox-posts"],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/posts\/5697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/comments?post=5697"}],"version-history":[{"count":1,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/posts\/5697\/revisions"}],"predecessor-version":[{"id":6144,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/posts\/5697\/revisions\/6144"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/media\/5698"}],"wp:attachment":[{"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/media?parent=5697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/categories?post=5697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prichard-backup.com\/July\/wp-json\/wp\/v2\/tags?post=5697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}