Andy Smarick says I told you so.
To be clear, I wasn’t the only one raising the alarm. For example, Charlie Barone on the left and Rick Hess on the right were skeptical of the program. But the Duncan-Obama team pushed ahead on SIG with fervor. It’s never been all that clear whether they weren’t aware of the history and research or chose to ignore it. (For an administration that claimed to always follow data, always do what’s right for kids, and only pursue what works, the irony is striking.) But they designed and then implemented a program that did the same things that had disappointed when they were called “comprehensive school reform,” “restructuring,” “reconstitution,” or something else—give more money to the very districts running the persistently failing schools and ask those districts to implement a list of mandated interventions. For some reason this administration was certain this approach would work this time around despite the mountain of evidence telling them otherwise.
On the other hand, Neerav Kingsland cautions on the methods used in the study of SIG’s (in-)effectiveness.
In using a regression-discontinuity design (comparing schools that received the SIG treatment to slightly higher performing schools that did not receive the treatment), the authors were not able to generate a sample size that would be sensitive to positive significant effects that, in my mind, could be considered a success.
The federal government should have either randomized which SIG-eligible schools received funding for the SIG treatment, or the authors should have used a quasi-experimental student-based methodology that allowed for a larger sample