we should remember the Big Facts. For example, one the Big Facts in finance is that active equity fund managers rarely beat the market for very long, at least after fees. This, as much as Campbell Harvey’s statistical work reminds us to be wary of the hundreds of papers claiming to find factors that beat the market.
Pointer from Mark Thoma
This is a good example of asking, “What else would be true?” When you are inclined to believe that a study shows X, consider all of the implications of X. In the example above, Dillow is suggesting that if one finds that there is some factor that allows one to earn above-market returns, how do we reconcile that with the fact that we do not observe active fund managers earning above-market returns?
Recall that I raised a similar question about the purported finding that in the United States worker earnings have gone nowhere as productivity increased. This should greatly increase the demand for labor. It should greatly increase international competitiveness, turning us into an export powerhouse. Since I do not see either of those taking place, and since many economists have pointed to flaws in the construction of the comparison of earnings and productivity, I think this makes the purported finding highly suspect.
In contrast, consider the view that assortative mating has increased and plays an important role in inequality. I have not seen anyone say, “IF that were true, then we would expect to observe Y, and Y has not happened.”
I think that this is the way to evaluate interpretive frameworks in economics. Consider many possible implications of an interpretive framework. Relative to those implications, do we observe anomalies? When you have several anomalies, you may choose to overlook them or to explain them away, but you should at least treat the anomalies as caution flags. If instead you keep finding other phenomena that are consistent with the interpretive framework, then that should make you more comfortable with using that framework.