Since increasing a bank's capital requirement to improve the stability of the financial system imposes costs upon the bank, a regulator should ideally be able to prove beyond a reasonable doubt that banks classified as systemically risky really do create systemic risk before subjecting them to this capital punishment. Evaluating the performance of two leading systemic risk models, we show that estimation error alone prevents the reliable identification of the most systemically risky banks. We conclude that it will be a considerable challenge to develop a riskometer that is both sound and reliable enough to provide an adequate foundation for macroprudential policy.