There is no such thing as reliably cleaning up after a test failure. If you could do things reliably, the test wouldn't have failed.