Also handle errors due to missing buffers gracefully.

This error is surprisingly easy to trigger, so we should make sure that
the program does not crash.