Users now have to call Close() explicitly.  This simplifies using the
class, as most users have automatic socket management already, and
Steal() had to be used often.

Avoid closing it twice.

Finally fixes the regression by commit c1f4f1fd.