Do not complain if the originator for an asynchronous request has
gone away.

Do not output a misleading message about failing to read the UDP
packet or connection refused, if it is the user callback that fails.

Fixes #10057.