net/vhost: fix unix socket not removed as closing