net/nfb: remove resources when port is closed