ethdev: fix port removal notification timing