vfio: do not needlessly check for IOVA mode