bus/ifpga: remove useless driver cast