net: axienet: Fix double deregister of mdio