net: phy: Avoid NPD upon phy_detach() when driver is unbound