net/mlx5e: Allow mlx5e_safe_switch_channels to work with channels closed