drm/ttm: Fix a deadlock if the target BO is not idle during swap