driver core: Fix sleeping in invalid context during device link deletion