io_uring: fix wqe->lock/completion_lock deadlock
authorPavel Begunkov <asml.silence@gmail.com>
Tue, 26 Jan 2021 23:35:10 +0000 (23:35 +0000)
committerJens Axboe <axboe@kernel.dk>
Wed, 27 Jan 2021 02:36:55 +0000 (19:36 -0700)
commit907d1df30a51cc1a1d25414a00cde0494b83df7b
tree4f4c77ff3eab78ccc44536dc01c21b6b8000127c
parentca70f00bed6cb255b7a9b91aa18a2717c9217f70
io_uring: fix wqe->lock/completion_lock deadlock

Joseph reports following deadlock:

CPU0:
...
io_kill_linked_timeout  // &ctx->completion_lock
io_commit_cqring
__io_queue_deferred
__io_queue_async_work
io_wq_enqueue
io_wqe_enqueue  // &wqe->lock

CPU1:
...
__io_uring_files_cancel
io_wq_cancel_cb
io_wqe_cancel_pending_work  // &wqe->lock
io_cancel_task_cb  // &ctx->completion_lock

Only __io_queue_deferred() calls queue_async_work() while holding
ctx->completion_lock, enqueue drained requests via io_req_task_queue()
instead.

Cc: stable@vger.kernel.org # 5.9+
Reported-by: Joseph Qi <joseph.qi@linux.alibaba.com>
Tested-by: Joseph Qi <joseph.qi@linux.alibaba.com>
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
fs/io_uring.c