io_uring: IRQ rw completion batching
authorPavel Begunkov <asml.silence@gmail.com>
Wed, 18 Aug 2021 11:42:47 +0000 (12:42 +0100)
committerJens Axboe <axboe@kernel.dk>
Mon, 23 Aug 2021 19:13:04 +0000 (13:13 -0600)
commit126180b95f27ef6cc536da57115e06665254b0d7
tree5289d89d4bada33011eed816c141b854c8bbc3a8
parentf237c30a5610d35a584f3296d397b93d80ce374e
io_uring: IRQ rw completion batching

Employ inline completion logic for read/write completions done via
io_req_task_complete(). If ->uring_lock is contended, just do normal
request completion, but if not, make tctx_task_work() to grab the lock
and do batched inline completions in io_req_task_complete().

Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/94589c3ce69eaed86a21bb1ec696407a54fab1aa.1629286357.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
fs/io_uring.c