io_uring: fix missing mb() before waitqueue_active
authorPavel Begunkov <asml.silence@gmail.com>
Wed, 8 Sep 2021 19:49:17 +0000 (20:49 +0100)
committerJens Axboe <axboe@kernel.dk>
Wed, 8 Sep 2021 19:57:56 +0000 (13:57 -0600)
commitc57a91fb1ccfa203ba3e31e5a389cb04de5b0561
treed03ab06beb7d97625301c48c80df6b3d9fef5489
parent713b9825a4c47897f66ad69409581e7734a8728e
io_uring: fix missing mb() before waitqueue_active

In case of !SQPOLL, io_cqring_ev_posted_iopoll() doesn't provide a
memory barrier required by waitqueue_active(&ctx->poll_wait). There is
a wq_has_sleeper(), which does smb_mb() inside, but it's called only for
SQPOLL.

Fixes: 5fd4617840596 ("io_uring: be smarter about waking multiple CQ ring waiters")
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/2982e53bcea2274006ed435ee2a77197107d8a29.1631130542.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
fs/io_uring.c