2021-03-29 | Pavel Begunkov | io_uring: handle setup-failed ctx in kill_timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...60c8e43c87edab3c16736fa.1617014345.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-29 | Pavel Begunkov | io_uring: always go for cancellation spin on exec Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...bc906dd57a57b2c2985a8ac.1616839147.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: don't cancel extra on files match Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...5de345c817ca953580e0e2e.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: don't cancel-track common timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...113d44501fda0df88656b83.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: do post-completion chore on t-out cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...34a6a4185d56c445a366fb4.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: fix timeout cancel return code Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...722702bd0ba9e7bc9b0683b.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-25 | Pavel Begunkov | io_uring: maintain CQE order of a failed link Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...ad55f84092a2548c4a888b0.1616699075.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-24 | Pavel Begunkov | io_uring: do ctx sqd ejection in a clear context Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...4a7534601d35d62ab4cb8c7.1616496707.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: fix provide_buffers sign extension Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...8532186a06226e56eb1f594.1616149233.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: don't skip file_end_write() on reissue Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...ee1a3c46396094bd969e577.1616366969.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: correct io_queue_async_work() traces Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...c7aed9c49019ca7095dd24d.1616366969.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-18 | Pavel Begunkov | io_uring: don't leak creds on SQO attach error Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix sqpoll cancellation via task_work Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: add generic callback_head helpers Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix concurrent parking Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: halt SQO submission on ctx exit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: replace sqd rw_semaphore with mutex Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix complete_post use ctx after free Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix ->flags races by linked timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: fix OP_ASYNC_CANCEL across tasks Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: cancel sqpoll via task_work Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: prevent racy sqd->thread checks Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: remove useless ->startup completion Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: cancel deferred requests in try_cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: remove indirect ctx into sqo injection Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix invalid ctx->sq_thread_idle Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix complete_post races for linked req Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...5849f40c0037655c4f2840f.1615250156.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: add io_disarm_next() helper Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...e6b891bdde1ddc08cfc3590.1615250156.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix io_sq_offload_create error handling Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: clean R_DISABLED startup mess Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix unrelated ctx reqs cancellation Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io-wq: warn on creating manager while exiting Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: cancel reqs of all iowq's on ring exit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: warn when ring exit takes too long Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: index io_uring->xa by ctx not file Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: don't take task ring-file notes Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: do ctx initiated file note removal Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: introduce ctx to tctx back map Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: make del_task_file more forgiving Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-05 | Pavel Begunkov | io_uring: don't restrict issue_flags for io_openat Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: reliably cancel linked timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: cancel-match based on flags Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: remove extra in_idle wake up Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: inline __io_queue_async_work() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: inline io_req_clean_work() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: choose right tctx->io_wq for try cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: remove sqo_task Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: kill sqo_dead and sqo submission halting Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: replace cmpxchg in fallback with xchg Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: fix __tctx_task_work() ctx race Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: destroy io-wq on exec Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: warn on not destroyed io-wq Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-04 | Pavel Begunkov | io_uring: run fallback on cancellation Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-24 | Pavel Begunkov | mm/filemap: don't revert iter on -EIOCBQUEUED ...850cd108491f53a2e0c501a.1610207781.git.asml.silence@gmail.com Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-24 | Pavel Begunkov | io_uring: fix locked_free_list caches_free() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-22 | Pavel Begunkov | io_uring: clear request count when freeing caches Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-22 | Pavel Begunkov | io_uring: run task_work on io_uring_register() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-21 | Pavel Begunkov | io_uring: fix leaving invalid req->flags Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-21 | Pavel Begunkov | io_uring: wait potential ->release() on resurrect Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-21 | Pavel Begunkov | io_uring: keep generic rsrc infra generic Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-21 | Pavel Begunkov | io_uring: zero ref_node after killing it Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-21 | Pavel Begunkov | io_uring: fail io-wq submission from a task_work Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: don't take uring_lock during iowq cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: fail links more in io_submit_sqe() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: don't do async setup for links' heads Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: do io_*_prep() early in io_submit_sqe() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: split sqe-prep and async setup Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: don't submit link on error Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: move req link into submit_state Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: move io_init_req() into io_submit_sqe() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: move io_init_req()'s definition Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: don't duplicate ->file check in sfr Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: keep io_*_prep() naming consistent Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-18 | Pavel Begunkov | io_uring: kill fictitious submit iteration index Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-17 | Pavel Begunkov | io_uring: fix read memory leak Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: optimise io_init_req() flags setting Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: clean io_req_find_next() fast check Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: don't check PF_EXITING from syscall Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: don't split out consume out of SQE get Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: save ctx put/get for task_work submit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: don't duplicate io_req_task_queue() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: optimise SQPOLL mm/files grabbing Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: optimise out unlikely link queue Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-12 | Pavel Begunkov | io_uring: take compl state from submit state Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-11 | Pavel Begunkov | io_uring: inline io_complete_rw_common() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-11 | Pavel Begunkov | io_uring: move res check out of io_rw_reissue() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-11 | Pavel Begunkov | io_uring: simplify iopoll reissuing Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-11 | Pavel Begunkov | io_uring: clean up io_req_free_batch_finish() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: unpark SQPOLL thread for cancelation Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: defer flushing cached reqs Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: take comp_state from ctx Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: feed reqs back into alloc cache Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: persistent req cache Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: count ctx refs separately from reqs Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: remove fallback_req Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: submit-completion free batching Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: replace list with array for compl batch Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: don't reinit submit state every time Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: remove ctx from comp_state Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-02-10 | Pavel Begunkov | io_uring: don't keep submit_state on stack Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
next |