2021-04-12 | Pavel Begunkov | io_uring: store reg buffer end instead of length Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...37af134adeec2423cdf9395.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: improve import_fixed overflow checks Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...f11a4824ecbbf17225cb82a.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: refactor io_async_cancel() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...958a28af0452966ce1095b0.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: remove unused hash_wait Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...15275596b49fbafbea606fa.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: better ref handling in poll_remove_one Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...2e705abdc8cbafe1212f1bd.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: combine lock/unlock sections on exit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...791e2c282e4e9b713dd7024.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: remove useless is_dying check on quiesce Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...82e66daf384a469eb90b931.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: reuse io_rsrc_node_destroy() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...59988704885b1340aef3a27.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: ctx-wide rsrc nodes Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...a784b616ce29843021bb65a.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: refactor io_queue_rsrc_removal() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...7f2b010eef86ffe889174c6.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: move rsrc_put callback into io_rsrc_data Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...8f05747006a603d416d34b4.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: encapsulate rsrc node manipulations Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...c795380f7e1a1995595d41f.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: use rsrc prealloc infra for files reg Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...dc7fe5079d2aa6945b1ace0.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: simplify io_rsrc_node_ref_zero Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...89cd61815d33e05d9ff945e.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-12 | Pavel Begunkov | io_uring: name rsrc bits consistently Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...831e65da3932cde24f6d9df.1617287883.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: reg buffer overflow checks hardening Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...0a5fd21c8cd79dc1c91f0b5.1616624589.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: allocate memory for overflowed CQEs Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise rw complete error handling Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: hide iter revert in resubmit_prep Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: don't alter iopoll reissue fail ret code Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise kiocb_end_write for !ISREG Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: kill unused REQ_F_NO_FILE_TABLE Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: don't init req->work fully in advance Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io-wq: refactor *_get_acct() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: remove tctx->sqpoll Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: don't do extra EXITING cancellations Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: don't clear REQ_F_LINK_TIMEOUT Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise io_req_task_work_add() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: abolish old io_put_file() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise io_dismantle_req() fast path Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: inline io_clean_op()'s fast path Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: remove __io_req_task_cancel() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: add helper flushing locked_free_list Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: refactor io_free_req_deferred() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: inline io_put_req and friends Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: refactor rsrc refnode allocation Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: refactor io_flush_cached_reqs() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise success case of __io_queue_sqe Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: inline __io_queue_linked_timeout() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: keep io_req_free_batch() call locality Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise tctx node checks/alloc Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: optimise io_uring_enter() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: don't take ctx refs in task_work handler Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: simplify io_sqd_update_thread_idle() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: simplify io_resubmit_prep() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: merge defer_prep() and prep_async() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: rethink def->needs_async_data Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: untie alloc_async_data and needs_async_data Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: refactor out send/recv async setup Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: use better types for cflags Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: refactor provide/remove buffer locking Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: add a helper failing not issued requests Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: further deduplicate file slot selection Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: reuse io_req_task_queue_fail() Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-11 | Pavel Begunkov | io_uring: avoid taking ctx refs for task-cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-08 | Pavel Begunkov | io-wq: cancel unbounded works on io-wq destroy Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...55cf86f351441c2174d7f71.1617842918.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-08 | Pavel Begunkov | io_uring: fix rw req completion Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...ca9a01d747744d1e797be26.1617842918.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-08 | Pavel Begunkov | io_uring: clear F_REISSUE right after getting it Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...7cab0074d34afcab771bfa4.1617842918.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-04-02 | Pavel Begunkov | block: don't ignore REQ_NOWAIT for direct IO Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-01 | Pavel Begunkov | io_uring: fix EIOCBQUEUED iter revert Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-04-01 | Pavel Begunkov | io_uring/io-wq: protect against sprintf overflow Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...bc382f28334c02e1a3d3994.1617267273.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-29 | Pavel Begunkov | io_uring: handle setup-failed ctx in kill_timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...60c8e43c87edab3c16736fa.1617014345.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-29 | Pavel Begunkov | io_uring: always go for cancellation spin on exec Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...bc906dd57a57b2c2985a8ac.1616839147.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: don't cancel extra on files match Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...5de345c817ca953580e0e2e.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: don't cancel-track common timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...113d44501fda0df88656b83.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: do post-completion chore on t-out cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...34a6a4185d56c445a366fb4.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-27 | Pavel Begunkov | io_uring: fix timeout cancel return code Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...722702bd0ba9e7bc9b0683b.1616696997.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-25 | Pavel Begunkov | io_uring: maintain CQE order of a failed link Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...ad55f84092a2548c4a888b0.1616699075.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-24 | Pavel Begunkov | io_uring: do ctx sqd ejection in a clear context Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...4a7534601d35d62ab4cb8c7.1616496707.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: fix provide_buffers sign extension Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...8532186a06226e56eb1f594.1616149233.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: don't skip file_end_write() on reissue Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...ee1a3c46396094bd969e577.1616366969.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-22 | Pavel Begunkov | io_uring: correct io_queue_async_work() traces Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...c7aed9c49019ca7095dd24d.1616366969.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-18 | Pavel Begunkov | io_uring: don't leak creds on SQO attach error Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix sqpoll cancellation via task_work Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: add generic callback_head helpers Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix concurrent parking Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: halt SQO submission on ctx exit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: replace sqd rw_semaphore with mutex Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix complete_post use ctx after free Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-15 | Pavel Begunkov | io_uring: fix ->flags races by linked timeouts Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: fix OP_ASYNC_CANCEL across tasks Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: cancel sqpoll via task_work Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: prevent racy sqd->thread checks Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: remove useless ->startup completion Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-12 | Pavel Begunkov | io_uring: cancel deferred requests in try_cancel Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: remove indirect ctx into sqo injection Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix invalid ctx->sq_thread_idle Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix complete_post races for linked req Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...5849f40c0037655c4f2840f.1615250156.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: add io_disarm_next() helper Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> ...e6b891bdde1ddc08cfc3590.1615250156.git.asml.silence@gmail.com |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix io_sq_offload_create error handling Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: clean R_DISABLED startup mess Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-10 | Pavel Begunkov | io_uring: fix unrelated ctx reqs cancellation Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io-wq: warn on creating manager while exiting Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: cancel reqs of all iowq's on ring exit Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: warn when ring exit takes too long Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: index io_uring->xa by ctx not file Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: don't take task ring-file notes Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: do ctx initiated file note removal Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: introduce ctx to tctx back map Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
2021-03-07 | Pavel Begunkov | io_uring: make del_task_file more forgiving Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> |
commit | commitdiff | tree |
next |