aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring/io_uring.c
AgeCommit message (Expand)AuthorFilesLines
2025-10-22io_uring: Fix code indentation errorRanganath V N1-1/+1
2025-10-03io_uring: update liburing git URLJens Axboe1-1/+1
2025-10-02Merge tag 'for-6.18/io_uring-20250929' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-49/+96
2025-09-18io_uring/msg_ring: kill alloc_cache for io_kiocb allocationsJens Axboe1-4/+0
2025-09-18io_uring: include dying ring in task_work "should cancel" stateJens Axboe1-2/+4
2025-09-10io_uring: correct size of overflow CQE calculationJens Axboe1-1/+1
2025-09-10io_uring: replace use of system_unbound_wq with system_dfl_wqMarco Crivellari1-1/+1
2025-09-10io_uring: replace use of system_wq with system_percpu_wqMarco Crivellari1-1/+1
2025-09-08io_uring: don't include filetable.h in io_uring.hCaleb Sander Mateos1-0/+1
2025-09-08io_uring: add macros for avaliable flagsPavel Begunkov1-29/+3
2025-09-04io_uring: remove WRITE_ONCE() in io_uring_create()Caleb Sander Mateos1-2/+7
2025-08-27io_uring: add support for IORING_SETUP_CQE_MIXEDJens Axboe1-16/+62
2025-08-24io_uring: remove async/poll related provided buffer recyclesJens Axboe1-2/+0
2025-08-24io_uring/kbuf: switch to storing struct io_buffer_list locallyJens Axboe1-3/+3
2025-08-24io_uring/kbuf: pass in struct io_buffer_list to commit/recycle helpersJens Axboe1-3/+3
2025-08-24io_uring/kbuf: drop 'issue_flags' from io_put_kbuf(s)() argumentsJens Axboe1-1/+1
2025-08-24io_uring: add request poisoningPavel Begunkov1-0/+23
2025-08-21io_uring: clear ->async_data as part of normal initJens Axboe1-0/+1
2025-07-28Merge tag 'for-6.17/io_uring-20250728' of git://git.kernel.dk/linuxLinus Torvalds1-15/+75
2025-07-12io_uring/poll: cleanup apoll freeingJens Axboe1-8/+3
2025-07-08Revert "io_uring: gate REQ_F_ISREG on !S_ANON_INODE as well"Jens Axboe1-2/+1
2025-07-06Merge branch 'io_uring-6.16' into for-6.17/io_uringJens Axboe1-1/+2
2025-06-29io_uring: gate REQ_F_ISREG on !S_ANON_INODE as wellJens Axboe1-1/+2
2025-06-23io_uring: add mshot helper for posting CQE32Pavel Begunkov1-0/+40
2025-06-23io_uring: add struct io_cold_def->sqe_copy() methodJens Axboe1-2/+25
2025-06-23io_uring: add IO_URING_F_INLINE issue flagJens Axboe1-5/+7
2025-06-13io_uring: run local task_work from ring exit IOPOLL reapingJens Axboe1-0/+3
2025-06-12io_uring: consistently use rcu semantics with sqpoll threadKeith Busch1-2/+2
2025-06-04io_uring/futex: mark wait requests as inflightJens Axboe1-1/+6
2025-05-26Merge tag 'for-6.16/io_uring-20250523' of git://git.kernel.dk/linuxLinus Torvalds1-143/+142
2025-05-26Merge tag 'for-6.16/block-20250523' of git://git.kernel.dk/linuxLinus Torvalds1-0/+2
2025-05-21io_uring: finish IOU_OK -> IOU_COMPLETE transitionJens Axboe1-1/+1
2025-05-21io_uring: fix overflow resched cqe reorderingPavel Begunkov1-0/+1
2025-05-17io_uring: add new helpers for posting overflowsJens Axboe1-21/+29
2025-05-17io_uring: pass in struct io_big_cqe to io_alloc_ocqe()Jens Axboe1-12/+11
2025-05-17io_uring: make io_alloc_ocqe() take a struct io_cqe pointerJens Axboe1-10/+16
2025-05-17io_uring: split alloc and add of overflowJens Axboe1-29/+45
2025-05-16io_uring: open code io_req_cqe_overflow()Pavel Begunkov1-10/+10
2025-05-16Merge branch 'io_uring-6.15' into for-6.16/io_uringJens Axboe1-44/+38
2025-05-12io_uring: drain based on allocates reqsPavel Begunkov1-47/+32
2025-05-09io_uring: count allocated requestsPavel Begunkov1-1/+8
2025-05-09io_uring: open code io_account_cq_overflow()Pavel Begunkov1-9/+4
2025-05-09io_uring: consolidate drain seq checkingPavel Begunkov1-28/+17
2025-05-09io_uring: remove drain prealloc checksPavel Begunkov1-12/+3
2025-05-09io_uring: simplify drain ret passingPavel Begunkov1-3/+1
2025-05-09io_uring: fix spurious drain flushingPavel Begunkov1-1/+13
2025-05-09io_uring: account drain memory to cgroupPavel Begunkov1-1/+1
2025-05-09io_uring: add lockdep asserts to io_add_aux_cqePavel Begunkov1-0/+3
2025-05-07io_uring: ensure deferred completions are flushed for multishotJens Axboe1-0/+8
2025-05-06io_uring: move io_req_put_rsrc_nodes()Pavel Begunkov1-0/+10
2025-05-06io_uring: remove io_preinit_req()Pavel Begunkov1-19/+2
2025-05-06io_uring: enable per-io write streamsKeith Busch1-0/+2
2025-05-04io_uring: always arm linked timeouts prior to issueJens Axboe1-35/+15
2025-04-28io_uring: delete misleading comment in io_fill_cqe_aux()Pavel Begunkov1-5/+0
2025-04-24io_uring: fix 'sync' handling of io_fallback_tw()Jens Axboe1-6/+7
2025-04-24io_uring/eventfd: dedup signalling helpersPavel Begunkov1-2/+2
2025-04-24io_uring: don't duplicate flushing in io_req_post_cqePavel Begunkov1-3/+8
2025-04-23io_uring/zcrx: add support for multiple ifqsPavel Begunkov1-1/+2
2025-04-21io_uring/rsrc: remove node assignment helpersJens Axboe1-1/+2
2025-04-21io_uring/wq: avoid indirect do_work/free_work callsCaleb Sander Mateos1-1/+1
2025-04-03io_uring: always do atomic put from iowqPavel Begunkov1-1/+1
2025-03-31io_uring: add req flag invariant build assertionPavel Begunkov1-0/+2
2025-03-28io_uring: don't pass ctx to tw add remote helperPavel Begunkov1-8/+6
2025-03-28Merge tag 'for-6.15/io_uring-reg-vec-20250327' of git://git.kernel.dk/linuxLinus Torvalds1-38/+27
2025-03-28Merge tag 'for-6.15/io_uring-rx-zc-20250325' of git://git.kernel.dk/linuxLinus Torvalds1-0/+7
2025-03-27io_uring/net: fix io_req_post_cqe abuse by send bundlePavel Begunkov1-2/+2
2025-03-26Merge tag 'for-6.15/io_uring-20250322' of git://git.kernel.dk/linuxLinus Torvalds1-104/+145
2025-03-25Merge tag 'lsm-pr-20250323' of git://git.kernel.org/pub/scm/linux/kernel/git/...Linus Torvalds1-7/+14
2025-03-25io_uring: move min_events sanitisationPavel Begunkov1-9/+7
2025-03-25io_uring: rename "min" arg in io_iopoll_check()Pavel Begunkov1-4/+4
2025-03-25io_uring: open code __io_post_aux_cqe()Pavel Begunkov1-12/+2
2025-03-25io_uring: defer iowq cqe overflow via task_workPavel Begunkov1-4/+7
2025-03-25io_uring: fix retry handling off iowqPavel Begunkov1-1/+1
2025-03-25Merge tag 'timers-cleanups-2025-03-23' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-1/+1
2025-03-21io_uring/cmd: add iovec cache for commandsPavel Begunkov1-2/+3
2025-03-20io_uring: enable toggle of iowait usage when waiting on CQEsJens Axboe1-13/+19
2025-03-19io_uring/cmd: don't expose entire cmd async dataPavel Begunkov1-1/+1
2025-03-19io_uring: rename the data cmd cachePavel Begunkov1-2/+2
2025-03-10io_uring: unify STOP_MULTISHOT with IOU_OKPavel Begunkov1-1/+0
2025-03-10io_uring: return -EAGAIN to continue multishotPavel Begunkov1-3/+1
2025-03-07Merge branch 'for-6.15/io_uring-rx-zc' into for-6.15/io_uring-reg-vecJens Axboe1-0/+7
2025-03-05io_uring: introduce io_cache_free() helperCaleb Sander Mateos1-2/+1
2025-02-28io_uring: cache nodes and mapped buffersKeith Busch1-0/+2
2025-02-28io_uring: add support for kernel registered bvecsKeith Busch1-0/+3
2025-02-27Merge branch 'io_uring-6.14' into for-6.15/io_uringJens Axboe1-0/+2
2025-02-24io_uring: make io_poll_issue() sturdierPavel Begunkov1-7/+33
2025-02-21Merge tag 'io_uring-6.14-20250221' of git://git.kernel.dk/linuxLinus Torvalds1-0/+2
2025-02-18io_uring: use lockless_cq flag in io_req_complete_post()Caleb Sander Mateos1-1/+1
2025-02-18io_uring: Use helper function hrtimer_update_function()Nam Cao1-1/+1
2025-02-17io_uring/zcrx: add interface queue and refill queueDavid Wei1-0/+7
2025-02-17io_uring: pass struct io_tw_state by valueCaleb Sander Mateos1-7/+7
2025-02-17io_uring: introduce type alias for io_tw_stateCaleb Sander Mateos1-14/+14
2025-02-17io_uring: pass ctx instead of req to io_init_req_drain()Caleb Sander Mateos1-3/+2
2025-02-17io_uring: use IO_REQ_LINK_FLAGS moreCaleb Sander Mateos1-3/+4
2025-02-17io_uring/kbuf: introduce io_kbuf_drop_legacy()Pavel Begunkov1-1/+1
2025-02-17io_uring/kbuf: remove legacy kbuf cachingPavel Begunkov1-2/+0
2025-02-17io_uring/kbuf: move locking into io_kbuf_drop()Pavel Begunkov1-4/+1
2025-02-17io_uring/kbuf: remove legacy kbuf kmem cachePavel Begunkov1-2/+0
2025-02-17io_uring: sanitise ring params earlierPavel Begunkov1-33/+44
2025-02-17io_uring: check for iowq alloc_workqueue failurePavel Begunkov1-0/+1
2025-02-17io_uring: deduplicate caches deallocationPavel Begunkov1-12/+12
2025-02-15io_uring: prevent opcode speculationPavel Begunkov1-0/+2
2025-02-07io_uring,lsm,selinux: add LSM hooks for io_uring_setup()Hamza Mahfooz1-2/+3
2025-02-07io_uring: refactor io_uring_allowed()Hamza Mahfooz1-7/+13
2025-01-31Merge tag 'io_uring-6.14-20250131' of git://git.kernel.dk/linuxLinus Torvalds1-5/+7
2025-01-28treewide: const qualify ctl_tables where applicableJoel Granados1-1/+1
2025-01-23io_uring: get rid of alloc cache init_once handlingJens Axboe1-5/+7
2025-01-20Merge tag 'for-6.14/io_uring-20250119' of git://git.kernel.dk/linuxLinus Torvalds1-76/+60
2025-01-13io_uring: simplify the SQPOLL thread check when cancelling requestsBui Quang Minh1-6/+11
2025-01-11Merge tag 'io_uring-6.13-20250111' of git://git.kernel.dk/linuxLinus Torvalds1-4/+1
2025-01-10io_uring: expose read/write attribute capabilityAnuj Gupta1-1/+2
2025-01-10io_uring: don't touch sqd->thread off tw addPavel Begunkov1-4/+1
2025-01-10Merge tag 'vfs-6.13-rc7.fixes.2' of git://git.kernel.org/pub/scm/linux/kernel...Linus Torvalds1-5/+4
2025-01-10io_uring/rw: handle -EAGAIN retry at IO completion timeJens Axboe1-2/+13
2025-01-10Merge branch 'vfs-6.14.poll' into vfs.fixesChristian Brauner1-5/+4
2025-01-10io_uring_poll: kill the no longer necessary barrier after poll_wait()Oleg Nesterov1-5/+4
2025-01-09Merge tag 'for-6.13-rc6-tag' of git://git.kernel.org/pub/scm/linux/kernel/git...Linus Torvalds1-1/+1
2025-01-06io_uring/cmd: rename struct uring_cache to io_uring_cmd_dataJens Axboe1-1/+1
2024-12-30io_uring: ensure io_queue_deferred() is out-of-lineJens Axboe1-5/+4
2024-12-27io_uring/msg_ring: Drop custom destructorGabriel Krisman Bertazi1-2/+2
2024-12-27io_uring: Move old async data allocation helper to headerGabriel Krisman Bertazi1-13/+0
2024-12-23io_uring: prevent reg-wait speculationsPavel Begunkov1-0/+1
2024-12-23io_uring: introduce attributes for read/write and PI supportAnuj Gupta1-0/+2
2024-12-23io_uring: use region api for CQPavel Begunkov1-25/+11
2024-12-23io_uring: use region api for SQPavel Begunkov1-22/+14
2024-12-23io_uring: rename ->resize_lockPavel Begunkov1-1/+1
2024-12-19io_uring: check if iowq is killed before queuingPavel Begunkov1-1/+5
2024-12-18io_uring: Fix registered ring file refcount leakJann Horn1-0/+1
2024-12-17io_uring: make ctx->timeout_lock a raw spinlockJens Axboe1-5/+5
2024-11-30Merge tag 'io_uring-6.13-20242901' of git://git.kernel.dk/linuxLinus Torvalds1-25/+50
2024-11-26io_uring: fix task_work cap overshootingJens Axboe1-15/+19
2024-11-21io_uring: limit local tw doneDavid Wei1-11/+32
2024-11-21io_uring: add io_local_work_pending()David Wei1-7/+7
2024-11-19Merge tag 'timers-core-2024-11-18' of git://git.kernel.org/pub/scm/linux/kern...Linus Torvalds1-3/+4
2024-11-18Merge tag 'for-6.13/io_uring-20241118' of git://git.kernel.dk/linuxLinus Torvalds1-197/+236
2024-11-15io_uring: restore back registered wait argumentsPavel Begunkov1-1/+13
2024-11-15io_uring: add memory region registrationPavel Begunkov1-0/+1
2024-11-15io_uring: temporarily disable registered waitsPavel Begunkov1-10/+0
2024-11-15io_uring: disable ENTER_EXT_ARG_REG for IOPOLLPavel Begunkov1-6/+2
2024-11-13io_uring: fix invalid hybrid polling ctx leaksPavel Begunkov1-5/+5
2024-11-07io_uring: Switch to use hrtimer_setup_on_stack()Nam Cao1-3/+4
2024-11-06io_uring: avoid normal tw intermediate fallbackPavel Begunkov1-11/+10
2024-11-06io_uring: prevent speculating sq_array indexingPavel Begunkov1-0/+1
2024-11-06io_uring: move struct io_kiocb from task_struct to io_uring_taskJens Axboe1-19/+15
2024-11-06io_uring: remove task ref helpersJens Axboe1-21/+10
2024-11-06io_uring: move cancelations to be io_uring_task basedJens Axboe1-21/+21
2024-11-06io_uring/rsrc: split io_kiocb node type assignmentsJens Axboe1-3/+3
2024-11-02io_uring: add support for hybrid IOPOLLhexue1-1/+7
2024-11-02io_uring/rsrc: get rid of the empty node and dummy_ubufJens Axboe1-2/+2
2024-11-02io_uring/rsrc: add io_rsrc_node_lookup() helperJens Axboe1-5/+1
2024-11-02io_uring/rsrc: unify file and buffer resource tablesJens Axboe1-4/+3
2024-11-02io_uring: only initialize io_kiocb rsrc_nodes when neededJens Axboe1-2/+2
2024-11-02io_uring/rsrc: add an empty io_rsrc_node for sparse buffer entriesJens Axboe1-2/+2
2024-11-02io_uring/rsrc: get rid of io_rsrc_node allocation cacheJens Axboe1-5/+1
2024-11-02io_uring/rsrc: get rid of per-ring io_rsrc_node listJens Axboe1-26/+12
2024-10-29io_uring: specify freeptr usage for SLAB_TYPESAFE_BY_RCU io_kiocb cacheJens Axboe1-0/+2
2024-10-29io_uring: add support for fixed wait regionsJens Axboe1-11/+57
2024-10-29io_uring: change io_get_ext_arg() to use uaccess begin + endJens Axboe1-1/+17
2024-10-29io_uring: switch struct ext_arg from __kernel_timespec to timespec64Jens Axboe1-10/+9
2024-10-29io_uring/register: add IORING_REGISTER_RESIZE_RINGSJens Axboe1-0/+1
2024-10-29io_uring: abstract out a bit of the ring filling logicJens Axboe1-30/+40
2024-10-29io_uring: move max entry definition and ring sizing into headerJens Axboe1-8/+6
2024-10-29io_uring: clean up cqe trace pointsPavel Begunkov1-2/+2
2024-10-29io_uring: static_key for !IORING_SETUP_NO_SQARRAYPavel Begunkov1-1/+11
2024-10-29io_uring: kill io_llist_xchgPavel Begunkov1-15/+1
2024-10-29io_uring: move cancel hash tables to kvmalloc/kvfreeJens Axboe1-7/+13
2024-10-29io_uring/cancel: get rid of init_hash_table() helperJens Axboe1-1/+3
2024-10-29io_uring/poll: get rid of unlocked cancel hashJens Axboe1-4/+0
2024-10-07remove pointless includes of <linux/fdtable.h>Al Viro1-1/+0
2024-09-24io_uring: fix casts to io_req_flags_tMin-Hua Chen1-1/+1
2024-09-24io_uring: fix memory leak when cache init failGuixin Liu1-1/+4
2024-09-24Merge tag 'for-6.12/io_uring-20240922' of git://git.kernel.dk/linuxLinus Torvalds1-3/+18
2024-09-20io_uring: check if we need to reschedule during overflow flushJens Axboe1-0/+15
2024-09-20io_uring: improve request linking traceJens Axboe1-1/+1
2024-09-19io_uring: check for presence of task_work rather than TIF_NOTIFY_SIGNALJens Axboe1-2/+2
2024-09-18Merge tag 'slab-for-6.12' of git://git.kernel.org/pub/scm/linux/kernel/git/vb...Linus Torvalds1-6/+8
2024-09-11io_uring/cmd: expose iowq to cmdsPavel Begunkov1-0/+11
2024-09-10io_uring: port to struct kmem_cache_argsChristian Brauner1-6/+8
2024-08-29io_uring/kbuf: pass in 'len' argument for buffer commitJens Axboe1-1/+1
2024-08-25io_uring: wire up min batch wake timeoutJens Axboe1-4/+4
2024-08-25io_uring: add support for batch wait timeoutJens Axboe1-13/+80
2024-08-25io_uring: implement our own schedule timeout handlingJens Axboe1-4/+31
2024-08-25io_uring: move schedule wait logic into helperJens Axboe1-16/+21
2024-08-25io_uring: encapsulate extraneous wait flags into a separate structJens Axboe1-21/+24
2024-08-25io_uring: user registered clockid for wait timeoutsPavel Begunkov1-2/+6
2024-08-25io_uring: add absolute mode wait timeoutsPavel Begunkov1-7/+8
2024-08-25io_uring/napi: postpone napi timeout adjustmentPavel Begunkov1-1/+0
2024-07-26io_uring/napi: pass ktime to io_napi_adjust_timeoutPavel Begunkov1-2/+4
2024-07-24io_uring: align iowq and task request error handlingPavel Begunkov1-1/+1
2024-07-24io_uring: tighten task exit cancellationsPavel Begunkov1-1/+4
2024-07-15Merge tag 'for-6.11/io_uring-20240714' of git://git.kernel.dk/linuxLinus Torvalds1-95/+55
2024-07-02io_uring/msg_ring: fix overflow postingPavel Begunkov1-1/+5
2024-06-24io_uring: signal SQPOLL task_work with TWA_SIGNAL_NO_IPIJens Axboe1-2/+2
2024-06-24io_uring/msg_ring: add an alloc cache for io_kiocb entriesJens Axboe1-0/+6
2024-06-24io_uring: add io_add_aux_cqe() helperJens Axboe1-2/+21
2024-06-24io_uring: add remote task_work execution helperJens Axboe1-8/+16
2024-06-16io_uring/io-wq: make io_wq_work flags atomicJens Axboe1-6/+6
2024-06-16io_uring: use 'state' consistentlyJens Axboe1-1/+1
2024-06-16io_uring/eventfd: move eventfd handling to separate fileJens Axboe1-81/+1
2024-06-16io_uring/eventfd: move to more idiomatic RCU free usageJens Axboe1-23/+26