bpf: report RCU QS in cpumap kthread
authorYan Zhai <yan@cloudflare.com>
Tue, 19 Mar 2024 20:44:40 +0000 (13:44 -0700)
committerJakub Kicinski <kuba@kernel.org>
Thu, 21 Mar 2024 04:05:43 +0000 (21:05 -0700)
commit00bf63122459e87193ee7f1bc6161c83a525569f
treebb54c5de6214b985d103ec0d400e6b8d9527e10f
parentd6dbbb11247c71203785a2c9da474c36f4b19eae
bpf: report RCU QS in cpumap kthread

When there are heavy load, cpumap kernel threads can be busy polling
packets from redirect queues and block out RCU tasks from reaching
quiescent states. It is insufficient to just call cond_resched() in such
context. Periodically raise a consolidated RCU QS before cond_resched
fixes the problem.

Fixes: 6710e1126934 ("bpf: introduce new bpf cpu map type BPF_MAP_TYPE_CPUMAP")
Reviewed-by: Jesper Dangaard Brouer <hawk@kernel.org>
Signed-off-by: Yan Zhai <yan@cloudflare.com>
Acked-by: Paul E. McKenney <paulmck@kernel.org>
Acked-by: Jesper Dangaard Brouer <hawk@kernel.org>
Link: https://lore.kernel.org/r/c17b9f1517e19d813da3ede5ed33ee18496bb5d8.1710877680.git.yan@cloudflare.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
kernel/bpf/cpumap.c