Yan Zhai 5fcee137db bpf: report RCU QS in cpumap kthread ... [ Upstream commit 00bf63122459e87193ee7f1bc6161c83a525569f ] When there are heavy load, cpumap kernel threads can be busy polling packets from redirect queues and block out RCU tasks from reaching quiescent states. It is insufficient to just call cond_resched() in such context. Periodically raise a consolidated RCU QS before cond_resched fixes the problem. Fixes: 6710e1126934 ("bpf: introduce new bpf cpu map type BPF_MAP_TYPE_CPUMAP") Reviewed-by: Jesper Dangaard Brouer <hawk@kernel.org> Signed-off-by: Yan Zhai <yan@cloudflare.com> Acked-by: Paul E. McKenney <paulmck@kernel.org> Acked-by: Jesper Dangaard Brouer <hawk@kernel.org> Link: https://lore.kernel.org/r/c17b9f1517e19d813da3ede5ed33ee18496bb5d8.1710877680.git.yan@cloudflare.com Signed-off-by: Jakub Kicinski <kuba@kernel.org> Signed-off-by: Sasha Levin <sashal@kernel.org>		2024-03-26 18:20:12 -04:00
..
bpf	bpf: report RCU QS in cpumap kthread	2024-03-26 18:20:12 -04:00
cgroup	cgroup_freezer: cgroup_freezing: Check if not frozen	2023-12-13 18:45:22 +01:00
configs
debug	kdb: Fix a potential buffer overflow in kdb_local()	2024-01-25 15:36:00 -08:00
dma	dma-mapping: clear dev->dma_mem to NULL after freeing it	2024-01-25 15:35:26 -08:00
entry
events	perf: Fix the nr_addr_filters fix	2024-02-05 20:14:33 +00:00
futex	futex: Don't include process MM in futex key on no-MMU	2023-11-20 11:58:53 +01:00
gcov
irq	genirq: Initialize resend_node hlist for all interrupt descriptors	2024-01-31 16:19:13 -08:00
kcsan
livepatch	livepatch: Fix missing newline character in klp_resolve_symbols()	2023-11-20 11:59:25 +01:00
locking	lockdep: Fix block chain corruption	2023-12-03 07:33:06 +01:00
module	modules: wait do_free_init correctly	2024-03-26 18:19:55 -04:00
power	PM: hibernate: Enforce ordering during image compression/decompression	2024-01-31 16:18:49 -08:00
printk	printk: Disable passing console lock owner completely during panic()	2024-03-26 18:19:27 -04:00
rcu	rcu/exp: Handle RCU expedited grace period kworker allocation failure	2024-03-26 18:19:17 -04:00
sched	sched/fair: Take the scheduling domain into account in select_idle_core()	2024-03-26 18:19:19 -04:00
time	timekeeping: Fix cross-timestamp interpolation for non-x86	2024-03-26 18:19:19 -04:00
trace	tracing: Fix a NULL vs IS_ERR() bug in event_subsystem_dir()	2024-02-23 09:25:28 +01:00
.gitignore
acct.c
async.c	async: Introduce async_schedule_dev_nocall()	2024-01-31 16:18:49 -08:00
audit_fsnotify.c
audit_tree.c
audit_watch.c	audit: don't WARN_ON_ONCE(!current->mm) in audit_exe_compare()	2023-11-28 17:19:56 +00:00
audit.c	audit: Send netlink ACK before setting connection in auditd_set	2024-02-05 20:14:14 +00:00
audit.h
auditfilter.c
auditsc.c	audit,io_uring: io_uring openat triggers audit reference count underflow	2023-10-13 18:34:46 +02:00
backtracetest.c
bounds.c
capability.c
cfi.c
compat.c
configs.c
context_tracking.c
cpu_pm.c
cpu.c	hrtimers: Push pending hrtimers away from outgoing CPU earlier	2023-12-13 18:44:56 +01:00
crash_core.c	Crash: add lock to serialize crash hotplug handling	2023-09-29 17:20:48 -07:00
crash_dump.c
cred.c	cred: get rid of CONFIG_DEBUG_CREDENTIALS	2023-12-20 17:01:51 +01:00
delayacct.c
dma.c
exec_domain.c
exit.c	cred: get rid of CONFIG_DEBUG_CREDENTIALS	2023-12-20 17:01:51 +01:00
extable.c
fail_function.c
fork.c	mm: add a NO_INHERIT flag to the PR_SET_MDWE prctl	2023-12-03 07:33:06 +01:00
freezer.c
gen_kheaders.sh
groups.c
hung_task.c
iomem.c
irq_work.c
jump_label.c
kallsyms_internal.h
kallsyms_selftest.c
kallsyms_selftest.h
kallsyms.c
kcmp.c
Kconfig.freezer
Kconfig.hz
Kconfig.kexec	kexec: select CRYPTO from KEXEC_FILE instead of depending on it	2024-01-05 15:19:41 +01:00
Kconfig.locks
Kconfig.preempt
kcov.c
kexec_core.c	kexec: do syscore_shutdown() in kernel_kexec	2024-01-31 16:18:56 -08:00
kexec_elf.c
kexec_file.c
kexec_internal.h
kexec.c	kernel: kexec: copy user-array safely	2023-11-28 17:19:40 +00:00
kheaders.c
kprobes.c	kprobes: consistent rcu api usage for kretprobe holder	2023-12-13 18:45:31 +01:00
ksyms_common.c
ksysfs.c
kthread.c
latencytop.c
Makefile
module_signature.c
notifier.c
nsproxy.c
padata.c	crypto: pcrypt - Fix hungtask for PADATA_RESET	2023-11-28 17:19:42 +00:00
panic.c	panic: Reenable preemption in WARN slowpath	2023-09-15 11:28:08 +02:00
params.c
pid_namespace.c
pid_sysctl.h
pid.c	pidfd: prevent a kernel-doc warning	2023-09-19 13:21:33 -07:00
profile.c
ptrace.c
range.c
reboot.c	kernel/reboot: emergency_restart: Set correct system_state	2023-11-28 17:20:04 +00:00
regset.c
relay.c
resource_kunit.c
resource.c	kernel/resource: Increment by align value in get_free_mem_region()	2024-01-10 17:16:58 +01:00
rseq.c
scftorture.c
scs.c
seccomp.c
signal.c
smp.c	smp,csd: Throw an error if a CSD lock is stuck for too long	2023-11-28 17:19:36 +00:00
smpboot.c
smpboot.h
softirq.c
stackleak.c
stacktrace.c
static_call_inline.c
static_call.c
stop_machine.c
sys_ni.c	posix-timers: Get rid of [COMPAT_]SYS_NI() uses	2024-01-20 11:51:46 +01:00
sys.c	prctl: Disable prctl(PR_SET_MDWE) on parisc	2023-12-03 07:33:06 +01:00
sysctl-test.c
sysctl.c
task_work.c	task_work: add kerneldoc annotation for 'data' argument	2023-09-19 13:21:32 -07:00
taskstats.c
torture.c	rcutorture: Fix stuttering races and other issues	2023-11-28 17:20:08 +00:00
tracepoint.c
tsacct.c
ucount.c
uid16.c
uid16.h
umh.c
up.c
user_namespace.c
user-return-notifier.c
user.c
usermode_driver.c
utsname_sysctl.c
utsname.c
vhost_task.c
watch_queue.c	kernel: watch_queue: copy user-array safely	2023-11-28 17:19:40 +00:00
watchdog_buddy.c
watchdog_perf.c
watchdog.c	watchdog: move softlockup_panic back to early_param	2023-11-28 17:19:57 +00:00
workqueue_internal.h
workqueue.c	workqueue: Don't call cpumask_test_cpu() with -1 CPU in wq_update_node_max_active()	2024-03-26 18:19:16 -04:00