Chengming Zhou b2788f6d49 sched/cpuacct: Optimize away RCU read lock ...

commit dc6e0818bc upstream.

Since cpuacct_charge() is called from the scheduler update_curr(),
we must already have rq lock held, then the RCU read lock can
be optimized away.

And do the same thing in it's wrapper cgroup_account_cputime(),
but we can't use lockdep_assert_rq_held() there, which defined
in kernel/sched/sched.h.

Suggested-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Signed-off-by: Chengming Zhou <zhouchengming@bytedance.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://lore.kernel.org/r/20220220051426.5274-2-zhouchengming@bytedance.com
[OP: adjusted lockdep_assert_rq_held() -> lockdep_assert_held()]
Signed-off-by: Ovidiu Panait <ovidiu.panait@windriver.com>
Signed-off-by: Sasha Levin <sashal@kernel.org>

2023-10-10 21:53:33 +02:00

..

bpf

bpf: Avoid deadlock when using queue and stack maps from NMI

2023-10-10 21:53:26 +02:00

cgroup

cgroup:namespace: Remove unused cgroup_namespaces_init()

2023-09-19 12:20:19 +02:00

configs

…

debug

…

dma

dma-debug: don't call __dma_entry_alloc_check_leak() under free_entries_lock

2023-10-10 21:53:32 +02:00

entry

entry/kvm: Exit to user mode when TIF_NOTIFY_SIGNAL is set

2023-01-04 11:39:22 +01:00

events

perf: Fix function pointer case

2023-08-11 11:57:46 +02:00

futex

futex: Resend potentially swallowed owner death notification

2023-01-14 10:15:20 +01:00

gcov

gcov: add support for checksum field

2023-01-14 10:16:24 +01:00

irq

irqdomain: Fix domain registration race

2023-03-17 08:45:08 +01:00

kcsan

kcsan: Don't expect 64 bits atomic builtins from 32 bits architectures

2023-07-27 08:43:57 +02:00

livepatch

…

locking

…

power

PM: EM: fix memory leak with using debugfs_lookup()

2023-03-11 16:39:51 +01:00

printk

printk: ringbuffer: Fix truncating buffer size min_t cast

2023-09-19 12:20:21 +02:00

rcu

rcuscale: Move rcu_scale_writer() schedule_timeout_uninterruptible() to _idle()

2023-09-23 11:01:05 +02:00

sched

sched/cpuacct: Optimize away RCU read lock

2023-10-10 21:53:33 +02:00

time

timers/nohz: Switch to ONESHOT_STOPPED in the low-res handler when the tick is stopped

2023-08-30 16:23:17 +02:00

trace

ring-buffer: Do not attempt to read past "commit"

2023-10-10 21:53:32 +02:00

.gitignore

…

acct.c

acct: fix potential integer overflow in encode_comp_t()

2023-01-14 10:16:14 +01:00

async.c

…

audit_fsnotify.c

…

audit_tree.c

…

audit_watch.c

…

audit.c

…

audit.h

…

auditfilter.c

…

auditsc.c

audit: fix possible soft lockup in __audit_inode_child()

2023-09-19 12:20:13 +02:00

backtracetest.c

…

bounds.c

…

capability.c

…

compat.c

sched_getaffinity: don't assume 'cpumask_size()' is fully initialized

2023-04-05 11:23:45 +02:00

configs.c

…

context_tracking.c

…

cpu_pm.c

…

cpu.c

cpu/hotplug: Make target_store() a nop when target == state

2023-01-14 10:15:20 +01:00

crash_core.c

…

crash_dump.c

…

cred.c

…

delayacct.c

…

dma.c

…

exec_domain.c

…

exit.c

exit: Use READ_ONCE() for all oops/warn limit reads

2023-02-01 08:23:21 +01:00

extable.c

…

fail_function.c

kernel/fail_function: fix memory leak with using debugfs_lookup()

2023-03-11 16:40:18 +01:00

fork.c

kernel/fork: beware of __put_task_struct() calling context

2023-09-23 11:01:05 +02:00

freezer.c

…

gen_kheaders.sh

…

groups.c

…

hung_task.c

…

iomem.c

…

irq_work.c

…

jump_label.c

…

kallsyms.c

…

kcmp.c

…

Kconfig.freezer

…

Kconfig.hz

…

Kconfig.locks

…

Kconfig.preempt

…

kcov.c

…

kexec_core.c

kexec: fix a memory leak in crash_shrink_memory()

2023-07-27 08:43:40 +02:00

kexec_elf.c

…

kexec_file.c

kexec: support purgatories with .text.hot sections

2023-06-21 15:45:37 +02:00

kexec_internal.h

panic, kexec: make __crash_kexec() NMI safe

2023-04-20 12:10:29 +02:00

kexec.c

panic, kexec: make __crash_kexec() NMI safe

2023-04-20 12:10:29 +02:00

kheaders.c

kheaders: Use array declaration instead of char

2023-05-17 11:47:33 +02:00

kmod.c

…

kprobes.c

kprobes: Prohibit probing on CFI preamble symbol

2023-09-19 12:20:05 +02:00

ksysfs.c

kexec: turn all kexec_mutex acquisitions into trylocks

2023-04-20 12:10:29 +02:00

kthread.c

…

latencytop.c

…

Makefile

futex: Move to kernel/futex/

2023-01-14 10:15:20 +01:00

module_signature.c

…

module_signing.c

…

module-internal.h

…

module.c

modules: only allow symbol_get of EXPORT_SYMBOL_GPL modules

2023-09-19 12:20:02 +02:00

notifier.c

…

nsproxy.c

…

padata.c

padata: Fix list iterator in padata_do_serial()

2023-01-14 10:15:51 +01:00

panic.c

exit: Use READ_ONCE() for all oops/warn limit reads

2023-02-01 08:23:21 +01:00

params.c

…

pid_namespace.c

rcu-tasks: Fix synchronize_rcu_tasks() VS zap_pid_ns_processes()

2023-03-11 16:39:19 +01:00

pid.c

…

profile.c

…

ptrace.c

…

range.c

…

reboot.c

…

regset.c

…

relay.c

relayfs: fix out-of-bounds access in relay_file_read

2023-05-17 11:47:34 +02:00

resource.c

dax/kmem: Fix leak of memory-hotplug resources

2023-03-11 16:40:04 +01:00

rseq.c

…

scftorture.c

scftorture: Forgive memory-allocation failure if KASAN

2023-09-23 11:01:05 +02:00

scs.c

…

seccomp.c

…

signal.c

task_work: unconditionally run task_work from get_signal()

2023-01-04 11:39:23 +01:00

smp.c

…

smpboot.c

…

smpboot.h

…

softirq.c

…

stackleak.c

…

stacktrace.c

…

static_call.c

…

stop_machine.c

…

sys_ni.c

…

sys.c

kernel/sys.c: fix and improve control flow in __sys_setres[ug]id()

2023-04-26 11:27:38 +02:00

sysctl-test.c

…

sysctl.c

sysctl: move some boundary constants from sysctl.c to sysctl_vals

2023-06-28 10:28:09 +02:00

task_work.c

task_work: add helper for more targeted task_work canceling

2023-01-04 11:39:23 +01:00

taskstats.c

…

test_kprobes.c

…

torture.c

torture: Fix hang during kthread shutdown phase

2023-08-30 16:23:17 +02:00

tracepoint.c

…

tsacct.c

…

ucount.c

…

uid16.c

…

uid16.h

…

umh.c

…

up.c

…

user_namespace.c

…

user-return-notifier.c

…

user.c

…

usermode_driver.c

…

utsname_sysctl.c

…

utsname.c

…

watch_queue.c

watch_queue: fix IOC_WATCH_QUEUE_SET_SIZE alloc error paths

2023-03-17 08:45:13 +01:00

watchdog_hld.c

watchdog/perf: more properly prevent false positives with turbo modes

2023-07-27 08:43:40 +02:00

watchdog.c

…

workqueue_internal.h

…

workqueue.c

workqueue: clean up WORK_* constant types, clarify masking

2023-07-27 08:44:19 +02:00