summaryrefslogtreecommitdiffstats
path: root/kernel/delayacct.c
diff options
context:
space:
mode:
authorDavid Woodhouse <dwmw@amazon.co.uk>2021-02-16 15:04:34 +0000
committerGreg Kroah-Hartman <gregkh@linuxfoundation.org>2022-04-08 13:58:36 +0200
commit1680a05ff9e93cdc932d9b7c684f215c3167ce42 (patch)
tree2c09291ff5f7b3941ca317af006e16fba638ac6d /kernel/delayacct.c
parent0a639f01f90dea71462320d2e477d716a2479a61 (diff)
downloadlinux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.tar.gz
linux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.tar.bz2
linux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.zip
rcu: Kill rnp->ofl_seq and use only rcu_state.ofl_lock for exclusion
[ Upstream commit 82980b1622d97017053c6792382469d7dc26a486 ] If we allow architectures to bring APs online in parallel, then we end up requiring rcu_cpu_starting() to be reentrant. But currently, the manipulation of rnp->ofl_seq is not thread-safe. However, rnp->ofl_seq is also fairly much pointless anyway since both rcu_cpu_starting() and rcu_report_dead() hold rcu_state.ofl_lock for fairly much the whole time that rnp->ofl_seq is set to an odd number to indicate that an operation is in progress. So drop rnp->ofl_seq completely, and use only rcu_state.ofl_lock. This has a couple of minor complexities: lockdep will complain when we take rcu_state.ofl_lock, and currently accepts the 'excuse' of having an odd value in rnp->ofl_seq. So switch it to an arch_spinlock_t to avoid that false positive complaint. Since we're killing rnp->ofl_seq of course that 'excuse' has to be changed too, so make it check for arch_spin_is_locked(rcu_state.ofl_lock). There's no arch_spin_lock_irqsave() so we have to manually save and restore local interrupts around the locking. At Paul's request based on Neeraj's analysis, make rcu_gp_init not just wait but *exclude* any CPU online/offline activity, which was fairly much true already by virtue of it holding rcu_state.ofl_lock. Signed-off-by: David Woodhouse <dwmw@amazon.co.uk> Signed-off-by: Paul E. McKenney <paulmck@kernel.org> Signed-off-by: Sasha Levin <sashal@kernel.org>
Diffstat (limited to 'kernel/delayacct.c')
0 files changed, 0 insertions, 0 deletions