diff options
author | David Woodhouse <dwmw@amazon.co.uk> | 2021-02-16 15:04:34 +0000 |
---|---|---|
committer | Greg Kroah-Hartman <gregkh@linuxfoundation.org> | 2022-04-08 13:58:36 +0200 |
commit | 1680a05ff9e93cdc932d9b7c684f215c3167ce42 (patch) | |
tree | 2c09291ff5f7b3941ca317af006e16fba638ac6d /kernel/delayacct.c | |
parent | 0a639f01f90dea71462320d2e477d716a2479a61 (diff) | |
download | linux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.tar.gz linux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.tar.bz2 linux-stable-1680a05ff9e93cdc932d9b7c684f215c3167ce42.zip |
rcu: Kill rnp->ofl_seq and use only rcu_state.ofl_lock for exclusion
[ Upstream commit 82980b1622d97017053c6792382469d7dc26a486 ]
If we allow architectures to bring APs online in parallel, then we end
up requiring rcu_cpu_starting() to be reentrant. But currently, the
manipulation of rnp->ofl_seq is not thread-safe.
However, rnp->ofl_seq is also fairly much pointless anyway since both
rcu_cpu_starting() and rcu_report_dead() hold rcu_state.ofl_lock for
fairly much the whole time that rnp->ofl_seq is set to an odd number
to indicate that an operation is in progress.
So drop rnp->ofl_seq completely, and use only rcu_state.ofl_lock.
This has a couple of minor complexities: lockdep will complain when we
take rcu_state.ofl_lock, and currently accepts the 'excuse' of having
an odd value in rnp->ofl_seq. So switch it to an arch_spinlock_t to
avoid that false positive complaint. Since we're killing rnp->ofl_seq
of course that 'excuse' has to be changed too, so make it check for
arch_spin_is_locked(rcu_state.ofl_lock).
There's no arch_spin_lock_irqsave() so we have to manually save and
restore local interrupts around the locking.
At Paul's request based on Neeraj's analysis, make rcu_gp_init not just
wait but *exclude* any CPU online/offline activity, which was fairly
much true already by virtue of it holding rcu_state.ofl_lock.
Signed-off-by: David Woodhouse <dwmw@amazon.co.uk>
Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
Signed-off-by: Sasha Levin <sashal@kernel.org>
Diffstat (limited to 'kernel/delayacct.c')
0 files changed, 0 insertions, 0 deletions