summaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorAndrii Nakryiko <andrii@kernel.org>2024-04-01 19:21:15 -0700
committerIngo Molnar <mingo@kernel.org>2024-04-03 09:14:26 +0200
commit0dbf66fa7e80024629f816c2ec7a9f3d39637822 (patch)
tree0fc72d941b68b09d9d1f443dc4e2952a6634f3fa
parent9b4e528557944dff694c8afa5a8912de81503bf2 (diff)
downloadlinux-stable-0dbf66fa7e80024629f816c2ec7a9f3d39637822.tar.gz
linux-stable-0dbf66fa7e80024629f816c2ec7a9f3d39637822.tar.bz2
linux-stable-0dbf66fa7e80024629f816c2ec7a9f3d39637822.zip
perf/x86/amd: Ensure amd_pmu_core_disable_all() is always inlined
In the following patches we will enable LBR capture on AMD CPUs at arbitrary point in time, which means that LBR recording won't be frozen by hardware automatically as part of hardware overflow event. So we need to take care to minimize amount of branches and function calls/returns on the path to freezing LBR, minimizing LBR snapshot altering as much as possible. amd_pmu_core_disable_all() is one of the functions on this path, and is already marked as __always_inline. But it calls amd_pmu_set_global_ctl() which is marked as just inline. So to guarantee no function call will be generated thoughout mark amd_pmu_set_global_ctl() as __always_inline as well. Signed-off-by: Andrii Nakryiko <andrii@kernel.org> Signed-off-by: Ingo Molnar <mingo@kernel.org> Reviewed-by: Sandipan Das <sandipan.das@amd.com> Link: https://lore.kernel.org/r/20240402022118.1046049-2-andrii@kernel.org
-rw-r--r--arch/x86/events/amd/core.c2
1 files changed, 1 insertions, 1 deletions
diff --git a/arch/x86/events/amd/core.c b/arch/x86/events/amd/core.c
index 985ef3b47919..9b15afda0326 100644
--- a/arch/x86/events/amd/core.c
+++ b/arch/x86/events/amd/core.c
@@ -647,7 +647,7 @@ static void amd_pmu_cpu_dead(int cpu)
}
}
-static inline void amd_pmu_set_global_ctl(u64 ctl)
+static __always_inline void amd_pmu_set_global_ctl(u64 ctl)
{
wrmsrl(MSR_AMD64_PERF_CNTR_GLOBAL_CTL, ctl);
}