[tip:timers/core] [timers] 7ee9887703: netperf.Throughput_Mbps -1.2% regression

From: kernel test robot
Date: Fri Mar 01 2024 - 03:09:59 EST




Hello,

kernel test robot noticed a -1.2% regression of netperf.Throughput_Mbps on:


commit: 7ee988770326fca440472200c3eb58935fe712f6 ("timers: Implement the hierarchical pull model")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git timers/core

testcase: netperf
test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz (Ice Lake) with 256G memory
parameters:

ip: ipv4
runtime: 300s
nr_threads: 200%
cluster: cs-localhost
test: SCTP_STREAM
cpufreq_governor: performance




If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <oliver.sang@xxxxxxxxx>
| Closes: https://lore.kernel.org/oe-lkp/202403011511.24defbbd-oliver.sang@xxxxxxxxx


Details are as below:
-------------------------------------------------------------------------------------------------->


The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20240301/202403011511.24defbbd-oliver.sang@xxxxxxxxx

=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase:
cs-localhost/gcc-12/performance/ipv4/x86_64-rhel-8.3/200%/debian-12-x86_64-20240206.cgz/300s/lkp-icl-2sp2/SCTP_STREAM/netperf

commit:
57e95a5c41 ("timers: Introduce function to check timer base is_idle flag")
7ee9887703 ("timers: Implement the hierarchical pull model")

57e95a5c4117dc6a 7ee988770326fca440472200c3e
---------------- ---------------------------
%stddev %change %stddev
\ | \
5232 +6.8% 5589 vmstat.system.in
0.03 +0.0 0.04 mpstat.cpu.all.soft%
0.04 +0.0 0.08 mpstat.cpu.all.sys%
201.33 ± 3% -34.1% 132.67 ± 7% perf-c2c.DRAM.remote
187.83 ± 3% -28.7% 133.83 ± 12% perf-c2c.HITM.local
40.67 ± 7% -57.4% 17.33 ± 26% perf-c2c.HITM.remote
4984 +4.9% 5227 proc-vmstat.nr_shmem
100999 +3.6% 104640 proc-vmstat.nr_slab_unreclaimable
8114 ± 2% +11.0% 9005 ± 2% proc-vmstat.pgactivate
20.00 +1907.5% 401.50 ± 79% proc-vmstat.unevictable_pgs_culled
965754 -10.3% 866147 sched_debug.cpu.avg_idle.avg
101797 ± 12% +41.8% 144376 ± 4% sched_debug.cpu.avg_idle.stddev
0.00 ± 22% -40.7% 0.00 ± 18% sched_debug.cpu.next_balance.stddev
886.06 ± 18% +339.7% 3895 ± 8% sched_debug.cpu.nr_switches.min
5474 ± 12% -23.9% 4164 ± 10% sched_debug.cpu.nr_switches.stddev
4.10 -1.2% 4.05 netperf.ThroughputBoth_Mbps
1049 -1.2% 1037 netperf.ThroughputBoth_total_Mbps
4.10 -1.2% 4.05 netperf.Throughput_Mbps
1049 -1.2% 1037 netperf.Throughput_total_Mbps
102.17 ± 8% +887.4% 1008 ± 3% netperf.time.involuntary_context_switches
2.07 ± 3% +388.2% 10.11 netperf.time.system_time
15.14 +18.8% 17.99 perf-stat.i.MPKI
1.702e+08 +1.6% 1.729e+08 perf-stat.i.branch-instructions
1.68 +0.0 1.71 perf-stat.i.branch-miss-rate%
18.46 +3.1 21.57 perf-stat.i.cache-miss-rate%
4047319 +19.7% 4846291 perf-stat.i.cache-misses
22007366 +3.2% 22707969 perf-stat.i.cache-references
1.84 +17.0% 2.15 perf-stat.i.cpi
9.159e+08 +10.4% 1.011e+09 perf-stat.i.cpu-cycles
161.08 +183.7% 456.91 ± 2% perf-stat.i.cpu-migrations
190.71 -1.6% 187.66 perf-stat.i.cycles-between-cache-misses
8.434e+08 +1.2% 8.535e+08 perf-stat.i.instructions
0.61 -10.6% 0.54 perf-stat.i.ipc
4.79 +18.4% 5.66 perf-stat.overall.MPKI
4.21 -0.1 4.14 perf-stat.overall.branch-miss-rate%
18.39 +2.9 21.33 perf-stat.overall.cache-miss-rate%
1.09 +9.1% 1.19 perf-stat.overall.cpi
227.07 -7.8% 209.29 perf-stat.overall.cycles-between-cache-misses
0.92 -8.3% 0.84 perf-stat.overall.ipc
1379820 +2.3% 1411871 perf-stat.overall.path-length
1.702e+08 +1.5% 1.728e+08 perf-stat.ps.branch-instructions
4035389 +19.7% 4830446 perf-stat.ps.cache-misses
21948285 +3.2% 22642774 perf-stat.ps.cache-references
9.163e+08 +10.3% 1.011e+09 perf-stat.ps.cpu-cycles
160.61 +183.5% 455.30 ± 2% perf-stat.ps.cpu-migrations
8.433e+08 +1.1% 8.529e+08 perf-stat.ps.instructions
2.551e+11 +1.5% 2.589e+11 perf-stat.total.instructions
31.82 ± 3% -12.9 18.91 ± 5% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter
36.90 ± 2% -12.1 24.83 ± 7% perf-profile.calltrace.cycles-pp.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
27.61 ± 3% -11.9 15.68 ± 8% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state
31.75 ± 2% -11.5 20.25 ± 8% perf-profile.calltrace.cycles-pp.acpi_safe_halt.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
24.39 ± 3% -10.0 14.38 ± 8% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter
24.33 ± 3% -10.0 14.36 ± 8% perf-profile.calltrace.cycles-pp.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt
21.00 ± 3% -9.2 11.84 ± 9% perf-profile.calltrace.cycles-pp.net_rx_action.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
20.97 ± 3% -9.1 11.83 ± 9% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__do_softirq.irq_exit_rcu
20.97 ± 3% -9.1 11.84 ± 9% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt
4.92 ± 10% -4.0 0.91 ± 28% perf-profile.calltrace.cycles-pp._nohz_idle_balance.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.81 ± 13% -1.5 0.29 ±100% perf-profile.calltrace.cycles-pp.run_timer_softirq.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
9.76 ± 7% -1.5 8.26 ± 8% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv
5.08 ± 7% -1.0 4.12 ± 12% perf-profile.calltrace.cycles-pp.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
2.99 ± 4% -0.8 2.22 ± 16% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
2.98 ± 4% -0.8 2.22 ± 16% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.66 ± 7% -0.7 0.95 ± 11% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt.acpi_idle_enter
1.58 ± 5% -0.7 0.90 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_safe_halt
1.05 ± 9% -0.5 0.52 ± 49% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_generate_timeout_event.call_timer_fn.__run_timers
0.95 ± 14% -0.5 0.50 ± 46% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.90 ± 14% -0.4 0.53 ± 47% perf-profile.calltrace.cycles-pp.schedule.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.90 ± 14% -0.4 0.52 ± 47% perf-profile.calltrace.cycles-pp.__schedule.schedule.smpboot_thread_fn.kthread.ret_from_fork
0.64 ± 17% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.64 ± 17% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64
0.96 ± 8% -0.3 0.65 ± 45% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.96 ± 8% -0.3 0.64 ± 45% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.96 ± 8% -0.3 0.65 ± 45% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.53 ± 4% -0.3 1.22 ± 12% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.53 ± 4% -0.3 1.24 ± 12% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.62 ± 4% -0.3 1.33 ± 12% perf-profile.calltrace.cycles-pp.read
1.57 ± 5% -0.3 1.28 ± 13% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.57 ± 5% -0.3 1.28 ± 13% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
1.23 ± 8% -0.2 1.03 ± 10% perf-profile.calltrace.cycles-pp.tick_nohz_stop_tick.tick_nohz_idle_stop_tick.cpuidle_idle_call.do_idle.cpu_startup_entry
0.50 ± 45% +0.4 0.92 ± 14% perf-profile.calltrace.cycles-pp.rebalance_domains._nohz_idle_balance.__do_softirq.irq_exit_rcu.sysvec_call_function_single
0.45 ± 72% +0.5 0.95 ± 17% perf-profile.calltrace.cycles-pp.skb_release_data.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.sock_recvmsg
0.75 ± 46% +0.5 1.26 ± 24% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg
0.82 ± 45% +0.5 1.36 ± 22% perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg
1.08 ± 12% +0.6 1.68 ± 14% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_call_function_single.asm_sysvec_call_function_single.acpi_safe_halt.acpi_idle_enter
1.08 ± 12% +0.6 1.68 ± 14% perf-profile.calltrace.cycles-pp._nohz_idle_balance.__do_softirq.irq_exit_rcu.sysvec_call_function_single.asm_sysvec_call_function_single
1.08 ± 12% +0.6 1.68 ± 14% perf-profile.calltrace.cycles-pp.__do_softirq.irq_exit_rcu.sysvec_call_function_single.asm_sysvec_call_function_single.acpi_safe_halt
0.18 ±141% +0.6 0.83 ± 14% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains._nohz_idle_balance.__do_softirq.irq_exit_rcu
0.00 +0.7 0.66 ± 18% perf-profile.calltrace.cycles-pp.sctp_generate_timeout_event.call_timer_fn.__run_timers.timer_expire_remote.tmigr_handle_remote_up
0.30 ±101% +0.7 0.97 ± 28% perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.consume_skb.sctp_chunk_put.sctp_ulpevent_free
0.00 +0.8 0.77 ± 18% perf-profile.calltrace.cycles-pp.call_timer_fn.__run_timers.timer_expire_remote.tmigr_handle_remote_up.tmigr_handle_remote
0.00 +0.8 0.80 ± 17% perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.consume_skb.sctp_chunk_put.sctp_datamsg_put
3.45 ± 14% +0.8 4.26 ± 11% perf-profile.calltrace.cycles-pp.__memcpy.skb_copy_bits.skb_copy.sctp_make_reassembled_event.sctp_ulpq_tail_data
3.46 ± 14% +0.8 4.28 ± 10% perf-profile.calltrace.cycles-pp.skb_copy_bits.skb_copy.sctp_make_reassembled_event.sctp_ulpq_tail_data.sctp_cmd_interpreter
0.00 +0.8 0.82 ± 18% perf-profile.calltrace.cycles-pp.__run_timers.timer_expire_remote.tmigr_handle_remote_up.tmigr_handle_remote.__do_softirq
0.00 +0.8 0.83 ± 17% perf-profile.calltrace.cycles-pp.timer_expire_remote.tmigr_handle_remote_up.tmigr_handle_remote.__do_softirq.irq_exit_rcu
0.00 +0.8 0.84 ± 31% perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.skb_release_data.consume_skb.sctp_chunk_put
4.44 ± 14% +0.9 5.36 ± 10% perf-profile.calltrace.cycles-pp.sctp_make_reassembled_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
0.00 +0.9 0.94 ± 16% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.sctp_chunk_put.sctp_datamsg_put.sctp_chunk_free
4.33 ± 14% +0.9 5.27 ± 10% perf-profile.calltrace.cycles-pp.skb_copy.sctp_make_reassembled_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm
2.42 ± 9% +1.1 3.56 ± 17% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit
2.41 ± 9% +1.1 3.55 ± 17% perf-profile.calltrace.cycles-pp.__do_softirq.do_softirq.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2
2.42 ± 9% +1.2 3.58 ± 17% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit
2.34 ± 10% +1.2 3.50 ± 17% perf-profile.calltrace.cycles-pp.net_rx_action.__do_softirq.do_softirq.__local_bh_enable_ip.__dev_queue_xmit
2.56 ± 8% +1.2 3.74 ± 17% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush
1.72 ± 15% +1.2 2.91 ± 19% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_assoc_rwnd_increase
1.76 ± 14% +1.2 2.97 ± 18% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_assoc_rwnd_increase.sctp_ulpevent_free
1.88 ± 13% +1.2 3.10 ± 18% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_assoc_rwnd_increase.sctp_ulpevent_free.sctp_recvmsg
2.34 ± 9% +1.2 3.57 ± 19% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__do_softirq.do_softirq
2.34 ± 10% +1.2 3.57 ± 19% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__do_softirq.do_softirq.__local_bh_enable_ip
1.98 ± 13% +1.3 3.23 ± 19% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_assoc_rwnd_increase.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg
2.23 ± 10% +1.3 3.50 ± 19% perf-profile.calltrace.cycles-pp.sctp_assoc_rwnd_increase.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.sock_recvmsg
0.00 +1.4 1.37 ± 9% perf-profile.calltrace.cycles-pp.tmigr_handle_remote_up.tmigr_handle_remote.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt
0.00 +1.4 1.38 ± 10% perf-profile.calltrace.cycles-pp.tmigr_handle_remote.__do_softirq.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
3.52 ± 7% +1.8 5.30 ± 15% perf-profile.calltrace.cycles-pp.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.sock_recvmsg.____sys_recvmsg
4.94 ± 5% +5.6 10.58 ± 16% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork.ret_from_fork_asm
4.94 ± 5% +5.6 10.58 ± 16% perf-profile.calltrace.cycles-pp.ret_from_fork.ret_from_fork_asm
4.94 ± 5% +5.6 10.58 ± 16% perf-profile.calltrace.cycles-pp.ret_from_fork_asm
2.83 ± 9% +5.9 8.73 ± 18% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1.73 ± 12% +6.2 7.93 ± 18% perf-profile.calltrace.cycles-pp.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1.73 ± 12% +6.2 7.93 ± 18% perf-profile.calltrace.cycles-pp.__do_softirq.run_ksoftirqd.smpboot_thread_fn.kthread.ret_from_fork
1.70 ± 13% +6.2 7.91 ± 18% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__do_softirq.run_ksoftirqd
1.70 ± 13% +6.2 7.91 ± 18% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__do_softirq.run_ksoftirqd.smpboot_thread_fn
1.70 ± 12% +6.2 7.92 ± 18% perf-profile.calltrace.cycles-pp.net_rx_action.__do_softirq.run_ksoftirqd.smpboot_thread_fn.kthread
0.00 +10.2 10.24 ± 89% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
36.91 ± 2% -12.1 24.83 ± 7% perf-profile.children.cycles-pp.acpi_idle_enter
36.80 ± 2% -12.0 24.80 ± 7% perf-profile.children.cycles-pp.acpi_safe_halt
29.95 ± 3% -11.8 18.19 ± 7% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
27.78 ± 3% -11.4 16.39 ± 8% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
25.75 ± 2% -9.1 16.65 ± 9% perf-profile.children.cycles-pp.irq_exit_rcu
5.07 ± 3% -3.4 1.71 ± 12% perf-profile.children.cycles-pp._raw_spin_lock
6.04 ± 8% -3.3 2.70 ± 17% perf-profile.children.cycles-pp._nohz_idle_balance
2.80 ± 6% -2.3 0.51 ± 31% perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
1.83 ± 13% -1.3 0.51 ± 30% perf-profile.children.cycles-pp.run_timer_softirq
5.62 ± 5% -1.1 4.52 ± 10% perf-profile.children.cycles-pp.sctp_outq_flush_data
1.40 ± 13% -1.0 0.38 ± 25% perf-profile.children.cycles-pp.tick_irq_enter
1.44 ± 13% -1.0 0.44 ± 18% perf-profile.children.cycles-pp.irq_enter_rcu
1.77 ± 11% -1.0 0.78 ± 20% perf-profile.children.cycles-pp.__mod_timer
1.36 ± 15% -0.9 0.48 ± 24% perf-profile.children.cycles-pp.get_nohz_timer_target
0.97 ± 15% -0.9 0.10 ± 38% perf-profile.children.cycles-pp.tick_do_update_jiffies64
1.46 ± 11% -0.9 0.60 ± 23% perf-profile.children.cycles-pp.sctp_transport_reset_t3_rtx
1.53 ± 7% -0.6 0.92 ± 21% perf-profile.children.cycles-pp.update_blocked_averages
1.00 ± 27% -0.5 0.45 ± 32% perf-profile.children.cycles-pp.update_rq_clock_task
1.73 ± 7% -0.5 1.21 ± 7% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
1.65 ± 5% -0.5 1.14 ± 5% perf-profile.children.cycles-pp.hrtimer_interrupt
1.94 ± 6% -0.4 1.56 ± 13% perf-profile.children.cycles-pp.vfs_read
1.16 ± 10% -0.3 0.84 ± 19% perf-profile.children.cycles-pp.sctp_generate_timeout_event
0.66 ± 12% -0.3 0.37 ± 17% perf-profile.children.cycles-pp.update_rq_clock
0.99 ± 8% -0.3 0.73 ± 20% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.99 ± 8% -0.3 0.73 ± 20% perf-profile.children.cycles-pp.do_group_exit
0.99 ± 8% -0.3 0.73 ± 20% perf-profile.children.cycles-pp.do_exit
0.34 ± 17% -0.2 0.12 ± 46% perf-profile.children.cycles-pp.run_rebalance_domains
0.28 ± 23% -0.2 0.07 ± 83% perf-profile.children.cycles-pp.__release_sock
1.24 ± 9% -0.2 1.03 ± 10% perf-profile.children.cycles-pp.tick_nohz_stop_tick
0.54 ± 17% -0.2 0.33 ± 20% perf-profile.children.cycles-pp.idle_cpu
0.30 ± 16% -0.2 0.10 ± 32% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
1.09 ± 5% -0.2 0.88 ± 15% perf-profile.children.cycles-pp.seq_read_iter
0.26 ± 26% -0.2 0.07 ± 83% perf-profile.children.cycles-pp.sctp_backlog_rcv
0.35 ± 25% -0.2 0.15 ± 41% perf-profile.children.cycles-pp.release_sock
0.39 ± 19% -0.2 0.20 ± 11% perf-profile.children.cycles-pp.__memcg_slab_free_hook
0.72 ± 13% -0.2 0.54 ± 11% perf-profile.children.cycles-pp.ktime_get
0.50 ± 14% -0.2 0.33 ± 18% perf-profile.children.cycles-pp.do_vmi_align_munmap
0.39 ± 18% -0.2 0.23 ± 14% perf-profile.children.cycles-pp.sctp_inq_pop
0.51 ± 15% -0.2 0.35 ± 20% perf-profile.children.cycles-pp.do_vmi_munmap
0.46 ± 14% -0.1 0.32 ± 18% perf-profile.children.cycles-pp.proc_reg_read_iter
0.26 ± 20% -0.1 0.14 ± 29% perf-profile.children.cycles-pp.tlb_finish_mmu
0.46 ± 10% -0.1 0.34 ± 20% perf-profile.children.cycles-pp.sched_clock_cpu
0.22 ± 17% -0.1 0.12 ± 13% perf-profile.children.cycles-pp.should_we_balance
0.21 ± 13% -0.1 0.10 ± 20% perf-profile.children.cycles-pp.lookup_fast
0.36 ± 16% -0.1 0.25 ± 24% perf-profile.children.cycles-pp.__split_vma
0.29 ± 10% -0.1 0.20 ± 27% perf-profile.children.cycles-pp.wp_page_copy
0.54 ± 11% -0.1 0.45 ± 8% perf-profile.children.cycles-pp.balance_fair
0.14 ± 34% -0.1 0.06 ± 48% perf-profile.children.cycles-pp.vma_prepare
0.21 ± 28% -0.1 0.13 ± 27% perf-profile.children.cycles-pp.vsnprintf
0.14 ± 31% -0.1 0.05 ± 75% perf-profile.children.cycles-pp.irqentry_exit
0.15 ± 17% -0.1 0.07 ± 45% perf-profile.children.cycles-pp.__x64_sys_munmap
0.19 ± 19% -0.1 0.12 ± 21% perf-profile.children.cycles-pp.__vm_munmap
0.10 ± 22% -0.1 0.05 ± 72% perf-profile.children.cycles-pp.dev_attr_show
0.10 ± 22% -0.1 0.05 ± 72% perf-profile.children.cycles-pp.sysfs_kf_seq_show
0.22 ± 8% -0.0 0.17 ± 17% perf-profile.children.cycles-pp.diskstats_show
0.05 ± 72% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.__fdget_pos
0.07 ± 52% +0.1 0.16 ± 44% perf-profile.children.cycles-pp.local_clock_noinstr
0.06 ±106% +0.1 0.18 ± 32% perf-profile.children.cycles-pp.timerqueue_add
0.00 +0.2 0.17 ± 24% perf-profile.children.cycles-pp.tmigr_inactive_up
0.00 +0.2 0.18 ± 23% perf-profile.children.cycles-pp.tmigr_cpu_deactivate
0.06 ± 23% +0.2 0.25 ± 15% perf-profile.children.cycles-pp.task_work_run
0.00 +0.2 0.19 ± 19% perf-profile.children.cycles-pp.tmigr_cpu_activate
0.00 +0.2 0.20 ± 20% perf-profile.children.cycles-pp.task_mm_cid_work
0.00 +0.4 0.38 ± 17% perf-profile.children.cycles-pp.tmigr_update_events
0.07 ± 24% +0.4 0.49 ± 13% perf-profile.children.cycles-pp.__get_next_timer_interrupt
2.29 ± 4% +0.7 3.02 ± 12% perf-profile.children.cycles-pp.__kmalloc_large_node
2.32 ± 4% +0.7 3.05 ± 13% perf-profile.children.cycles-pp.__kmalloc_node_track_caller
2.09 ± 8% +0.7 2.82 ± 13% perf-profile.children.cycles-pp.get_page_from_freelist
0.00 +0.9 0.86 ± 16% perf-profile.children.cycles-pp.timer_expire_remote
1.25 ± 10% +0.9 2.15 ± 14% perf-profile.children.cycles-pp.rmqueue
1.48 ± 14% +1.0 2.51 ± 13% perf-profile.children.cycles-pp.__free_pages_ok
0.58 ± 29% +1.1 1.66 ± 14% perf-profile.children.cycles-pp.free_one_page
3.00 ± 6% +1.1 4.11 ± 17% perf-profile.children.cycles-pp.ip_finish_output2
2.88 ± 6% +1.1 4.00 ± 17% perf-profile.children.cycles-pp.__dev_queue_xmit
2.23 ± 10% +1.3 3.50 ± 19% perf-profile.children.cycles-pp.sctp_assoc_rwnd_increase
0.00 +1.4 1.40 ± 8% perf-profile.children.cycles-pp.tmigr_handle_remote_up
0.00 +1.4 1.43 ± 9% perf-profile.children.cycles-pp.tmigr_handle_remote
2.43 ± 9% +1.5 3.91 ± 18% perf-profile.children.cycles-pp.do_softirq
2.46 ± 9% +1.5 3.95 ± 18% perf-profile.children.cycles-pp.__local_bh_enable_ip
2.16 ± 9% +1.7 3.87 ± 13% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
3.53 ± 7% +1.8 5.30 ± 14% perf-profile.children.cycles-pp.sctp_ulpevent_free
5.02 ± 5% +5.6 10.65 ± 15% perf-profile.children.cycles-pp.ret_from_fork_asm
5.00 ± 4% +5.6 10.64 ± 15% perf-profile.children.cycles-pp.ret_from_fork
4.94 ± 5% +5.6 10.58 ± 16% perf-profile.children.cycles-pp.kthread
2.83 ± 9% +5.9 8.74 ± 18% perf-profile.children.cycles-pp.smpboot_thread_fn
1.73 ± 12% +6.2 7.93 ± 18% perf-profile.children.cycles-pp.run_ksoftirqd
0.02 ±141% +10.3 10.31 ± 88% perf-profile.children.cycles-pp.poll_idle
2.41 ± 5% -1.1 1.32 ± 10% perf-profile.self.cycles-pp._raw_spin_lock
1.11 ± 19% -0.7 0.37 ± 20% perf-profile.self.cycles-pp.get_nohz_timer_target
0.84 ± 28% -0.5 0.34 ± 30% perf-profile.self.cycles-pp.update_rq_clock_task
0.65 ± 23% -0.5 0.16 ± 34% perf-profile.self.cycles-pp._nohz_idle_balance
0.29 ± 16% -0.2 0.07 ± 62% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.52 ± 19% -0.2 0.31 ± 21% perf-profile.self.cycles-pp.idle_cpu
0.43 ± 9% -0.2 0.23 ± 23% perf-profile.self.cycles-pp.update_rq_clock
0.25 ± 28% -0.1 0.12 ± 50% perf-profile.self.cycles-pp.__memcg_slab_free_hook
0.16 ± 34% -0.1 0.03 ±101% perf-profile.self.cycles-pp.need_update
0.16 ± 32% -0.1 0.06 ± 80% perf-profile.self.cycles-pp.call_cpuidle
0.12 ± 19% -0.1 0.04 ±101% perf-profile.self.cycles-pp.sctp_inq_pop
0.23 ± 22% -0.1 0.15 ± 42% perf-profile.self.cycles-pp.sctp_check_transmitted
0.13 ± 47% -0.1 0.06 ± 55% perf-profile.self.cycles-pp.all_vm_events
0.19 ± 14% -0.1 0.12 ± 25% perf-profile.self.cycles-pp.filemap_map_pages
0.05 ± 72% +0.1 0.11 ± 24% perf-profile.self.cycles-pp.__fdget_pos
0.08 ± 54% +0.1 0.16 ± 22% perf-profile.self.cycles-pp.sctp_skb_recv_datagram
0.00 +0.1 0.09 ± 31% perf-profile.self.cycles-pp.tmigr_cpu_activate
0.00 +0.2 0.18 ± 26% perf-profile.self.cycles-pp.task_mm_cid_work
0.02 ±141% +10.1 10.08 ± 90% perf-profile.self.cycles-pp.poll_idle




Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki