Re: [PATCH V3] perf vendor events riscv: add T-HEAD C9xx JSON file

From: Nikita Shubin
Date: Thu May 18 2023 - 05:09:31 EST


Hello Inochi Amaoto!

Tested your latest patch on LicheeRV C906:

linux $ git describe --tags
v6.4-rc2-1-g85a420ada3a8

opensbi $ git describe --tags
v1.2-119-gdc1c7db

stat_all_pmu.sh - PASSED

Perf stat gives something:

perf stat -e data_tlb_miss,inst_tlb_miss,jtlb_miss,l1_dcache_read_acc
ess,l1_dcache_read_miss,l1_dcache_write_access,l1_dcache_write_miss,l1_
icache_ac
cess,l1_icache_miss -- sleep 1

Performance counter stats for 'sleep 1':

9082 data_tlb_miss
5604 inst_tlb_miss
1790 jtlb_miss
130207 l1_dcache_read_access
3353 l1_dcache_read_miss
80454 l1_dcache_write_access
633 l1_dcache_write_miss
639820 l1_icache_access
14660 l1_icache_miss

1.009768750 seconds time elapsed

0.000000000 seconds user
0.010388000 seconds sys

perf record hangs

licheerv # perf record
[ 432.015618] watchdog: BUG: soft lockup - CPU#0 stuck for 26s!
[perf:117]
[ 460.015617] watchdog: BUG: soft lockup - CPU#0 stuck for 52s!
[perf:117]
[ 488.015616] watchdog: BUG: soft lockup - CPU#0 stuck for 78s!
[perf:117]
[ 516.015617] watchdog: BUG: soft lockup - CPU#0 stuck for 104s!
[perf:117]

But that's not related to your patch anyway.

I am strongly against using "c9xx" wildcard, i would prefer declaring
them separate (especially taking in mind that c920 is c910 with vector
- AFAIK), but that's up to Arnaldo to decide.

Anyway:

Tested-by: Nikita Shubin <n.shubin@xxxxxxxxx>


On Wed, 2023-05-17 at 15:12 +0800, Inochi Amaoto wrote:
> Add json file of T-HEAD C9xx series events.
>
> The event idx (raw value) is summary as following:
>
> event id range   | support cpu
>  0x01 - 0x06     |  c906,c910,c920
>  0x07            |  c906
>  0x08 - 0x0a     |  c910,c920
>  0x0b - 0x0f     |  c906,c910,c920
>  0x10 - 0x1a     |  c910,c920
>  0x1b - 0x1c     |  c910,c920 (software defined for all >= 0x1b)
>  0x1d - 0x2a     |  c906
>
> The event ids are based on the public document of T-HEAD and cover
> the c9xx series.
>
> These events are the max that c9xx series support.
> Since T-HEAD let manufacturers decide whether events are usable,
> the final support of the perf events is determined by the pmu node
> of the soc dtb.
>
> Signed-off-by: Inochi Amaoto <inochiama@xxxxxxxxxxx>
> ---
> Change from v2:
> 1. add C906 0x07 events to the instruction.json file
> 2. fix name for events 0x07 and 0x09 in instruction.json
>
> Example:
>
> This pmu node example can be used on sophgo sg2042 platform (c920)
> with
> mainline OpenSBI.
> It should also work on T-HEAD th1520.
>
> For the one use C906 core. Only event 0x01 - 0x07, 0xb - 0xf has
> known
> CSR mapping. The other events do not have known CSR mapping in
> document
> until now.
> This pmu node needs to be shorten to adopt c906
>
> pmu {
>         compatible = "riscv,pmu";
>         riscv,event-to-mhpmcounters =
>                 // event-start event-end a bitmap of all the
> MHPMCOUNTERx
>                 <0x00006 0x00006 0x00000400>,
>                 <0x00005 0x00005 0x00000800>,
>                 <0x10000 0x10000 0x00004000>,
>                 <0x10001 0x10001 0x00008000>,
>                 <0x10002 0x10002 0x00010000>,
>                 <0x10003 0x10003 0x00020000>,
>                 <0x10008 0x10008 0x00000008>,
>                 <0x10009 0x10009 0x00000010>,
>                 <0x10010 0x10010 0x00040000>,
>                 <0x10011 0x10011 0x00080000>,
>                 <0x10012 0x10012 0x00100000>,
>                 <0x10013 0x10013 0x00200000>,
>                 <0x10019 0x10019 0x00000040>,
>                 <0x10021 0x10021 0x00000020>;
>         riscv,event-to-mhpmevent =
>                 // event-id event-selector
>                 /* mhpmevent3: L1I_READ_ACCESS */
>                 <0x10008 0x00000000 0x00000001>,
>                 /* mhpmevent4: L1I_READ_MISS */
>                 <0x10009 0x00000000 0x00000002>,
>                 /* mhpmevent5: ITLB_READ_MISS */
>                 <0x10021 0x00000000 0x00000003>,
>                 /* mhpmevent6: DTLB_READ_MISS */
>                 <0x10019 0x00000000 0x00000004>,
>                 /* mhpmevent10: PMU_HW_BRANCH_MISSES */
>                 <0x00006 0x00000000 0x00000008>,
>                 /* mhpmevent11: PMU_HW_BRANCH_INSTRUCTIONS */
>                 <0x00005 0x00000000 0x00000009>,
>                 /* mhpmevent14: L1D_READ_ACCESS */
>                 <0x10000 0x00000000 0x0000000c>,
>                 /* mhpmevent15: L1D_READ_MISS */
>                 <0x10001 0x00000000 0x0000000d>,
>                 /* mhpmevent16: L1D_WRITE_ACCESS */
>                 <0x10002 0x00000000 0x0000000e>,
>                 /* mhpmevent17: L1D_WRITE_MISS */
>                 <0x10003 0x00000000 0x0000000f>,
>                 /* mhpmevent18: LL_READ_ACCESS */
>                 <0x10010 0x00000000 0x00000010>,
>                 /* mhpmevent19: LL_READ_MISS */
>                 <0x10011 0x00000000 0x00000011>,
>                 /* mhpmevent20: LL_WRITE_ACCESS */
>                 <0x10012 0x00000000 0x00000012>,
>                 /* mhpmevent21: LL_WRITE_MISS */
>                 <0x10013 0x00000000 0x00000013>;
>         riscv,raw-event-to-mhpmcounters =
>                 /* mhpmevent3: L1 ICache Access Counter */
>                 <0x00000000 0x00000001 0xffffffff 0xffffffff
> 0x00000008>,
>                 /* mhpmevent4: L1 ICache Miss Counter */
>                 <0x00000000 0x00000002 0xffffffff 0xffffffff
> 0x00000010>,
>                 /* mhpmevent5: I-UTLB Miss Counter */
>                 <0x00000000 0x00000003 0xffffffff 0xffffffff
> 0x00000020>,
>                 /* mhpmevent6: D-UTLB Miss Counter */
>                 <0x00000000 0x00000004 0xffffffff 0xffffffff
> 0x00000040>,
>                 /* mhpmevent7: JTLB Miss */
>                 <0x00000000 0x00000005 0xffffffff 0xffffffff
> 0x00000080>,
>                 /* mhpmevent8: Conditional Branch Mispredict */
>                 <0x00000000 0x00000006 0xffffffff 0xffffffff
> 0x00000100>,
>                 /* mhpmevent9: Conditional Branch Instruction Counter
> (reserved for c910)*/
>                 /* <0x00000000 0x00000007 0xffffffff 0xffffffff
> 0x00000200>, */
>                 /* mhpmevent10: Indirect Branch Mispredict Counter */
>                 <0x00000000 0x00000008 0xffffffff 0xffffffff
> 0x00000400>,
>                 /* mhpmevent11: Indirect Branch Instruction Counter
> */
>                 <0x00000000 0x00000009 0xffffffff 0xffffffff
> 0x00000800>,
>                 /* mhpmevent12: LSU Spec Fail */
>                 <0x00000000 0x0000000a 0xffffffff 0xffffffff
> 0x00001000>,
>                 /* mhpmevent13: Store Instruction */
>                 <0x00000000 0x0000000b 0xffffffff 0xffffffff
> 0x00002000>,
>                 /* mhpmevent14: L1 DCache read access Counter */
>                 <0x00000000 0x0000000c 0xffffffff 0xffffffff
> 0x00004000>,
>                 /* mhpmevent15: L1 DCache read miss Counter */
>                 <0x00000000 0x0000000d 0xffffffff 0xffffffff
> 0x00008000>,
>                 /* mhpmevent16: L1 DCache write access Counter */
>                 <0x00000000 0x0000000e 0xffffffff 0xffffffff
> 0x00010000>,
>                 /* mhpmevent17: L1 DCache write access Counter */
>                 <0x00000000 0x0000000f 0xffffffff 0xffffffff
> 0x00020000>,
>                 /* mhpmevent18: L2 Cache read access Counter */
>                 <0x00000000 0x00000010 0xffffffff 0xffffffff
> 0x00040000>,
>                 /* mhpmevent19: L2 Cache read miss Counter */
>                 <0x00000000 0x00000011 0xffffffff 0xffffffff
> 0x00080000>,
>                 /* mhpmevent20: L2 Cache write access Counter */
>                 <0x00000000 0x00000012 0xffffffff 0xffffffff
> 0x00100000>,
>                 /* mhpmevent21: L2 Cache write miss Counter */
>                 <0x00000000 0x00000013 0xffffffff 0xffffffff
> 0x00200000>,
>                 /* mhpmevent22: RF Launch Fail */
>                 <0x00000000 0x00000014 0xffffffff 0xffffffff
> 0x00400000>,
>                 /* mhpmevent23: RF Reg Launch Fail */
>                 <0x00000000 0x00000015 0xffffffff 0xffffffff
> 0x00800000>,
>                 /* mhpmevent24: RF Instruction */
>                 <0x00000000 0x00000016 0xffffffff 0xffffffff
> 0x01000000>,
>                 /* mhpmevent25: LSU Cross 4K Stall */
>                 <0x00000000 0x00000017 0xffffffff 0xffffffff
> 0x02000000>,
>                 /* mhpmevent26: LSU Other Stall */
>                 <0x00000000 0x00000018 0xffffffff 0xffffffff
> 0x04000000>,
>                 /* mhpmevent27: LSU SQ Discard */
>                 <0x00000000 0x00000019 0xffffffff 0xffffffff
> 0x08000000>,
>                 /* mhpmevent28: LSU SQ Data Discard */
>                 <0x00000000 0x0000001a 0xffffffff 0xffffffff
> 0x10000000>;
> };
>
> ---
>  tools/perf/pmu-events/arch/riscv/mapfile.csv  |  1 +
>  .../arch/riscv/t-head/c9xx/cache.json         | 67 +++++++++++++++++
>  .../arch/riscv/t-head/c9xx/firmware.json      | 68
> ++++++++++++++++++
>  .../arch/riscv/t-head/c9xx/instruction.json   | 72
> +++++++++++++++++++
>  .../arch/riscv/t-head/c9xx/microarch.json     | 67 +++++++++++++++++
>  5 files changed, 275 insertions(+)
>  create mode 100644 tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/cache.json
>  create mode 100644 tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/firmware.json
>  create mode 100644 tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/instruction.json
>  create mode 100644 tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/microarch.json
>
> diff --git a/tools/perf/pmu-events/arch/riscv/mapfile.csv
> b/tools/perf/pmu-events/arch/riscv/mapfile.csv
> index c61b3d6ef616..dd1d998a7ad6 100644
> --- a/tools/perf/pmu-events/arch/riscv/mapfile.csv
> +++ b/tools/perf/pmu-events/arch/riscv/mapfile.csv
> @@ -15,3 +15,4 @@
>  #
>  #MVENDORID-MARCHID-MIMPID,Version,Filename,EventType
>  0x489-0x8000000000000007-0x[[:xdigit:]]+,v1,sifive/u74,core
> +0x5b7-0x0-0x0,v1,t-head/c9xx,core
> diff --git a/tools/perf/pmu-events/arch/riscv/t-head/c9xx/cache.json
> b/tools/perf/pmu-events/arch/riscv/t-head/c9xx/cache.json
> new file mode 100644
> index 000000000000..2c6e9a904a11
> --- /dev/null
> +++ b/tools/perf/pmu-events/arch/riscv/t-head/c9xx/cache.json
> @@ -0,0 +1,67 @@
> +[
> +  {
> +    "EventName": "L1_ICACHE_ACCESS",
> +    "EventCode": "0x000001",
> +    "BriefDescription": "L1 instruction cache access"
> +  },
> +  {
> +    "EventName": "L1_ICACHE_MISS",
> +    "EventCode": "0x000002",
> +    "BriefDescription": "L1 instruction cache miss"
> +  },
> +  {
> +    "EventName": "INST_TLB_MISS",
> +    "EventCode": "0x000003",
> +    "BriefDescription": "Instruction TLB (I-UTLB) miss"
> +  },
> +  {
> +    "EventName": "DATA_TLB_MISS",
> +    "EventCode": "0x000004",
> +    "BriefDescription": "Data TLB (D-UTLB) miss"
> +  },
> +  {
> +    "EventName": "JTLB_MISS",
> +    "EventCode": "0x000005",
> +    "BriefDescription": "JTLB access miss"
> +  },
> +  {
> +    "EventName": "L1_DCACHE_READ_ACCESS",
> +    "EventCode": "0x00000c",
> +    "BriefDescription": "L1 data cache read access"
> +  },
> +  {
> +    "EventName": "L1_DCACHE_READ_MISS",
> +    "EventCode": "0x00000d",
> +    "BriefDescription": "L1 data cache read miss"
> +  },
> +  {
> +    "EventName": "L1_DCACHE_WRITE_ACCESS",
> +    "EventCode": "0x00000e",
> +    "BriefDescription": "L1 data cache write access"
> +  },
> +  {
> +    "EventName": "L1_DCACHE_WRITE_MISS",
> +    "EventCode": "0x00000f",
> +    "BriefDescription": "L1 data cache write miss"
> +  },
> +  {
> +    "EventName": "L2_CACHE_READ_ACCESS",
> +    "EventCode": "0x000010",
> +    "BriefDescription": "L2 cache read access"
> +  },
> +  {
> +    "EventName": "L2_CACHE_READ_MISS",
> +    "EventCode": "0x000011",
> +    "BriefDescription": "L2 cache read miss"
> +  },
> +  {
> +    "EventName": "L2_CACHE_WRITE_ACCESS",
> +    "EventCode": "0x000012",
> +    "BriefDescription": "L2 cache write access"
> +  },
> +  {
> +    "EventName": "L2_CACHE_WRITE_MISS",
> +    "EventCode": "0x000013",
> +    "BriefDescription": "L2 cache write miss"
> +  }
> +]
> diff --git a/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/firmware.json b/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/firmware.json
> new file mode 100644
> index 000000000000..9b4a032186a7
> --- /dev/null
> +++ b/tools/perf/pmu-events/arch/riscv/t-head/c9xx/firmware.json
> @@ -0,0 +1,68 @@
> +[
> +  {
> +    "ArchStdEvent": "FW_MISALIGNED_LOAD"
> +  },
> +  {
> +    "ArchStdEvent": "FW_MISALIGNED_STORE"
> +  },
> +  {
> +    "ArchStdEvent": "FW_ACCESS_LOAD"
> +  },
> +  {
> +    "ArchStdEvent": "FW_ACCESS_STORE"
> +  },
> +  {
> +    "ArchStdEvent": "FW_ILLEGAL_INSN"
> +  },
> +  {
> +    "ArchStdEvent": "FW_SET_TIMER"
> +  },
> +  {
> +    "ArchStdEvent": "FW_IPI_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_IPI_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_FENCE_I_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_FENCE_I_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_SFENCE_VMA_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_SFENCE_VMA_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_SFENCE_VMA_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_SFENCE_VMA_ASID_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_GVMA_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_GVMA_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_GVMA_VMID_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_GVMA_VMID_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_VVMA_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_VVMA_RECEIVED"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_VVMA_ASID_SENT"
> +  },
> +  {
> +    "ArchStdEvent": "FW_HFENCE_VVMA_ASID_RECEIVED"
> +  }
> +]
> diff --git a/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/instruction.json b/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/instruction.json
> new file mode 100644
> index 000000000000..7f1649548177
> --- /dev/null
> +++ b/tools/perf/pmu-events/arch/riscv/t-head/c9xx/instruction.json
> @@ -0,0 +1,72 @@
> +[
> +  {
> +    "EventName": "BR_COND_MIS_PRED",
> +    "EventCode": "0x000006",
> +    "BriefDescription": "Conditional branch mispredict"
> +  },
> +  {
> +    "EventName": "INST_BR_COND_MIS",
> +    "EventCode": "0x000007",
> +    "BriefDescription": "Conditional branch instruction"
> +  },
> +  {
> +    "EventName": "BR_INDIRECT_MIS_PRED",
> +    "EventCode": "0x000008",
> +    "BriefDescription": "Indirect branch mispredict"
> +  },
> +  {
> +    "EventName": "INST_BR_COND_MIS",
> +    "EventCode": "0x000009",
> +    "BriefDescription": "Indirect branch instruction"
> +  },
> +  {
> +    "EventName": "INST_STORE",
> +    "EventCode": "0x00000b",
> +    "BriefDescription": "Store instruction retired"
> +  },
> +  {
> +    "EventName": "INST_ALU",
> +    "EventCode": "0x00001d",
> +    "BriefDescription": "ALU instruction retired"
> +  },
> +  {
> +    "EventName": "INST_LOAD_SAVE",
> +    "EventCode": "0x00001e",
> +    "BriefDescription": "LOAD/Store instruction retired"
> +  },
> +  {
> +    "EventName": "INST_VECTOR",
> +    "EventCode": "0x00001f",
> +    "BriefDescription": "Vector instruction retired"
> +  },
> +  {
> +    "EventName": "INST_CSR_ACCESS",
> +    "EventCode": "0x000020",
> +    "BriefDescription": "CSR access instruction retired"
> +  },
> +  {
> +    "EventName": "INST_SYNC",
> +    "EventCode": "0x000021",
> +    "BriefDescription": "Sync instruction retired"
> +  },
> +  {
> +    "EventName": "INST_LOAD_SAVE_UNALIGNED",
> +    "EventCode": "0x000022",
> +    "BriefDescription": "Load/Store unaligned access instruction
> retired"
> +  },
> +  {
> +    "EventName": "INST_ENV_CALL",
> +    "EventCode": "0x000025",
> +    "BriefDescription": "Environment call instruction retired"
> +  },
> +  {
> +    "EventName": "INST_LONGJUMP",
> +    "EventCode": "0x000026",
> +    "BriefDescription": "Long jump instruction retired (jump dist
> over 8MB)"
> +  },
> +  {
> +    "EventName": "INST_FP",
> +    "EventCode": "0x00002a",
> +    "BriefDescription": "Float point instruction retired"
> +  }
> +]
> diff --git a/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/microarch.json b/tools/perf/pmu-events/arch/riscv/t-
> head/c9xx/microarch.json
> new file mode 100644
> index 000000000000..073c1d085021
> --- /dev/null
> +++ b/tools/perf/pmu-events/arch/riscv/t-head/c9xx/microarch.json
> @@ -0,0 +1,67 @@
> +[
> +  {
> +    "EventName": "LSU_SPEC_FAIL",
> +    "EventCode": "0x00000a",
> +    "BriefDescription": "LSU Spec Fail"
> +  },
> +  {
> +    "EventName": "RF_LAUNCH_FAIL",
> +    "EventCode": "0x000014",
> +    "BriefDescription": "Register file launch fail"
> +  },
> +  {
> +    "EventName": "RF_REG_LAUNCH",
> +    "EventCode": "0x000015",
> +    "BriefDescription": "Register file reg launch"
> +  },
> +  {
> +    "EventName": "RF_INSTRUCTION",
> +    "EventCode": "0x000016",
> +    "BriefDescription": "Register file instruction"
> +  },
> +  {
> +    "EventName": "LSU_STALL_CROSS_4K",
> +    "EventCode": "0x000017",
> +    "BriefDescription": "LSU stall with cross 4K access"
> +  },
> +  {
> +    "EventName": "LSU_STALL_OTHER",
> +    "EventCode": "0x000018",
> +    "BriefDescription": "LSU stall with other events"
> +  },
> +  {
> +    "EventName": "LSU_SQ_DISCARD",
> +    "EventCode": "0x000019",
> +    "BriefDescription": "LSU SQ discard"
> +  },
> +  {
> +    "EventName": "LSU_SQ_DISCARD_DATA",
> +    "EventCode": "0x00001a",
> +    "BriefDescription": "LSU SQ data discard"
> +  },
> +  {
> +    "EventName": "INT_NUMBER",
> +    "EventCode": "0x000023",
> +    "BriefDescription": "Interrupt number respond"
> +  },
> +  {
> +    "EventName": "INT_OFF_CYCLE",
> +    "EventCode": "0x000024",
> +    "BriefDescription": "Off cycle before interrupt arbitrating"
> +  },
> +  {
> +    "EventName": "STALLED_CYCLE_IFU",
> +    "EventCode": "0x000027",
> +    "BriefDescription": "Stall cycles of the instruction fetch unit"
> +  },
> +  {
> +    "EventName": "STALLED_CYCLE_IDU",
> +    "EventCode": "0x000028",
> +    "BriefDescription": "Stall cycles of the instruction decoding
> unit and next-level pipeline unit"
> +  },
> +  {
> +    "EventName": "STALLED_CYCLE_SYNC",
> +    "EventCode": "0x000029",
> +    "BriefDescription": "Stalled cycle for sync instructions
> (FENCE/FENCE.i/SFENCE/SYNC...)"
> +  }
> +]
> --
> 2.40.1
>
>
> _______________________________________________
> linux-riscv mailing list
> linux-riscv@xxxxxxxxxxxxxxxxxxx
> http://lists.infradead.org/mailman/listinfo/linux-riscv