Re: [PATCH 6.0 000/240] 6.0.7-rc1 review
From: Naresh Kamboju
Date: Wed Nov 02 2022 - 14:27:09 EST
Results from Linaro’s test farm.
No regressions on arm64, arm, x86_64, and i386.
Tested-by: Linux Kernel Functional Testing <lkft@xxxxxxxxxx>
NOTE:
We LKFT running same test suites on multiple configurations builds
on latest toolchains and on real hardware and qemu 's.
Because of the above reason we have been finding mixed results.
For example, Due to the slowness of the qemu few tests got timeout
but the same test passed on real hardware.
* qemu-arm64-gcc-12-lkftconfig-debug-kmemleak, ltp-cve
- cve-2017-15299
- cve-2017-15951
tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
request_key03.c:59: TCONF: kernel doesn't support key type 'encrypted'
request_key03.c:59: TCONF: kernel doesn't support key type 'trusted'
<47>[ 759.437664] systemd-journald[212]: Sent WATCHDOG=1 notification.
request_key03.c:135: TPASS: didn't crash while updating key of type 'user'
<47>[ 869.408908] systemd-journald[212]: Sent WATCHDOG=1 notification.
Test timeouted, sending SIGKILL!
tst_test.c:1569: TINFO: Killed the leftover descendant processes
tst_test.c:1575: TINFO: If you are running on slow machine, try
exporting LTP_TIMEOUT_MUL > 1
tst_test.c:1577: TBROK: Test killed! (timeout?)
- cve-2020-25705
tst_kconfig.c:82: TINFO: Parsing kernel config '/proc/config.gz'
tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
<6>[ 1826.776891] IPv6: ADDRCONF(NETDEV_CHANGE): ltp_veth1: link
becomes ready
<6>[ 1826.781937] IPv6: ADDRCONF(NETDEV_CHANGE): ltp_veth2: link
becomes ready
icmp_rate_limit01.c:230: TINFO: Batch 0: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 1: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 2: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 3: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 4: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 5: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 6: Got 100 ICMP errors
icmp_rate_limit01.c:234: TINFO: Batch 7: Got 100 ICMP errors
icmp_rate_limit01.c:238: TFAIL: ICMP rate limit not randomized,
system is vulnerable
HINT: You _MAY_ be missing kernel fixes:
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=b38e7819cae9
HINT: You _MAY_ be vulnerable to CVE(s):
https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-25705
Summary:
passed 0
failed 1
[1] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12807800/suite/ltp-cve/test/cve-2017-15299/details/
[2] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12807800/suite/ltp-cve/test/cve-2017-15299/log
* qemu-arm64-64k-page-size, ltp-hugetlb
- hugemmap05
- hugemmap05_1
- hugemmap05_2
- hugemmap05_3
All these test failed due to ENOMEM.
hugemmap05.c:83: TBROK: mmap((nil),1610612736,3,1,3,0) failed:
ENOMEM (12)
hugemmap05.c:83: TBROK: mmap((nil),1610612736,3,1,3,0) failed:
ENOMEM (12)
These failures only seen on qemu-arm64 but test passed on
bcm2711-rpi-4-b-64k_page_size device with same config.
[3] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12807533/suite/ltp-hugetlb/test/hugemmap05/log
[4] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12807533/suite/ltp-hugetlb/test/hugemmap05/details/
* qemu-arm64-clang-15-lkftconfig, ltp-syscalls
- add_key05
add_key05.c:136: TFAIL: max used bytes 19991, key allow max bytes 20000
- futex_cmp_requeue01
futex_cmp_requeue01.c:68: TFAIL: process 89996 wasn't woken up:
ETIMEDOUT (110)
[5] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12808167/suite/ltp-syscalls/test/add_key05/log
* qemu-arm64-gcc-12-lkftconfig-debug-kmemleak, ltp-syscalls
- request_key03
tst_test.c:1524: TINFO: Timeout per run is 0h 02m 30s
request_key03.c:59: TCONF: kernel doesn't support key type 'encrypted'
request_key03.c:59: TCONF: kernel doesn't support key type 'trusted'
<47>[ 4891.998441] systemd-journald[211]: Sent WATCHDOG=1 notification.
request_key03.c:135: TPASS: didn't crash while updating key of type 'user'
Test timeouted, sending SIGKILL!
tst_test.c:1569: TINFO: Killed the leftover descendant processes
tst_test.c:1575: TINFO: If you are running on slow machine, try
exporting LTP_TIMEOUT_MUL > 1
tst_test.c:1577: TBROK: Test killed! (timeout?)
[6] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12810384/suite/ltp-syscalls/test/request_key03/log
* qemu-i386, ltp-fs_bind
- fs_bind_rbind07_sh
fs_bind_rbind07 1 TPASS: umount share2 passed as expected
umount: /scratch/ltp-BdrYN1uDRZ/LTP_fs_bind_rbind07.R6J2DAH7FB/sandbox/parent2:
target is busy.
fs_bind_rbind07 1 TFAIL: umount parent2 failed unexpectedly
fs_bind_rbind07 1 TPASS: umount parent2 passed as expected
fs_bind_rbind07 1 TPASS: umount parent1 passed as expected
fs_bind_rbind07 1 TFAIL: There are still mounts in the sandbox:\nparent2
[7] https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780/testrun/12808354/suite/ltp-fs_bind/test/fs_bind_rbind07_sh/log
## Build
* kernel: 6.0.7-rc1
* git: https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable-rc
* git branch: linux-6.0.y
* git commit: 436175d0f780af8302164b3102ecf0ff99f7a376
* git describe: v6.0.6-241-g436175d0f780
* test details:
https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-6.0.y/build/v6.0.6-241-g436175d0f780
## No Test Regressions (compared to v6.0.5-94-gd5a53a666fb9)
## No Metric Regressions (compared to v6.0.5-94-gd5a53a666fb9)
## No Test Fixes (compared to v6.0.5-94-gd5a53a666fb9)
## No Metric Fixes (compared to v6.0.5-94-gd5a53a666fb9)
## Test result summary
total: 160584, pass: 131298, fail: 11489, skip: 17432, xfail: 365
## Build Summary
* arc: 5 total, 5 passed, 0 failed
* arm: 149 total, 146 passed, 3 failed
* arm64: 47 total, 47 passed, 0 failed
* i386: 37 total, 36 passed, 1 failed
* mips: 27 total, 26 passed, 1 failed
* parisc: 6 total, 6 passed, 0 failed
* powerpc: 34 total, 30 passed, 4 failed
* riscv: 12 total, 12 passed, 0 failed
* s390: 12 total, 12 passed, 0 failed
* sh: 12 total, 12 passed, 0 failed
* sparc: 6 total, 6 passed, 0 failed
* x86_64: 40 total, 40 passed, 0 failed
## Test suites summary
* fwts
* igt-gpu-tools
* kselftest-android
* kselftest-arm64
* kselftest-arm64/arm64.btitest.bti_c_func
* kselftest-arm64/arm64.btitest.bti_j_func
* kselftest-arm64/arm64.btitest.bti_jc_func
* kselftest-arm64/arm64.btitest.bti_none_func
* kselftest-arm64/arm64.btitest.nohint_func
* kselftest-arm64/arm64.btitest.paciasp_func
* kselftest-arm64/arm64.nobtitest.bti_c_func
* kselftest-arm64/arm64.nobtitest.bti_j_func
* kselftest-arm64/arm64.nobtitest.bti_jc_func
* kselftest-arm64/arm64.nobtitest.bti_none_func
* kselftest-arm64/arm64.nobtitest.nohint_func
* kselftest-arm64/arm64.nobtitest.paciasp_func
* kselftest-breakpoints
* kselftest-capabilities
* kselftest-cgroup
* kselftest-clone3
* kselftest-core
* kselftest-cpu-hotplug
* kselftest-cpufreq
* kselftest-drivers-dma-buf
* kselftest-efivarfs
* kselftest-filesystems
* kselftest-filesystems-binderfs
* kselftest-firmware
* kselftest-fpu
* kselftest-futex
* kselftest-gpio
* kselftest-intel_pstate
* kselftest-ipc
* kselftest-ir
* kselftest-kcmp
* kselftest-kexec
* kselftest-kvm
* kselftest-lib
* kselftest-livepatch
* kselftest-membarrier
* kselftest-memfd
* kselftest-memory-hotplug
* kselftest-mincore
* kselftest-mount
* kselftest-mqueue
* kselftest-net
* kselftest-net-forwarding
* kselftest-net-mptcp
* kselftest-netfilter
* kselftest-nsfs
* kselftest-openat2
* kselftest-pid_namespace
* kselftest-pidfd
* kselftest-proc
* kselftest-pstore
* kselftest-ptrace
* kselftest-rseq
* kselftest-rtc
* kselftest-seccomp
* kselftest-sigaltstack
* kselftest-size
* kselftest-splice
* kselftest-static_keys
* kselftest-sync
* kselftest-sysctl
* kselftest-tc-testing
* kselftest-timens
* kselftest-timers
* kselftest-tmpfs
* kselftest-tpm2
* kselftest-user
* kselftest-vm
* kselftest-x86
* kselftest-zram
* kunit
* kvm-unit-tests
* libgpiod
* libhugetlbfs
* log-parser-boot
* log-parser-test
* ltp-cap_bounds
* ltp-commands
* ltp-containers
* ltp-controllers
* ltp-cpuhotplug
* ltp-crypto
* ltp-cve
* ltp-dio
* ltp-fcntl-locktests
* ltp-filecaps
* ltp-fs
* ltp-fs_bind
* ltp-fs_perms_simple
* ltp-fsx
* ltp-hugetlb
* ltp-io
* ltp-ipc
* ltp-math
* ltp-mm
* ltp-nptl
* ltp-open-posix-tests
* ltp-pty
* ltp-sched
* ltp-securebits
* ltp-smoke
* ltp-syscalls
* ltp-tracing
* network-basic-tests
* perf
* perf/Zstd-perf.data-compression
* rcutorture
* v4l2-compliance
* vdso
--
Linaro LKFT
https://lkft.linaro.org