Base | |
Target | Fedora-30 build 10 |
Build | 1 | 7 | 8 | 9 | 10 |
Machine | 192 | 192 | 192,192 | 192,192 | 192 |
Distro | AFedora-30
|
AFedora-30
|
AFedora-30
|
AFedora-30
|
AFedora-30
|
Guest distro | DISTRO | DISTRO | DISTRO | DISTRO | DISTRO |
Runperf version | 99a5c8 | 99a5c8 | 99a5c8 | 99a5c8 | 99a5c8 |
Runperf cmd | Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
|
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
|
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
|
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
|
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
|
World env | E3Click to copy the raw python dict kernel ====== -5.6.13-100.fc30.x86_64 -#1 SMP Fri May 15 00:36:06 UTC 2020 +5.0.9-301.fc30.x86_64 +#1 SMP Tue Apr 23 23:57:35 UTC 2019 -BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet +BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet mitigations =========== -/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages -/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown -/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization +/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization -/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 |
E3Click to copy the raw python dict kernel ====== -5.6.13-100.fc30.x86_64 -#1 SMP Fri May 15 00:36:06 UTC 2020 +5.0.9-301.fc30.x86_64 +#1 SMP Tue Apr 23 23:57:35 UTC 2019 -BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet +BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet mitigations =========== -/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages -/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown -/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization +/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization -/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 |
D2Click to copy the raw python dict ,general ======= +This is a testing FILTERED value that is only present in the diff but should not be present in the RAW (click and ctrl+v) value params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 C-1Click to copy the raw python dict +World PROFILE MISSING IN SRC |
B1Click to copy the raw python dict ,general ======= +This is a testing FILTERED value that is only present in the diff but should not be present in the RAW (click and ctrl+v) value C-1Click to copy the raw python dict +World PROFILE MISSING IN SRC |
|
Localhost env | E3Click to copy the raw python dict kernel ====== -5.6.13-100.fc30.x86_64 -#1 SMP Fri May 15 00:36:06 UTC 2020 +5.0.9-301.fc30.x86_64 +#1 SMP Tue Apr 23 23:57:35 UTC 2019 -BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet +BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet mitigations =========== -/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages -/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown -/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization +/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization -/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 |
E3Click to copy the raw python dict kernel ====== -5.6.13-100.fc30.x86_64 -#1 SMP Fri May 15 00:36:06 UTC 2020 +5.0.9-301.fc30.x86_64 +#1 SMP Tue Apr 23 23:57:35 UTC 2019 -BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet +BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet mitigations =========== -/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages -/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown -/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization +/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization -/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 |
D2Click to copy the raw python dict ,params ====== -guest_cpus: 1 +guest_cpus: 3 -host_cpus: 1 +host_cpus: 3 List of missing keys ===================== -persistent MISSING IN DST C-1Click to copy the raw python dict +Localhost PROFILE MISSING IN SRC |
B1Click to copy the raw python dict ,List of missing keys ===================== -persistent MISSING IN DST C-1Click to copy the raw python dict +Localhost PROFILE MISSING IN SRC |
|
Localhost2 env | A-1Click to copy the raw python dict +Localhost2 PROFILE MISSING IN SRC |
||||
Localhost3 env | A-1Click to copy the raw python dict ,+Localhost3 PROFILE MISSING IN SRC A-1Click to copy the raw python dict +Localhost3 PROFILE MISSING IN SRC |
||||
Tests env | ATests with different params from src build: |
BTests with different params from src build: Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev |
BTests with different params from src build: Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev |
CTests with different params from src build: Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev |
DTests with different params from src build: Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev |
Failures | 5 | 5 | 9 | 6 | |
Group failures | 0 | 0 | 3 | 0 | |
Non-primary failures | 15 | 15 | 28 | 16 | |
Runtime errors | 0 | 0 | 0 | 0 | |
Total checks | 35 | 35 | 51 | 35 | |
Build score | 0 | 6 | 6 | 26 | 7 |
Test | 7 | 8 | 9 | 10 |
---|---|---|---|---|
*/fio/0000:./read-*/throughput/iops_sec.mean*/fio/0000:./read-*/throughput/iops_sec.mean |
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance |
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance |
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance |
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance |
Localhost/*/*:./*-*/*/*.meanLocalhost/*/*:./*-*/*/*.mean |
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance |
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance |
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance |
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance |
Localhost/fio/0000:./read-*/throughput/iops_sec.meanLocalhost/fio/0000:./read-*/throughput/iops_sec.mean |
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance |
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance |
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance |
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance |
Test | 7 | 8 | 9 | 10 |
---|---|---|---|---|
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean
🔧
3.6
-3.7
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params |
-1.3
GOOD model0 -1.26%, mraw0 -1.21%, raw -3.57% (179348.46/183743.17; 177181.152542373) +-5.0% tolerance
|
-6.1
SMALL model0 -6.07%, mraw0 -5.63%, raw -7.89% (179348.46/183743.17; 169245.372881356) +-5.0% tolerance
|
-20.2
SMALL model0 -20.25%, mraw0 -18.69%, raw -20.64% (179348.46/183743.17; 145825.271186441) +-5.0% tolerance
|
-8.4
🔧
SMALL raw -6.83%, avg -16.23%, n_of -5.50% GOOD model0 -4.88%, mraw0 -4.54% (179348.46/183743.17; 171197.389830508) +-5.0% tolerance
Test params differ (click to copy raw value): 0 = -runtime:60 +runtime:61 |
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev
🔧
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params |
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
🔧
GOOD raw 0.00%, avg 0.00%, n_of -0.00% (0; 0) +-10.0% tolerance
Test params differ (click to copy raw value): 0 = -runtime:60 +runtime:61 |
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean
🔧
3.6
-3.6
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean
Click to copy raw src test params |
-6.8
SMALL model0 -6.75%, mraw0 -6.14%, raw -8.70% (100482.88/103308.03; 94316.7627118644) +-5.0% tolerance
|
3.9
GOOD model0 3.94%, mraw0 3.58%, raw 0.75% (100482.88/103308.03; 104077.847457627) +-5.0% tolerance
|
2.9
GOOD model0 2.91%, mraw0 2.64%, raw -0.16% (100482.88/103308.03; 103140.627118644) +-5.0% tolerance
|
13.3
🔧
BIG model0 21.78%, mraw0 19.80%, raw 16.53%, avg 10.94% GOOD n_of 3.67% (100482.88/103308.03; 120381.830508475) +-5.0% tolerance
Test params differ (click to copy raw value): 0 = -runtime:60 +runtime:61 |
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev
🔧
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Click to copy raw src test params |
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
GOOD raw 0.00% (0; 0) +-10.0% tolerance
|
0.0
🔧
GOOD raw 0.00%, avg 0.00%, n_of -0.00% (0; 0) +-10.0% tolerance
Test params differ (click to copy raw value): 0 = -runtime:60 +runtime:61 |
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
🔧
3.6
-3.6
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
🔧
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
🔧
3.6
-3.6
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Click to copy raw src test params |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
🔧
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Click to copy raw src test params |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
-100.0
🔧
ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = -MISSING IN THIS PARAMS user0 ===== -MISSING IN THIS PARAMS |
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean
🔧
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
-100.0
🔧
ERROR Not present in source results (145825.271186441). (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = +MISSING IN SRC user0 ===== +MISSING IN SRC |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev
🔧
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
-100.0
🔧
ERROR Not present in source results (0). (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = +MISSING IN SRC user0 ===== +MISSING IN SRC |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean
🔧
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
-100.0
🔧
ERROR Not present in source results (103140.627118644). (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = +MISSING IN SRC user0 ===== +MISSING IN SRC |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev
🔧
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |
-100.0
🔧
ERROR Not present in source results (0). (0; -100) +-1% tolerance
Test params differ (click to copy raw value): 0 = +MISSING IN SRC user0 ===== +MISSING IN SRC |
NA
🔧
Unknown
Test params differ (click to copy raw value): NA |