Comparison of build 1 and 10 (Fedora-30 and Fedora-30 )

Base
Target Fedora-30 build 10
Build 1 7 8 9 10
Machine 192 192 192,192 192,192 192
Distro
AFedora-30
AFedora-30
AFedora-30
AFedora-30
AFedora-30
Guest distro DISTRO DISTRO DISTRO DISTRO DISTRO
Runperf version 99a5c8 99a5c8 99a5c8 99a5c8 99a5c8
Runperf cmd
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
Ascripts/run-perf -vvv --hosts foo:192.168.122.162 --distro DISTRO --default-password MASKED --metadata MASKED --profiles Localhost --paths ../runperf_config/ -- fio:{"type":"read", "ramptime":"10", "runtime":"60", "samples":"1", "file-size": "1300000", "targets": "/fio"}
World env
E3Click to copy the raw python dict
kernel
======
-5.6.13-100.fc30.x86_64
-#1 SMP Fri May 15 00:36:06 UTC 2020
+5.0.9-301.fc30.x86_64
+#1 SMP Tue Apr 23 23:57:35 UTC 2019
-BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet
+BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet

mitigations
===========
-/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages
-/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown
-/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization
+/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization
-/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown

params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3
E3Click to copy the raw python dict
kernel
======
-5.6.13-100.fc30.x86_64
-#1 SMP Fri May 15 00:36:06 UTC 2020
+5.0.9-301.fc30.x86_64
+#1 SMP Tue Apr 23 23:57:35 UTC 2019
-BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet
+BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet

mitigations
===========
-/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages
-/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown
-/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization
+/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization
-/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown

params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3
D2Click to copy the raw python dict
general
=======
+This is a testing FILTERED value that is only present in the diff but should not be present in the RAW (click and ctrl+v) value

params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3
,
C-1Click to copy the raw python dict
+World PROFILE MISSING IN SRC
B1Click to copy the raw python dict
general
=======
+This is a testing FILTERED value that is only present in the diff but should not be present in the RAW (click and ctrl+v) value
,
C-1Click to copy the raw python dict
+World PROFILE MISSING IN SRC
Localhost env
E3Click to copy the raw python dict
kernel
======
-5.6.13-100.fc30.x86_64
-#1 SMP Fri May 15 00:36:06 UTC 2020
+5.0.9-301.fc30.x86_64
+#1 SMP Tue Apr 23 23:57:35 UTC 2019
-BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet
+BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet

mitigations
===========
-/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages
-/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown
-/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization
+/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization
-/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown

params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3
E3Click to copy the raw python dict
kernel
======
-5.6.13-100.fc30.x86_64
-#1 SMP Fri May 15 00:36:06 UTC 2020
+5.0.9-301.fc30.x86_64
+#1 SMP Tue Apr 23 23:57:35 UTC 2019
-BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.6.13-100.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet
+BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.0.9-301.fc30.x86_64 root=/dev/mapper/fedora-root ro resume=/dev/mapper/fedora-swap rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap quiet

mitigations
===========
-/sys/devices/system/cpu/vulnerabilities/itlb_multihit:KVM: Mitigation: Split huge pages
-/sys/devices/system/cpu/vulnerabilities/mds:Mitigation: Clear CPU buffers; SMT Host state unknown
-/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: usercopy/swapgs barriers and __user pointer sanitization
+/sys/devices/system/cpu/vulnerabilities/spectre_v1:Mitigation: __user pointer sanitization
-/sys/devices/system/cpu/vulnerabilities/tsx_async_abort:Mitigation: Clear CPU buffers; SMT Host state unknown

params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3
D2Click to copy the raw python dict
params
======
-guest_cpus: 1
+guest_cpus: 3
-host_cpus: 1
+host_cpus: 3

List of missing keys
=====================
-persistent MISSING IN DST
,
C-1Click to copy the raw python dict
+Localhost PROFILE MISSING IN SRC
B1Click to copy the raw python dict
List of missing keys
=====================
-persistent MISSING IN DST
,
C-1Click to copy the raw python dict
+Localhost PROFILE MISSING IN SRC
Localhost2 env
A-1Click to copy the raw python dict
+Localhost2 PROFILE MISSING IN SRC
Localhost3 env
A-1Click to copy the raw python dict
+Localhost3 PROFILE MISSING IN SRC
,
A-1Click to copy the raw python dict
+Localhost3 PROFILE MISSING IN SRC
Tests env
ATests with different params from src build:
BTests with different params from src build:
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
BTests with different params from src build:
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
CTests with different params from src build:
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
DTests with different params from src build:
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Failures 5 5 9 6
Group failures 0 0 3 0
Non-primary failures 15 15 28 16
Runtime errors 0 0 0 0
Total checks 35 35 51 35
Build score 0 6 6 26 7

Group stats

[-]
This build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
Any build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
types: MEAN STDDEV
Test 7 8 9 10
*/fio/0000:./read-*/throughput/iops_sec.mean*/fio/0000:./read-*/throughput/iops_sec.mean
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance
Localhost/*/*:./*-*/*/*.meanLocalhost/*/*:./*-*/*/*.mean
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance
Localhost/fio/0000:./read-*/throughput/iops_sec.meanLocalhost/fio/0000:./read-*/throughput/iops_sec.mean
-4.0GOOD raw -4.01% (-4.01; -4.005453993002888) +-5.75% tolerance
-1.1GOOD raw -1.07% (-1.07; -1.0650041317484664) +-5.75% tolerance
-8.7SMALL raw -8.67% (-8.67; -8.667814451256838) +-5.75% tolerance
-1.3GOOD raw 2.43%, avg -5.65%, n_of -2.11% (2.43; 2.432125293674612) +-5.75% tolerance

Failures

[-]
This build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
Any build status: equals minor gains minor losses skips losses gains errors +good -good +bad -bad
profiles: * LOCALHOST LOCALHOST2 LOCALHOST3
tests: FIO
types: MEAN STDDEV
Test 7 8 9 10
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean 🔧 3.6 -3.7 Localhost/fio/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params
-1.3 GOOD model0 -1.26%, mraw0 -1.21%, raw -3.57% (179348.46/183743.17; 177181.152542373) +-5.0% tolerance
-6.1 SMALL model0 -6.07%, mraw0 -5.63%, raw -7.89% (179348.46/183743.17; 169245.372881356) +-5.0% tolerance
-20.2 SMALL model0 -20.25%, mraw0 -18.69%, raw -20.64% (179348.46/183743.17; 145825.271186441) +-5.0% tolerance
-8.4 🔧 SMALL raw -6.83%, avg -16.23%, n_of -5.50% GOOD model0 -4.88%, mraw0 -4.54% (179348.46/183743.17; 171197.389830508) +-5.0% tolerance
Test params differ (click to copy raw value):
0
=
-runtime:60
+runtime:61
Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev 🔧 Localhost/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 🔧 GOOD raw 0.00%, avg 0.00%, n_of -0.00% (0; 0) +-10.0% tolerance
Test params differ (click to copy raw value):
0
=
-runtime:60
+runtime:61
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean 🔧 3.6 -3.6 Localhost/fio/0000:./read-64KiB/throughput/iops_sec.mean
Click to copy raw src test params
-6.8 SMALL model0 -6.75%, mraw0 -6.14%, raw -8.70% (100482.88/103308.03; 94316.7627118644) +-5.0% tolerance
3.9 GOOD model0 3.94%, mraw0 3.58%, raw 0.75% (100482.88/103308.03; 104077.847457627) +-5.0% tolerance
2.9 GOOD model0 2.91%, mraw0 2.64%, raw -0.16% (100482.88/103308.03; 103140.627118644) +-5.0% tolerance
13.3 🔧 BIG model0 21.78%, mraw0 19.80%, raw 16.53%, avg 10.94% GOOD n_of 3.67% (100482.88/103308.03; 120381.830508475) +-5.0% tolerance
Test params differ (click to copy raw value):
0
=
-runtime:60
+runtime:61
Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev 🔧 Localhost/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Click to copy raw src test params
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 GOOD raw 0.00% (0; 0) +-10.0% tolerance
0.0 🔧 GOOD raw 0.00%, avg 0.00%, n_of -0.00% (0; 0) +-10.0% tolerance
Test params differ (click to copy raw value):
0
=
-runtime:60
+runtime:61
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean 🔧 3.6 -3.6 Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev 🔧 Localhost2/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean 🔧 3.6 -3.6 Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.mean
Click to copy raw src test params
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev 🔧 Localhost2/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Click to copy raw src test params
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
-100.0 🔧 ERROR Not present in target results (-100) (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
-MISSING IN THIS PARAMS
user0
=====
-MISSING IN THIS PARAMS
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean 🔧 Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.mean
Test params differ (click to copy raw value):
NA
-100.0 🔧 ERROR Not present in source results (145825.271186441). (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
+MISSING IN SRC
user0
=====
+MISSING IN SRC
Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev 🔧 Localhost3/fio/0000:./read-4KiB/throughput/iops_sec.stddev
Test params differ (click to copy raw value):
NA
-100.0 🔧 ERROR Not present in source results (0). (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
+MISSING IN SRC
user0
=====
+MISSING IN SRC
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean 🔧 Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.mean
Test params differ (click to copy raw value):
NA
-100.0 🔧 ERROR Not present in source results (103140.627118644). (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
+MISSING IN SRC
user0
=====
+MISSING IN SRC
Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev 🔧 Localhost3/fio/0000:./read-64KiB/throughput/iops_sec.stddev
Test params differ (click to copy raw value):
NA
-100.0 🔧 ERROR Not present in source results (0). (0; -100) +-1% tolerance
Test params differ (click to copy raw value):
0
=
+MISSING IN SRC
user0
=====
+MISSING IN SRC

Details

[+]

Charts

[-]

Overall mean

[-]

Overall stddev

[-]

Same profile means

[-]



Same test suite means

[-]



Same test (different params)

[-]