Comparison of build 6b5 and bb4 (RHEL-8.4.0-20210503.1 and RHEL-8.4.0-20210503.1 )

Base
Target RHEL-8.4.0-20210503.1 build bb4
Build 6b5 ff8 ba0 096 558 485 0c8 fce bb4
Machine worker1 worker1 worker1 worker1 worker1 worker1 worker1 worker1 worker1
Distro
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
ARHEL-8.4.0-20210503.1
Guest distro DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO DISTRO
Runperf version 1.0.19 1.0.19 1.0.19 1.0.19 1.0.19 1.0.19 1.0.19 1.0.19 1.0.19
Runperf cmd
Iscripts/run-perf --host-setup-script sha1:f48f03 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Hscripts/run-perf --host-setup-script sha1:9e8870 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Gscripts/run-perf --host-setup-script sha1:648735 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Fscripts/run-perf --host-setup-script sha1:3e780c --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Escripts/run-perf --host-setup-script sha1:2aeb8c --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Dscripts/run-perf --host-setup-script sha1:4f4507 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Cscripts/run-perf --host-setup-script sha1:36926c --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Bscripts/run-perf --host-setup-script sha1:7e3ad8 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
Ascripts/run-perf --host-setup-script sha1:0ef888 --host-setup-script-reboot --worker-setup-script sha1:254bdf -vvv --hosts worker1.REDHAT --distro DISTRO --provisioner Beaker --default-password MASKED MASKED --profiles Localhost --paths ./downstream_config --metadata MASKED MASKED MASKED MASKED MASKED --output .diff-perf//current-result -- fio-nbd:{"runtime": "180", "block-sizes": "4,1024", "test-types": "read,write", "samples": "3"}
World env
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

    

        Localhost env
        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

        
A0Click to copy the raw python dict

    

    

        Tests env
        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

        
ATests with different params from src build:

    

    

        Failures
        
        0
        2
        2
        2
        2
        2
        2
        2
    

    

        Group failures
        
        0
        0
        3
        3
        3
        3
        3
        3
    

    

        Non-primary failures
        
        0
        0
        9
        8
        8
        8
        8
        8
    

        Total checks
        
        37
        37
        37
        37
        37
        37
        37
        37
    

    

        Build score
        0
        0
        2
        17
        17
        17
        17
        17
        17
    





Group stats

[-]




    This build status: 
    equals
    minor gains
    minor losses
    skips
    losses
    gains
    errors
    +good
    -good
    +bad
    -bad
    

    Any build status: 
    equals
    minor gains
    minor losses
    skips
    losses
    gains
    errors
    +good
    -good
    +bad
    -bad
    

    types: 
    MEAN
    STDDEV

    

    

        Test
        ff8

        ba0

        096

        558

        485

        0c8

        fce

        bb4

    

    

        
*/fio-nbd/0000:./read-*/throughput/iops_sec.mean*/fio-nbd/0000:./read-*/throughput/iops_sec.mean

        
-0.3GOOD raw -0.32% (-0.32; -0.31647907703414563) +-5.75% tolerance

        
-4.8GOOD raw -4.85% (-4.85; -4.849274288825097) +-5.75% tolerance

        
-0.5GOOD raw -0.55% (-0.55; -0.5451111492125473) +-5.75% tolerance

        
-1.5GOOD raw -1.46% (-1.46; -1.4597293489759795) +-5.75% tolerance

        
-0.7GOOD raw -0.73% (-0.73; -0.7281856833618977) +-5.75% tolerance

        
-0.1GOOD raw -0.11% (-0.11; -0.11450758571709027) +-5.75% tolerance

        
-0.4GOOD raw -0.40% (-0.40; -0.40115964926559483) +-5.75% tolerance

        
-2.3GOOD raw -2.01%, avg -2.61% (-2.01; -2.0084911799996545) +-5.75% tolerance

    

    

        
*/fio-nbd/0000:./write-*/throughput/iops_sec.mean*/fio-nbd/0000:./write-*/throughput/iops_sec.mean

        
-1.1GOOD raw -1.14% (-1.14; -1.1354802961306834) +-5.75% tolerance

        
0.8GOOD raw 0.77% (0.77; 0.773707619711763) +-5.75% tolerance

        
1231.2BIG raw 1231.18% (1231.18; 1231.1837123438604) +-5.75% tolerance

        
1226.3BIG raw 1226.35% (1226.35; 1226.345883474391) +-5.75% tolerance

        
1235.9BIG raw 1235.93% (1235.93; 1235.9259998094826) +-5.75% tolerance

        
1243.5BIG raw 1243.46% (1243.46; 1243.4580154713244) +-5.75% tolerance

        
1215.8BIG raw 1215.81% (1215.81; 1215.805101353472) +-5.75% tolerance

        
1728.4BIG raw 1534.93%, avg 1921.82% (1534.93; 1534.9329004439182) +-5.75% tolerance

    

    

        
Localhost/*/*:./*-*/*/*.meanLocalhost/*/*:./*-*/*/*.mean

        
-0.7GOOD raw -0.73% (-0.73; -0.7259796865824146) +-3.5% tolerance

        
-2.0GOOD raw -2.04% (-2.04; -2.037783334556667) +-3.5% tolerance

        
615.3BIG raw 615.32% (615.32; 615.319300597324) +-3.5% tolerance

        
612.4BIG raw 612.44% (612.44; 612.4430770627075) +-3.5% tolerance

        
617.6BIG raw 617.60% (617.60; 617.5989070630604) +-3.5% tolerance

        
621.7BIG raw 621.67% (621.67; 621.6717539428037) +-3.5% tolerance

        
607.7BIG raw 607.70% (607.70; 607.7019708521033) +-3.5% tolerance

        
863.0BIG raw 766.46%, avg 959.61% (766.46; 766.4622046319593) +-3.5% tolerance

    

    

        
Localhost/fio-nbd/0000:./read-*/throughput/iops_sec.meanLocalhost/fio-nbd/0000:./read-*/throughput/iops_sec.mean

        
-0.3GOOD raw -0.32% (-0.32; -0.31647907703414563) +-5.75% tolerance

        
-4.8GOOD raw -4.85% (-4.85; -4.849274288825097) +-5.75% tolerance

        
-0.5GOOD raw -0.55% (-0.55; -0.5451111492125473) +-5.75% tolerance

        
-1.5GOOD raw -1.46% (-1.46; -1.4597293489759795) +-5.75% tolerance

        
-0.7GOOD raw -0.73% (-0.73; -0.7281856833618977) +-5.75% tolerance

        
-0.1GOOD raw -0.11% (-0.11; -0.11450758571709027) +-5.75% tolerance

        
-0.4GOOD raw -0.40% (-0.40; -0.40115964926559483) +-5.75% tolerance

        
-2.3GOOD raw -2.01%, avg -2.61% (-2.01; -2.0084911799996545) +-5.75% tolerance

    

    

        
Localhost/fio-nbd/0000:./write-*/throughput/iops_sec.meanLocalhost/fio-nbd/0000:./write-*/throughput/iops_sec.mean

        
-1.1GOOD raw -1.14% (-1.14; -1.1354802961306834) +-5.75% tolerance

        
0.8GOOD raw 0.77% (0.77; 0.773707619711763) +-5.75% tolerance

        
1231.2BIG raw 1231.18% (1231.18; 1231.1837123438604) +-5.75% tolerance

        
1226.3BIG raw 1226.35% (1226.35; 1226.345883474391) +-5.75% tolerance

        
1235.9BIG raw 1235.93% (1235.93; 1235.9259998094826) +-5.75% tolerance

        
1243.5BIG raw 1243.46% (1243.46; 1243.4580154713244) +-5.75% tolerance

        
1215.8BIG raw 1215.81% (1215.81; 1215.805101353472) +-5.75% tolerance

        
1728.4BIG raw 1534.93%, avg 1921.82% (1534.93; 1534.9329004439182) +-5.75% tolerance

    

    





Failures

[-]




    This build status: 
    equals
    minor gains
    minor losses
    skips
    losses
    gains
    errors
    +good
    -good
    +bad
    -bad
    

    Any build status: 
    equals
    minor gains
    minor losses
    skips
    losses
    gains
    errors
    +good
    -good
    +bad
    -bad
    

    profiles: 
    *
    LOCALHOST

    tests: 
    FIO-NBD

    types: 
    MEAN
    STDDEV

    

    

        Test
        ff8

        ba0

        096

        558

        485

        0c8

        fce

        bb4

    

    

        
Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.mean
Click to copy raw src test params

        
0.5GOOD raw 0.53% (22570; 22690) +-5% tolerance

        
-8.6SMALL raw -8.64% (22570; 20620) +-5% tolerance

        
0.9GOOD raw 0.89% (22570; 22770) +-5% tolerance

        
0.2GOOD raw 0.22% (22570; 22620) +-5% tolerance

        
-0.1GOOD raw -0.13% (22570; 22540) +-5% tolerance

        
0.1GOOD raw 0.09% (22570; 22590) +-5% tolerance

        
0.1GOOD raw 0.13% (22570; 22600) +-5% tolerance

        
-0.8GOOD raw 0.04%, avg -1.72% (22570; 22580) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./read-1024KiB/throughput/iops_sec.stddev
Click to copy raw src test params

        
-0.5GOOD raw -0.45% (0.19; 0.6414) +-5% tolerance

        
-12.6SMALL raw -12.63% (0.19; 12.82) +-5% tolerance

        
-0.2GOOD raw -0.22% (0.19; 0.4133) +-5% tolerance

        
-0.1GOOD raw -0.07% (0.19; 0.2597) +-5% tolerance

        
0.0GOOD raw 0.03% (0.19; 0.1544) +-5% tolerance

        
0.2GOOD raw 0.17% (0.19; 0.02033) +-5% tolerance

        
-0.2GOOD raw -0.17% (0.19; 0.3632) +-5% tolerance

        
-1.7GOOD raw -0.09%, avg -3.36% (0.19; 0.2799) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.mean
Click to copy raw src test params

        
-1.2GOOD raw -1.16% (566700; 560100) +-5% tolerance

        
-1.1GOOD raw -1.06% (566700; 560700) +-5% tolerance

        
-2.0GOOD raw -1.98% (566700; 555500) +-5% tolerance

        
-3.1GOOD raw -3.14% (566700; 548900) +-5% tolerance

        
-1.3GOOD raw -1.32% (566700; 559200) +-5% tolerance

        
-0.3GOOD raw -0.32% (566700; 564900) +-5% tolerance

        
-0.9GOOD raw -0.94% (566700; 561400) +-5% tolerance

        
-3.2GOOD raw -3.11%, avg -3.26% (566700; 549100) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./read-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params

        
-0.3GOOD raw -0.27% (1.50; 1.771) +-5% tolerance

        
0.3GOOD raw 0.33% (1.50; 1.163) +-5% tolerance

        
0.9GOOD raw 0.87% (1.50; 0.6232) +-5% tolerance

        
1.2GOOD raw 1.17% (1.50; 0.3261) +-5% tolerance

        
0.3GOOD raw 0.29% (1.50; 1.206) +-5% tolerance

        
0.7GOOD raw 0.70% (1.50; 0.8006) +-5% tolerance

        
0.4GOOD raw 0.36% (1.50; 1.134) +-5% tolerance

        
1.0GOOD raw 0.97%, avg 1.10% (1.50; 0.526) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.mean
Click to copy raw src test params

        
-1.2GOOD raw -1.20% (440.30; 435) +-5% tolerance

        
1.5GOOD raw 1.48% (440.30; 446.8) +-5% tolerance

        
1640.6BIG raw 1640.63% (440.30; 7664) +-5% tolerance

        
1628.8BIG raw 1628.82% (440.30; 7612) +-5% tolerance

        
1643.4BIG raw 1643.36% (440.30; 7676) +-5% tolerance

        
1651.3BIG raw 1651.31% (440.30; 7711) +-5% tolerance

        
1620.2BIG raw 1620.19% (440.30; 7574) +-5% tolerance

        
2033.7BIG raw 1617.01%, avg 2450.40% (440.30; 7560) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./write-1024KiB/throughput/iops_sec.stddev
Click to copy raw src test params

        
-0.0GOOD raw -0.01% (0.06; 0.0683) +-5% tolerance

        
0.0GOOD raw 0.02% (0.06; 0.04325) +-5% tolerance

        
-3.0GOOD raw -3.01% (0.06; 3.07) +-5% tolerance

        
-3.3GOOD raw -3.28% (0.06; 3.345) +-5% tolerance

        
-1.1GOOD raw -1.13% (0.06; 1.195) +-5% tolerance

        
-1.4GOOD raw -1.42% (0.06; 1.485) +-5% tolerance

        
-1.4GOOD raw -1.38% (0.06; 1.439) +-5% tolerance

        
-2.8GOOD raw -2.41%, avg -3.16% (0.06; 2.477) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.mean🔧Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.mean
Click to copy raw src test params

        
-1.1GOOD raw -1.07% (28110; 27810) +-5% tolerance

        
0.1GOOD raw 0.07% (28110; 28130) +-5% tolerance

        
821.7BIG raw 821.74% (28110; 259100) +-5% tolerance

        
823.9BIG raw 823.87% (28110; 259700) +-5% tolerance

        
828.5BIG raw 828.50% (28110; 261000) +-5% tolerance

        
835.6BIG raw 835.61% (28110; 263000) +-5% tolerance

        
811.4BIG raw 811.42% (28110; 256200) +-5% tolerance

        
1036.2BIG raw 833.83%, avg 1238.49% (28110; 262500) +-5% tolerance

    

    

        
Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.stddev🔧Localhost/fio-nbd/0000:./write-4KiB/throughput/iops_sec.stddev
Click to copy raw src test params

        
1.9GOOD raw 1.91% (3.12; 1.216) +-5% tolerance

        
1.3GOOD raw 1.33% (3.12; 1.796) +-5% tolerance

        
3.0GOOD raw 2.97% (3.12; 0.1503) +-5% tolerance

        
2.5GOOD raw 2.46% (3.12; 0.6634) +-5% tolerance

        
2.9GOOD raw 2.92% (3.12; 0.2027) +-5% tolerance

        
2.7GOOD raw 2.71% (3.12; 0.4102) +-5% tolerance

        
2.3GOOD raw 2.32% (3.12; 0.7997) +-5% tolerance

        
3.6GOOD raw 2.42%, avg 4.76% (3.12; 0.7037) +-5% tolerance

    

    





Details

[+]