DIskless Nodes low Read Performance

LINBIT SDS Integrations Proxmox VE
1 
net {
            max-epoch-size      20000;
            sndbuf-size         8388608; # bytes
            rcvbuf-size         8388608; # bytes
            allow-two-primaries yes;
            cram-hmac-alg       "sha1";
            shared-secret       "ngo7SuWAGve9dY7Psby6";
            verify-alg          "sha256";
            max-buffers         30000;
            _name               "k94cs-prxmx04";
        }
        volume 0 {
            disk {
                c-fill-target           24414s; # bytes
                c-max-rate              3194304k; # bytes/second
                bitmap                  no;

On Diskfull Node:

/dev/vda:
 Timing O_DIRECT cached reads:   6056 MB in  2.00 seconds = 3030.96 MB/sec
 Timing O_DIRECT disk reads: 10556 MB in  3.00 seconds = 3518.63 MB/sec
root@k94cs-test01:/test# hdparm -Tt --direct /dev/vda

move to diskless Node:

/dev/vda:
 Timing O_DIRECT cached reads:   3078 MB in  2.00 seconds = 1539.05 MB/sec
 Timing O_DIRECT disk reads: 5046 MB in  3.00 seconds = 1681.58 MB/sec

Im Using Linstor on Proxmox

1 Like
2

/dev/vda:
Timing O_DIRECT cached reads: 3078 MB in 2.00 seconds = 1539.05 MB/sec
Timing O_DIRECT disk reads: 5046 MB in 3.00 seconds = 1681.58 MB/sec

Is this a 10Gbps network? Those speeds are suspiciously close to 10Gbps.

3

its a bonded 100gb dual port nic. Throughput ist single flow 40gb, multi flow 196gb