Set DRBD replica via 10Gbit network

LINSTOR
,
1

Hello everyone. I’ve set up 2node PVE with HA linstor DB. In addition 3rd server incl. corosync called pve-backup. Both nodes has 2nd network.

image
image1280×554 24.7 KB

Is it possible with this installation set the DRBD replica through this cross cable replica?

I tried:
set up network in PVE (both networks ping each other)
set up 2nd ETH in Controller
set up in Resource group with param pref.Nic but after drbd restart service It wont see each other

image
image1817×266 23.7 KB

Should I configure the pref.Nic in Storage Pools?

image
image1840×630 40.9 KB

Thank you.

2

Don’t get fooled by the wording: PrefNic does NOT equal “preferred” NIC, but also use others.

Meaning: setting the DRBD Replication communication to this NIC first, if some (the majority?) nodes can access the network behind the NIC and communicate with each other, they will do. Other nodes not connected to this network - you mentioned a cross cable! - won’t take part in the DRBD Replication communication.
A DRBD quorum (you might use your 3rd node for this to get HA features with a tie-breaker in LINSTOR / DRBD) does need to take part in replication communication or won’t be a functioning quorum with all negative effects on the HA features you’d love to have.

See my annotation in Proxmox: no DRBD storage while LINBIT controller is down - #19 by proxmeup

I actually wanted to have already moulded the topic of PrefNic / fallback NIC into a question…

3

Hi Kentrill , i only recently statrted testing linstor and proxmox and i am looking to do the same setup. Did you find the process of setting up another 10gb nic for replication only purposes and would you ind sharing that setup process with me.

4

Hi shane, actually I found using 10 GBIT is quite usless in this setup, because 3rd server as tie breaker cannot be as role tie breaker DRBD with 10 GBit replica with cross cable. All 3 servers must be on the same network. DRBD 9 is quite strong and fast in 1GBIT switches. I have test environment with NVMe disks and SSD disks and all is sync within a few minutes

5

I have a huge amount of data that would need to be replicated and kept synchronized. The data size currently is about 12TB of data and i am just afraid that keeping them synchronized is going to be an Issue. That data is kept on spinning disks currently and accessed often for data retrieval. That is why i was hoping that i could make use of the 10Gb cards for replication only