Hello,
I have a 3 node cluster of proxmox and followed the following guide to establish HA controller.
1: How to Setup LINSTOR on Proxmox VE - LINBIT
2: https://linbit.com/drbd-user-guide/linstor-guide-1_0-en/#s-linstor_ha
3: https://linbit.com/drbd-user-guide/linstor-guide-1_0-en/#s-proxmox-ls-HA
Everything works, when one node goes down. Another node controller is being auto started by reactor daemon.
But only issue is that in the gui I donโt see the available storage capacity. But it appears again when the node 1 comes back. I can migrate vm/LXC without any issue from node 2 to node 3 in the meantime.
This is what happens when the controller node goes down. (pvetest1 was controller node first)
root@pvetest2:~# linstor node list
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ Node โ NodeType โ Addresses โ State โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ pvetest1 โ SATELLITE โ 192.168.102.201:3366 (PLAIN) โ OFFLINE (Auto-eviction: 2024-09-21 23:44:04) โ
โ pvetest2 โ SATELLITE โ 192.168.102.202:3366 (PLAIN) โ Online โ
โ pvetest3 โ SATELLITE โ 192.168.102.203:3366 (PLAIN) โ Online โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
To cancel automatic eviction please consider the corresponding DrbdOptions/AutoEvict* properties on controller and / or node level
See 'linstor controller set-property --help' or 'linstor node set-property --help' for more details
root@pvetest2:~# drbd-reactorctl status
/etc/drbd-reactor.d/linstor_db.toml:
Promoter: Currently active on this node
โ drbd-services@linstor_db.target
โ โโ drbd-promote@linstor_db.service
โ โโ var-lib-linstor.mount
โ โโ linstor-controller.service
root@pvetest2:~# drbdadm status
linstor_db role:Primary
disk:UpToDate
pvetest1 connection:Connecting
pvetest3 role:Secondary
peer-disk:UpToDate
pm-c40c9e19 role:Secondary
disk:UpToDate
pvetest1 connection:Connecting
pvetest3 role:Secondary
peer-disk:UpToDate
pm-db8d36d7 role:Secondary
disk:UpToDate
pvetest1 connection:Connecting
pvetest3 role:Secondary
peer-disk:UpToDate
pm-e29692bb role:Primary
disk:UpToDate
pvetest1 connection:Connecting
pvetest3 role:Secondary
peer-disk:UpToDate
root@pvetest2:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content iso,vztmpl,backup
lvmthin: local-lvm
thinpool data
vgname pve
content rootdir,images
drbd: linstor_storage
content images, rootdir
controller 192.168.102.202,192.168.102.201,192.168.102.203
resourcegroup pve-rg
root@pvetest2:~# linstor storage-pool list
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ StoragePool โ Node โ Driver โ PoolName โ FreeCapacity โ TotalCapacity โ CanSnapshots โ State โ SharedName โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ DfltDisklessStorPool โ pvetest1 โ DISKLESS โ โ โ โ False โ Warning โ pvetest1;DfltDisklessStorPool โ
โ DfltDisklessStorPool โ pvetest2 โ DISKLESS โ โ โ โ False โ Ok โ pvetest2;DfltDisklessStorPool โ
โ DfltDisklessStorPool โ pvetest3 โ DISKLESS โ โ โ โ False โ Ok โ pvetest3;DfltDisklessStorPool โ
โ pve-storage โ pvetest1 โ LVM_THIN โ linstor_vg/thinpool โ โ โ True โ Warning โ pvetest1;pve-storage โ
โ pve-storage โ pvetest2 โ LVM_THIN โ linstor_vg/thinpool โ 25.31 GiB โ 25.54 GiB โ True โ Ok โ pvetest2;pve-storage โ
โ pve-storage โ pvetest3 โ LVM_THIN โ linstor_vg/thinpool โ 25.31 GiB โ 25.54 GiB โ True โ Ok โ pvetest3;pve-storage โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
WARNING:
Description:
No active connection to satellite 'pvetest1'
Details:
The controller is trying to (re-) establish a connection to the satellite. The controller stored the changes and as soon the satellite is connected, it will receive this update.
root@pvetest2:~#
root@pvetest2:~# pvesm list linstor_storage
Use of uninitialized value $owner in concatenation (.) or string at /usr/share/perl5/LINBIT/PluginHelper.pm line 65.
Use of uninitialized value $owner in concatenation (.) or string at /usr/share/perl5/LINBIT/PluginHelper.pm line 65.
Use of uninitialized value $owner in concatenation (.) or string at /usr/share/perl5/LINBIT/PluginHelper.pm line 65.
Use of uninitialized value $owner in concatenation (.) or string at /usr/share/perl5/LINBIT/PluginHelper.pm line 65.
Volid Format Type Size VMID
linstor_storage:pm-e29692bb_100 raw rootdir 8592252928 100