[Linstor-Proxmox] Issues setting up LINSTOR storage with Proxmox VE: /mnt/pve/linstor not mounting

LINSTOR
1

I’m seeking guidance in troubleshooting and resolving setting up a Linstor resource group that I can mount to /mnt/pve/linstor on my proxmox nodes.

The commands I’ve used are:

root@veroandi:~# linstor resource-group create templates --storage-pool omni --place-count 3

root@veroandi:~# linstor volume-group create templates

root@veroandi:~# linstor resource-group spawn templates templates-res

My current configuration is as follows

root@veroandi:~# linstor node list
╭──────────────────────────────────────────────────────────╮
┊ Node     ┊ NodeType  ┊ Addresses                ┊ State  ┊
╞══════════════════════════════════════════════════════════╡
┊ skuld    ┊ SATELLITE ┊ 172.16.86.9:3366 (PLAIN) ┊ Online ┊
┊ urd      ┊ SATELLITE ┊ 172.16.86.8:3366 (PLAIN) ┊ Online ┊
┊ veroandi ┊ SATELLITE ┊ 172.16.86.7:3366 (PLAIN) ┊ Online ┊
╰──────────────────────────────────────────────────────────╯
root@veroandi:~# linstor storage-pool list
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool          ┊ Node     ┊ Driver   ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName                    ┊
╞═════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ skuld    ┊ DISKLESS ┊          ┊              ┊               ┊ False        ┊ Ok    ┊ skuld;DfltDisklessStorPool    ┊
┊ DfltDisklessStorPool ┊ urd      ┊ DISKLESS ┊          ┊              ┊               ┊ False        ┊ Ok    ┊ urd;DfltDisklessStorPool      ┊
┊ DfltDisklessStorPool ┊ veroandi ┊ DISKLESS ┊          ┊              ┊               ┊ False        ┊ Ok    ┊ veroandi;DfltDisklessStorPool ┊
┊ omni                 ┊ skuld    ┊ LVM      ┊ omni     ┊     1.69 TiB ┊      1.82 TiB ┊ False        ┊ Ok    ┊ skuld;omni                    ┊
┊ omni                 ┊ urd      ┊ LVM      ┊ omni     ┊     1.69 TiB ┊      1.82 TiB ┊ False        ┊ Ok    ┊ urd;omni                      ┊
┊ omni                 ┊ veroandi ┊ LVM      ┊ omni     ┊     1.69 TiB ┊      1.82 TiB ┊ False        ┊ Ok    ┊ veroandi;omni                 ┊
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
root@veroandi:~# linstor resource-group list
╭─────────────────────────────────────────────────────────────╮
┊ ResourceGroup ┊ SelectFilter         ┊ VlmNrs ┊ Description ┊
╞═════════════════════════════════════════════════════════════╡
┊ DfltRscGrp    ┊ PlaceCount: 2        ┊        ┊             ┊
╞┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄╡
┊ pve-rg        ┊ PlaceCount: 3        ┊ 0      ┊             ┊
┊               ┊ StoragePool(s): omni ┊        ┊             ┊
╞┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄╡
┊ templates     ┊ PlaceCount: 3        ┊ 0      ┊             ┊
┊               ┊ StoragePool(s): omni ┊        ┊             ┊
╰─────────────────────────────────────────────────────────────╯
root@veroandi:~# linstor volume-group list templates
╭──────────────────╮
┊ VolumeNr ┊ Flags ┊
╞══════════════════╡
┊ 0        ┊       ┊
╰──────────────────╯
root@veroandi:~# linstor resource list
╭───────────────────────────────────────────────────────────────────────────────────────────╮
┊ ResourceName  ┊ Node     ┊ Layers       ┊ Usage  ┊ Conns ┊    State ┊ CreatedOn           ┊
╞═══════════════════════════════════════════════════════════════════════════════════════════╡
┊ pm-4b4dabf5   ┊ skuld    ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:46 ┊
┊ pm-4b4dabf5   ┊ urd      ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:46 ┊
┊ pm-4b4dabf5   ┊ veroandi ┊ DRBD,STORAGE ┊ InUse  ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:45 ┊
┊ pm-6bec21f4   ┊ skuld    ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:44 ┊
┊ pm-6bec21f4   ┊ urd      ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:44 ┊
┊ pm-6bec21f4   ┊ veroandi ┊ DRBD,STORAGE ┊ InUse  ┊ Ok    ┊ UpToDate ┊ 2024-12-29 15:45:43 ┊
┊ templates-res ┊ skuld    ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-30 12:48:11 ┊
┊ templates-res ┊ urd      ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-30 12:48:11 ┊
┊ templates-res ┊ veroandi ┊ DRBD,STORAGE ┊ Unused ┊ Ok    ┊ UpToDate ┊ 2024-12-30 12:48:11 ┊
╰───────────────────────────────────────────────────────────────────────────────────────────╯
root@veroandi:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content iso,backup,vztmpl

lvmthin: local-lvm
        thinpool data
        vgname pve
        content images,rootdir

drbd: linstor
        resourcegroup pve-rg
        content rootdir,images
        controller 172.16.86.7

drbd: templates
       resourcegroup templates
      path /mnt/pve/linstor
       content iso,backup,vztmpl
       controller 172.16.86.7

pbs: aegis
        datastore terrorbyte
        server 192.168.86.5
        content backup
        fingerprint ...
        prune-backups keep-all=1
        username root@pam

root@veroandi:~# root@veroandi:~#

but every time I include the following in my storage cfg all of my nodes disappear from the datacentre page on the pve gui and nonthing shows up under “storage”.

drbd: templates
       resourcegroup templates
      path /mnt/pve/linstor
       content iso,backup,vztmpl
       controller 172.16.86.7
2

path is not a valid configuration option for the LINSTOR Proxmox VE plugin.

Also, the LINSTOR Plugin only supports content images,rootdir types, so it wouldn’t know what to do with storage types iso,backup,vztmpl.

If you really want DRBD replicated ISOs, templates, and backups, you could look into using DRBD Reactor and LINSTOR Gateway to create HA NFS shares to achieve this.

3

Thank you for the response. Due to other factors I decided to scrap my linstor cluster and instead use pve’s built-in replication.

One issue I did have was adding the DRBD to my storage.cfg would work sometimes and other types it would cause the entire cluster to fall over and for the life of me I couldn’t figure out why. I assume it had something to do with identation but every time I looked at the file it all looked indented correctly.

That said, I do really like the idea of Linstor, and it’ll probably be something I explore again in the future, particularly as PVE’s built-in replication throws me the odd error for reasons I’ve not been able to diagnose.