Please advise: 2 node cluster with add. quorum node

LINBIT SDS Integrations Proxmox VE
1

Hi,

I would like to build a 2-node Proxmox Cluster with a third node being a Raspberry PI using LINSTOR and DRBD.

  • PVE, current Proxmox software, nodes have disks
  • RasPi, current Raspberry PI OS, is diskless (only SD card) and should only be the quorum / tie breaker node

Can someone please advice which packages (DRBD, LINSTOR) to install on RasPi, including Package Repo setup and apt commands, for I seem to be not able to get it.

Next, please describe how to configure LINSTOR on PVE nodes and RasPI to achieve this setup. What I understand at the moment: one doesn’t configure DRBD in conf files or other way, for all will be done through LINSTOR. Correct?

Finally please help with Proxmox integration. From my point I get confused, because it seems that cluster setup in LINSTOR docs is not what should be done / is necessary doing LINSTOR on PVE (e.g. I understand that I don’t do LINSTOR resource definition on PVS, only controller, nodes, storage-pool, resource-group and volume-group). Correct? Please give a working example.

You also can point me to an existing documentation for such a setup and I will be happy. Please not to a full-fledged 3 node setup, because my scenario with diskless RasPi is different and I need examples where resources from a resource-group will only have two replicas on the PVE nodes. A resource should and can never be placed on the RasPi, but the RasPi should automatically be the tie breaker for every LINSTOR / DRBD resource and the cluster should be as resilient and self-healing as possible.

Thank you very much.

2

Hi, Acctualy I need the same, currently I’m testing 2node proxmox with Linstore and QDevice-Net see
https://pve.proxmox.com/wiki/Cluster_Manager

EDIT:
Instructions:

  1. Install PVE on 2 nodes
  2. edit repository
  3. disable enterprise repository
  4. How to Setup LINSTOR on Proxmox VE - LINBIT
  5. https://linbit.com/drbd-user-guide/linstor-guide-1_0-en/#s-linstor_ha
  6. Cluster Manager - Proxmox VE - QDevice-Net Setup

I’m currently testing. so it could be different :slight_smile: I strongly recommend in the product environment, 10GBit network and crosscable between 2 nodes for SYNC.

3

Sorry, needed some time.

Do you have a list what to install of LINBIT software.

What I want:

  • a couple of replicated volumes between 2 PVE nodes
  • HA failover of PVE CTs or VMs and their related DRBD volumes

What I have:

  • 2 PVE nodes
  • Proxmox QDevice

What I try to avoid:

  • LINBIT controller (and hence satellite) packages, except someone can tell me, what is is good for in my setup or why it makes things easier
4

In the end I’ve installed LINBIT packages on Proxmox as described in the guides. It is “somehow” working.

Closing this thread and moving on to what “somehow” seems problematic in another thread.