Have created a linstor cluster consisting of 3 nodes. Everything went smoothly except I am getting total capacity of storage equals to the storage capacity of 1 node only. I have tried to reduce place-count [replica] to 1 to verify this.
In a second attempt, I added to 2 more nodes in the same cluster, but the situation didn’t changed.
Where I am wrong ? can someone guide me. ?
Can you show us how you have things configured?
# linstor resource list
# linstor storage-pool list
# linstor resource-group list
# linstor resource-group query-size-info <resource-group>
super@srv200:~$ linstor resource list
╭──────────────────────────────────────────────────────────────────────────────────╮
┊ ResourceName ┊ Node ┊ Port ┊ Usage ┊ Conns ┊ State ┊ CreatedOn ┊
╞══════════════════════════════════════════════════════════════════════════════════╡
┊ my_ssd_res ┊ srv200 ┊ 7000 ┊ Unused ┊ Ok ┊ UpToDate ┊ 2024-08-31 07:46:44 ┊
┊ my_ssd_res ┊ srv201 ┊ 7000 ┊ Unused ┊ Ok ┊ UpToDate ┊ 2024-08-31 07:46:44 ┊
┊ my_ssd_res ┊ srv202 ┊ 7000 ┊ Unused ┊ Ok ┊ TieBreaker ┊ 2024-08-31 07:46:43 ┊
╰──────────────────────────────────────────────────────────────────────────────────╯
super@srv200:~$ linstor storage-pool list
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞═════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ srv200 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ srv200;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ srv201 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ srv201;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ srv202 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ srv202;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ srv203 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ srv203;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ srv204 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ srv204;DfltDisklessStorPool ┊
┊ pool_ssd ┊ srv200 ┊ LVM ┊ vg_ssd ┊ 4.99 GiB ┊ 20.00 GiB ┊ False ┊ Ok ┊ srv200;pool_ssd ┊
┊ pool_ssd ┊ srv201 ┊ LVM ┊ vg_ssd ┊ 4.99 GiB ┊ 20.00 GiB ┊ False ┊ Ok ┊ srv201;pool_ssd ┊
┊ pool_ssd ┊ srv202 ┊ LVM ┊ vg_ssd ┊ 20.00 GiB ┊ 20.00 GiB ┊ False ┊ Ok ┊ srv202;pool_ssd ┊
┊ pool_ssd ┊ srv203 ┊ LVM ┊ vg_ssd ┊ 20.00 GiB ┊ 20.00 GiB ┊ False ┊ Ok ┊ srv203;pool_ssd ┊
┊ pool_ssd ┊ srv204 ┊ LVM ┊ vg_ssd ┊ 20.00 GiB ┊ 20.00 GiB ┊ False ┊ Ok ┊ srv204;pool_ssd ┊
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
super@srv200:~$ linstor resource-group list
╭─────────────────────────────────────────────────────────────────╮
┊ ResourceGroup ┊ SelectFilter ┊ VlmNrs ┊ Description ┊
╞═════════════════════════════════════════════════════════════════╡
┊ DfltRscGrp ┊ PlaceCount: 2 ┊ ┊ ┊
╞┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄╡
┊ my_ssd_group ┊ PlaceCount: 2 ┊ 0 ┊ ┊
┊ ┊ StoragePool(s): pool_ssd ┊ ┊ ┊
╰─────────────────────────────────────────────────────────────────╯
super@srv200:~$ linstor resource-group query-size-info my_ssd_group
╭────────────────────────────────────────────────────────────────╮
┊ MaxVolumeSize ┊ AvailableSize ┊ Capacity ┊ Next Spawn Result ┊
╞════════════════════════════════════════════════════════════════╡
┊ 20.00 GiB ┊ 29.98 GiB ┊ 39.99 GiB ┊ pool_ssd on srv202 ┊
┊ ┊ ┊ ┊ pool_ssd on srv203 ┊
╰────────────────────────────────────────────────────────────────╯
After re-reading this it sounds like you’re looking to create a single resource that spans the physical storage of multiple nodes. That is not possible with LINSTOR. LINSTOR doesn’t stripe or distribute data across multiple nodes, it places “full replicas” of resources on multiple nodes.