If I change the layer-stack from DRBD to STORAGEโฆ
root@gateway:~# linstor resource-group list
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ ResourceGroup โ SelectFilter โ VlmNrs โ Description โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ DfltRscGrp โ PlaceCount: 2 โ โ โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ ha-lvm-rg โ PlaceCount: 2 โ 0 โ โ
โ โ StoragePool(s): ha-lvm-storage โ โ โ
โ โ LayerStack: ['STORAGE'] โ โ โ
โ โ ProviderList: ['LVM_THIN', 'LVM'] โ โ โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
root@gateway:~#
โฆ then I can suddenly create resources:
root@gateway:~# linstor resource-group spawn-resources ha-lvm-rg test 1GiB
SUCCESS:
Volume definition with number '0' successfully created in resource definition 'test'.
SUCCESS:
Description:
New resource definition 'test' created.
Details:
Resource definition 'test' UUID is: 568ff267-b77b-41ba-ad26-e222999813b0
SUCCESS:
Successfully set property key(s): StorPoolName
SUCCESS:
Successfully set property key(s): StorPoolName
SUCCESS:
Description:
Resource 'test' successfully autoplaced on 2 nodes
Details:
Used nodes (storage pool name): 'gateway (ha-lvm-storage)', 'tvbox (ha-lvm-storage)'
SUCCESS:
(gateway) Volume number 0 of resource 'test' [LVM-Thin] created
SUCCESS:
Created resource 'test' on 'gateway'
SUCCESS:
(tvbox) Volume number 0 of resource 'test' [LVM-Thin] created
SUCCESS:
Created resource 'test' on 'tvbox'
root@gateway:~# linstor resource list
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ ResourceName โ Node โ Layers โ Usage โ Conns โ State โ CreatedOn โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ test โ gateway โ STORAGE โ โ Ok โ Created โ 2025-12-25 23:21:26 โ
โ test โ tvbox โ STORAGE โ โ Ok โ Created โ 2025-12-25 23:21:26 โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
root@gateway:~# linstor resource-definition list
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ ResourceName โ ResourceGroup โ Layers โ State โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ test โ ha-lvm-rg โ STORAGE โ ok โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
root@gateway:~#
However proxmox still fails to move exiting VM disks to the DRBD storage:
create full clone of drive scsi0 (local-lvm:vm-9900-disk-1)
NOTICE
Trying to create diskful resource (pm-bacfc095) on (gateway).
Diskfull assignment on gateway failed, let's autoplace it.
TASK ERROR: storage migration failed: API Return-Code: 500. Message: Could not autoplace resource pm-bacfc095, because: [{"ret_code":-4611686018407201820,"message":"Not enough available nodes","details":"Not enough nodes fulfilling the following auto-place criteria:\n * has a deployed storage pool named [ha-lvm-storage]\n * the storage pools have to have at least '33554432' free space\n * the current access context has enough privileges to use the node and the storage pool\n * the node is online\n\nAuto-place configuration details:\n Replica count: 2\n Additional replica count: 2\n Storage pool name:\n ha-lvm-storage\n Do not place with resource:\n pm-bacfc095\n Do not place with resource (regex): \n Layer stack:\n STORAGE\n Allowed Providers:\n LVM_THIN\n LVM\n Diskless on remaining: false\n\nAuto-placing resource: pm-bacfc095","obj_refs":{"RscDfn":"pm-bacfc095"},"created_at":"2025-12-25T23:26:22.228384239+01:00"}] at /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 437. PVE::Storage::Custom::LINSTORPlugin::alloc_image("PVE::Storage::Custom::LINSTORPlugin", "ha-lvm", HASH(0x563438107068), 9900, "raw", undef, 33554432) called at /usr/share/perl5/PVE/Storage.pm line 1177 eval {...} called at /usr/share/perl5/PVE/Storage.pm line 1177 PVE::Storage::__ANON__() called at /usr/share/perl5/PVE/Cluster.pm line 649 eval {...} called at /usr/share/perl5/PVE/Cluster.pm line 615 PVE::Cluster::__ANON__("storage-ha-lvm", undef, CODE(0x5634380f9818)) called at /usr/share/perl5/PVE/Cluster.pm line 694 PVE::Cluster::cfs_lock_storage("ha-lvm", undef, CODE(0x5634380f9818)) called at /usr/share/perl5/PVE/Storage/Plugin.pm line 770 PVE::Storage::Plugin::cluster_lock_storage("PVE::Storage::Custom::LINSTORPlugin", "ha-lvm", 1, undef, CODE(0x5634380f9818)) called at /usr/share/perl5/PVE/Storage.pm line 1183 PVE::Storage::vdisk_alloc(HASH(0x5634380fa1d8), "ha-lvm", 9900, "raw", undef, 33554432) called at /usr/share/perl5/PVE/QemuServer.pm line 7917 PVE::QemuServer::clone_disk(HASH(0x5634380fa1d8), HASH(0x563431b8f9f0), HASH(0x5634381b45e8), 1, ARRAY(0x563438276938), undef, undef, undef, ...) called at /usr/share/perl5/PVE/API2/Qemu.pm line 4834 eval {...} called at /usr/share/perl5/PVE/API2/Qemu.pm line 4804 PVE::API2::Qemu::__ANON__() called at /usr/share/perl5/PVE/AbstractConfig.pm line 302 PVE::AbstractConfig::__ANON__() called at /usr/share/perl5/PVE/Tools.pm line 266 eval {...} called at /usr/share/perl5/PVE/Tools.pm line 266 PVE::Tools::lock_file_full("/var/lock/qemu-server/lock-9900.conf", 10, 0, CODE(0x563438017a08)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 305 PVE::AbstractConfig::__ANON__("PVE::QemuConfig", 9900, 10, 0, CODE(0x563431b85188)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 325 PVE::AbstractConfig::lock_config_full("PVE::QemuConfig", 9900, 10, CODE(0x563431b85188)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 332 PVE::AbstractConfig::lock_config("PVE::QemuConfig", 9900, CODE(0x563431b85188)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 5080 PVE::API2::Qemu::__ANON__("UPID:gateway:000D2D3C:00B7E38F:694DBA0E:qmmove:9900:root\@pam:") called at /usr/share/perl5/PVE/RESTEnvironment.pm line 650 eval {...} called at /usr/share/perl5/PVE/RESTEnvironment.pm line 641 PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x563431b798f8), "qmmove", 9900, "root\@pam", CODE(0x56343827c0f0)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 5083 PVE::API2::Qemu::__ANON__(HASH(0x5634381262c0)) called at /usr/share/perl5/PVE/RESTHandler.pm line 503 PVE::RESTHandler::handle("PVE::API2::Qemu", HASH(0x563435eb08e8), HASH(0x5634381262c0)) called at /usr/share/perl5/PVE/HTTPServer.pm line 192 eval {...} called at /usr/share/perl5/PVE/HTTPServer.pm line 144 PVE::HTTPServer::rest_handler(PVE::HTTPServer=HASH(0x56343801b7b0), "::ffff:192.168.1.110", "POST", "/nodes/gateway/qemu/9900/move_disk", HASH(0x563438261100), HASH(0x563431b8f138), "extjs") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 982 eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 952 PVE::APIServer::AnyEvent::handle_api2_request(PVE::HTTPServer=HASH(0x56343801b7b0), HASH(0x563438107188), HASH(0x563438261100), "POST", "/api2/extjs/nodes/gateway/qemu/9900/move_disk") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1226 eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1218 PVE::APIServer::AnyEvent::handle_request(PVE::HTTPServer=HASH(0x56343801b7b0), HASH(0x563438107188), HASH(0x563438261100), "POST", "/api2/extjs/nodes/gateway/qemu/9900/move_disk") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1714 PVE::APIServer::AnyEvent::__ANON__(AnyEvent::Handle=HASH(0x563438126728), "storage=ha-lvm&delete=1&disk=scsi0") called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 1505 AnyEvent::Handle::__ANON__(AnyEvent::Handle=HASH(0x563438126728)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 1315 AnyEvent::Handle::_drain_rbuf(AnyEvent::Handle=HASH(0x563438126728)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 2015 AnyEvent::Handle::__ANON__() called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Loop.pm line 248 AnyEvent::Loop::one_event() called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Impl/Perl.pm line 46 AnyEvent::CondVar::Base::_wait(AnyEvent::CondVar=HASH(0x563431bb9990)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent.pm line 2034 AnyEvent::CondVar::Base::recv(AnyEvent::CondVar=HASH(0x563431bb9990)) called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 2066 PVE::APIServer::AnyEvent::run(PVE::HTTPServer=HASH(0x56343801b7b0)) called at /usr/share/perl5/PVE/Service/pvedaemon.pm line 56 PVE::Service::pvedaemon::run(PVE::Service::pvedaemon=HASH(0x563437b788d8)) called at /usr/share/perl5/PVE/Daemon.pm line 171 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 171 PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x563437b788d8)) called at /usr/share/perl5/PVE/Daemon.pm line 390 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 379 PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x563437b788d8), undef) called at /usr/share/perl5/PVE/Daemon.pm line 549 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 547 PVE::Daemon::start(PVE::Service::pvedaemon=HASH(0x563437b788d8), undef) called at /usr/share/perl5/PVE/Daemon.pm line 657 PVE::Daemon::__ANON__(HASH(0x56342f603968)) called at /usr/share/perl5/PVE/RESTHandler.pm line 503 PVE::RESTHandler::handle("PVE::Service::pvedaemon", HASH(0x563437b78c20), HASH(0x56342f603968), 1) called at /usr/share/perl5/PVE/RESTHandler.pm line 1019 eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 1000 PVE::RESTHandler::cli_handler("PVE::Service::pvedaemon", "pvedaemon start", "start", ARRAY(0x56342f9129e0), ARRAY(0x56342f956f10), undef, undef, undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 627 PVE::CLIHandler::__ANON__(ARRAY(0x56342f604160), CODE(0x56342fa05538), undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 708 PVE::CLIHandler::run_cli_handler("PVE::Service::pvedaemon", "prepare", CODE(0x56342fa05538)) called at /usr/bin/pvedaemon line 27
VM creation sometimes work and sometimes not:
NOTICE
Trying to create diskful resource (pm-54e3d011) on (gateway).
scsi0: successfully created disk 'ha-lvm:pm-54e3d011_101,iothread=1,size=2G,ssd=1'
TASK OK
NOTICE
Trying to create diskful resource (pm-2fab2977) on (gateway).
Diskfull assignment on gateway failed, let's autoplace it.
TASK ERROR: unable to create VM 102 - API Return-Code: 500. Message: Could not autoplace resource pm-2fab2977, because: [{"ret_code":-4611686018407201820,"message":"Not enough available nodes","details":"Not enough nodes fulfilling the following auto-place criteria:\n * has a deployed storage pool named [ha-lvm-storage]\n * the storage pools have to have at least '2097152' free space\n * the current access context has enough privileges to use the node and the storage pool\n * the node is online\n\nAuto-place configuration details:\n Replica count: 2\n Additional replica count: 2\n Storage pool name:\n ha-lvm-storage\n Do not place with resource:\n pm-2fab2977\n Do not place with resource (regex): \n Layer stack:\n STORAGE\n Allowed Providers:\n LVM_THIN\n LVM\n Diskless on remaining: false\n\nAuto-placing resource: pm-2fab2977","obj_refs":{"RscDfn":"pm-2fab2977"},"created_at":"2025-12-25T23:40:28.185788515+01:00"}] at /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 437. PVE::Storage::Custom::LINSTORPlugin::alloc_image("PVE::Storage::Custom::LINSTORPlugin", "ha-lvm", HASH(0x56343827c198), 102, "raw", undef, 2097152) called at /usr/share/perl5/PVE/Storage.pm line 1177 eval {...} called at /usr/share/perl5/PVE/Storage.pm line 1177 PVE::Storage::__ANON__() called at /usr/share/perl5/PVE/Cluster.pm line 649 eval {...} called at /usr/share/perl5/PVE/Cluster.pm line 615 PVE::Cluster::__ANON__("storage-ha-lvm", undef, CODE(0x563438261820)) called at /usr/share/perl5/PVE/Cluster.pm line 694 PVE::Cluster::cfs_lock_storage("ha-lvm", undef, CODE(0x563438261820)) called at /usr/share/perl5/PVE/Storage/Plugin.pm line 770 PVE::Storage::Plugin::cluster_lock_storage("PVE::Storage::Custom::LINSTORPlugin", "ha-lvm", 1, undef, CODE(0x563438261820)) called at /usr/share/perl5/PVE/Storage.pm line 1183 PVE::Storage::vdisk_alloc(HASH(0x5634380f9c08), "ha-lvm", 102, "raw", undef, 2097152) called at /usr/share/perl5/PVE/API2/Qemu.pm line 638 PVE::API2::Qemu::__ANON__("scsi0", HASH(0x5634380ffb40)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 104 PVE::API2::Qemu::__ANON__(HASH(0x563438276950), CODE(0x563438276a40)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 691 eval {...} called at /usr/share/perl5/PVE/API2/Qemu.pm line 691 create_disks(PVE::RPCEnvironment=HASH(0x563431b798f8), "root\@pam", HASH(0x563438276950), "x86_64", HASH(0x5634380f9c08), 102, undef, HASH(0x563438276950), ...) called at /usr/share/perl5/PVE/API2/Qemu.pm line 1449 eval {...} called at /usr/share/perl5/PVE/API2/Qemu.pm line 1448 PVE::API2::Qemu::__ANON__() called at /usr/share/perl5/PVE/AbstractConfig.pm line 302 PVE::AbstractConfig::__ANON__() called at /usr/share/perl5/PVE/Tools.pm line 266 eval {...} called at /usr/share/perl5/PVE/Tools.pm line 266 PVE::Tools::lock_file_full("/var/lock/qemu-server/lock-102.conf", 1, 0, CODE(0x563438017ac8)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 305 PVE::AbstractConfig::__ANON__("PVE::QemuConfig", 102, 1, 0, CODE(0x5634380179a8)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 325 PVE::AbstractConfig::lock_config_full("PVE::QemuConfig", 102, 1, CODE(0x5634380179a8)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 1509 PVE::API2::Qemu::__ANON__() called at /usr/share/perl5/PVE/API2/Qemu.pm line 1553 eval {...} called at /usr/share/perl5/PVE/API2/Qemu.pm line 1553 PVE::API2::Qemu::__ANON__("UPID:gateway:000D465B:00B92DF3:694DBD5B:qmcreate:102:root\@pam:") called at /usr/share/perl5/PVE/RESTEnvironment.pm line 650 eval {...} called at /usr/share/perl5/PVE/RESTEnvironment.pm line 641 PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x563431b798f8), "qmcreate", 102, "root\@pam", CODE(0x5634380fa070)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 1577 PVE::API2::Qemu::__ANON__(HASH(0x563438276950)) called at /usr/share/perl5/PVE/RESTHandler.pm line 503 PVE::RESTHandler::handle("PVE::API2::Qemu", HASH(0x563435e41f10), HASH(0x563438276950)) called at /usr/share/perl5/PVE/HTTPServer.pm line 192 eval {...} called at /usr/share/perl5/PVE/HTTPServer.pm line 144 PVE::HTTPServer::rest_handler(PVE::HTTPServer=HASH(0x56343801b7b0), "::ffff:192.168.1.110", "POST", "/nodes/gateway/qemu", HASH(0x5634382612c8), HASH(0x563438244cb8), "extjs") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 982 eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 952 PVE::APIServer::AnyEvent::handle_api2_request(PVE::HTTPServer=HASH(0x56343801b7b0), HASH(0x5634381b4f00), HASH(0x5634382612c8), "POST", "/api2/extjs/nodes/gateway/qemu") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1226 eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1218 PVE::APIServer::AnyEvent::handle_request(PVE::HTTPServer=HASH(0x56343801b7b0), HASH(0x5634381b4f00), HASH(0x5634382612c8), "POST", "/api2/extjs/nodes/gateway/qemu") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1714 PVE::APIServer::AnyEvent::__ANON__(AnyEvent::Handle=HASH(0x56343811e7e0), "ostype=l26&numa=0&ide2=nas-templates%3Aiso%2Fubuntu-25.10-liv"...) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 1505 AnyEvent::Handle::__ANON__(AnyEvent::Handle=HASH(0x56343811e7e0)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 1315 AnyEvent::Handle::_drain_rbuf(AnyEvent::Handle=HASH(0x56343811e7e0)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Handle.pm line 2015 AnyEvent::Handle::__ANON__() called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Loop.pm line 248 AnyEvent::Loop::one_event() called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent/Impl/Perl.pm line 46 AnyEvent::CondVar::Base::_wait(AnyEvent::CondVar=HASH(0x563431bb9990)) called at /usr/lib/x86_64-linux-gnu/perl5/5.40/AnyEvent.pm line 2034 AnyEvent::CondVar::Base::recv(AnyEvent::CondVar=HASH(0x563431bb9990)) called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 2066 PVE::APIServer::AnyEvent::run(PVE::HTTPServer=HASH(0x56343801b7b0)) called at /usr/share/perl5/PVE/Service/pvedaemon.pm line 56 PVE::Service::pvedaemon::run(PVE::Service::pvedaemon=HASH(0x563437b788d8)) called at /usr/share/perl5/PVE/Daemon.pm line 171 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 171 PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x563437b788d8)) called at /usr/share/perl5/PVE/Daemon.pm line 390 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 379 PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x563437b788d8), undef) called at /usr/share/perl5/PVE/Daemon.pm line 549 eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 547 PVE::Daemon::start(PVE::Service::pvedaemon=HASH(0x563437b788d8), undef) called at /usr/share/perl5/PVE/Daemon.pm line 657 PVE::Daemon::__ANON__(HASH(0x56342f603968)) called at /usr/share/perl5/PVE/RESTHandler.pm line 503 PVE::RESTHandler::handle("PVE::Service::pvedaemon", HASH(0x563437b78c20), HASH(0x56342f603968), 1) called at /usr/share/perl5/PVE/RESTHandler.pm line 1019 eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 1000 PVE::RESTHandler::cli_handler("PVE::Service::pvedaemon", "pvedaemon start", "start", ARRAY(0x56342f9129e0), ARRAY(0x56342f956f10), undef, undef, undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 627 PVE::CLIHandler::__ANON__(ARRAY(0x56342f604160), CODE(0x56342fa05538), undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 708 PVE::CLIHandler::run_cli_handler("PVE::Service::pvedaemon", "prepare", CODE(0x56342fa05538)) called at /usr/bin/pvedaemon line 27
Even if the VM createion is successfully itโs not working:
blockdev: cannot open /dev/drbd/by-res/pm-54e3d011/0: No such file or directory
TASK ERROR: stat for '/dev/drbd/by-res/pm-54e3d011/0' failed - No such file or directory
Does this mean DRBD is not running on my nodes?
root@gateway:~# ls /dev/ | grep drbd
root@gateway:~#
root@gateway:~# linstor node info
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ Node โ Diskless โ LVM โ LVMThin โ ZFS/Thin โ File/Thin โ SPDK โ Remote SPDK โ Storage Spaces โ Storage Spaces/Thin โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ gateway โ + โ + โ + โ + โ + โ - โ + โ - โ - โ
โ tvbox โ + โ + โ + โ + โ + โ - โ + โ - โ - โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
โ Node โ DRBD โ LUKS โ NVMe โ Cache โ BCache โ WriteCache โ Storage โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโก
โ gateway โ - โ - โ - โ + โ - โ + โ + โ
โ tvbox โ - โ - โ - โ + โ - โ + โ + โ
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
root@gateway:~# modprobe drbd
root@gateway:~#
Iโm very confused.