My Ceph cluster, and everything it runs exists on three Cisco UCS C240 M3’s.
Each node has a range of 10 to 12 WD Red HDD’s in each. There are two NVMe PCIe cards (1 Sandisk Fusion IOMemory SX350 & 1 Sandisk Fusion IOMemory PX600). Each node includes 128GB of RAM and are connected to two 10Gbps networks (physically independent switches) for public and cluster networks.
- rbd: stored on HDD devices
- rbd-ssd: stored on SSD devices
- lxd: stored on SSD devices
- k8s-rbd: stored on SSD devices
