Cluster & Storage Upgrade Project

Goals:

1. Fast on-node storage for k8s+ceph, useful of containers requiring a little bit of block storage

• Nextcloud's configuration files + php scripts
• pict-rs's sled DB
• relay's sled DB
• conduit's rocksdb
• redis' storage
• possibly gitea's git repos

2. Off-cluster object-storage (probably with Garage, existing hardware - nextcloud box)

• Nextcloud's data
• pict-rs's data
• synapse's data

3. Retire GlusterFS Pool

• Frees up 3 rock64s for application nodes (or otherwise)

Stretch:

1. Move Postgres onto SoQuartz blades (cost: $363 or $726)

• Frees up 4 rock64s for application nodes (or otherwise)

2. Retire Raspberry Pi 4s

• Give to friends or something

Devices:

Count	Cost (per)	Cost (total)	Item	Link
5*	$80.0	$400.0	WD Red SN700 NVMe SSD	https://www.westerndigital.com/products/internal-drives/wd-red-sn700-nvme-ssd#WDS500G1R0C
5*	$50.0	$250.0	4GB SoQuartz module	https://pine64.com/product/soquartz-4gb-compute-module-w/
5*	$30.0	$150.0	SoQuartz Blade	https://pine64.com/product/soquartz-blade/
5*	$16.0	$80.0	16GB EMMC module	https://pine64.com/product/16gb-emmc-module/
5*	$5.5	$27.5	USB to Type H Barrel Power Cable	https://pine64.com/product/2-meters-length-usb-to-type-h-barrel-power-cable/
-----	----------	------------	-----------------------------------	-----------------------------------------------------------------------------------------
1	$47.0	$47.0	Compute Module 4 IO board	https://www.raspberrypi.com/products/compute-module-4-io-board/
1	$30.0	$30.0	Anker 360 Charger (60W)	https://www.anker.com/products/a2123?variant=37436925477014&ref=collectionBuy
1	$5.0	$5.0	USB Adapter for EMMC Module	https://pine64.com/product/usb-adapter-for-emmc-module/
1	$2.0	$2.0	Serial Console "Woodpecker" Edition	https://pine64.com/product/serial-console-woodpecker-edition/

*5 of would be nice, but starting with just 1 makes the most sense

Base Price

(1 of each) $265.5

Max Price

(5 of each) $991.5

Timeline:

1. February 1, 2023

• Have Proof-of-Concept SoQuartz Blade(s)
• NixOS booting reliably
• k3s installed
• ceph
• metallb
• ingress-nginx
• cert-manager

2. March 1, 2023

• Mastodon migrated to blade cluster
• pict-rs migrated to blade cluster
• relay migrated to blade cluster

3. April 1, 2023

• Remaining services migrated to SoQuartz blade cluster
• Extra Rock64s added into cluster
• Raspberry Pi 4s retired