66 lines
3.3 KiB
Markdown
66 lines
3.3 KiB
Markdown
# Cluster & Storage Upgrade Project
|
|
|
|
## Goals:
|
|
1. Fast on-node storage for k8s+ceph, useful of containers requiring a little bit of block storage
|
|
- Nextcloud's configuration files + php scripts
|
|
- pict-rs's sled DB
|
|
- relay's sled DB
|
|
- conduit's rocksdb
|
|
- redis' storage
|
|
- possibly gitea's git repos
|
|
2. Off-cluster object-storage (probably with Garage, existing hardware - nextcloud box)
|
|
- Nextcloud's data
|
|
- pict-rs's data
|
|
- synapse's data
|
|
3. Retire GlusterFS Pool
|
|
- Frees up 3 rock64s for application nodes (or otherwise)
|
|
|
|
Stretch:
|
|
1. Move Postgres onto SoQuartz blades (cost: $363 or $726)
|
|
- Frees up 4 rock64s for application nodes (or otherwise)
|
|
2. Retire Raspberry Pi 4s
|
|
- Give to friends or something
|
|
|
|
## Devices:
|
|
|
|
| Count | Cost (per) | Cost (total) | Item | Link |
|
|
| ----- | ---------- | ------------ | ----------------------------------- | ----------------------------------------------------------------------------------------- |
|
|
| 5\* | $80.0 | $400.0 | WD Red SN700 NVMe SSD | https://www.westerndigital.com/products/internal-drives/wd-red-sn700-nvme-ssd#WDS500G1R0C |
|
|
| 5\* | $50.0 | $250.0 | 4GB SoQuartz module | https://pine64.com/product/soquartz-4gb-compute-module-w/ |
|
|
| 5\* | $30.0 | $150.0 | SoQuartz Blade | https://pine64.com/product/soquartz-blade/ |
|
|
| 5\* | $16.0 | $80.0 | 16GB EMMC module | https://pine64.com/product/16gb-emmc-module/ |
|
|
| 5\* | $5.5 | $27.5 | USB to Type H Barrel Power Cable | https://pine64.com/product/2-meters-length-usb-to-type-h-barrel-power-cable/ |
|
|
| ----- | ---------- | ------------ | ----------------------------------- | ----------------------------------------------------------------------------------------- |
|
|
| 1 | $47.0 | $47.0 | Compute Module 4 IO board | https://www.raspberrypi.com/products/compute-module-4-io-board/ |
|
|
| 1 | $30.0 | $30.0 | Anker 360 Charger (60W) | https://www.anker.com/products/a2123?variant=37436925477014&ref=collectionBuy |
|
|
| 1 | $5.0 | $5.0 | USB Adapter for EMMC Module | https://pine64.com/product/usb-adapter-for-emmc-module/ |
|
|
| 1 | $2.0 | $2.0 | Serial Console "Woodpecker" Edition | https://pine64.com/product/serial-console-woodpecker-edition/ |
|
|
|
|
\*5 of would be nice, but starting with just 1 makes the most sense
|
|
|
|
#### Base Price
|
|
_(1 of each)_
|
|
$265.5
|
|
|
|
#### Max Price
|
|
_(5 of each)_
|
|
$991.5
|
|
|
|
## Timeline:
|
|
1. February 1, 2023
|
|
- Have Proof-of-Concept SoQuartz Blade(s)
|
|
- NixOS booting reliably
|
|
- k3s installed
|
|
- ceph
|
|
- metallb
|
|
- ingress-nginx
|
|
- cert-manager
|
|
2. March 1, 2023
|
|
- Mastodon migrated to blade cluster
|
|
- pict-rs migrated to blade cluster
|
|
- relay migrated to blade cluster
|
|
3. April 1, 2023
|
|
- Remaining services migrated to SoQuartz blade cluster
|
|
- Extra Rock64s added into cluster
|
|
- Raspberry Pi 4s retired
|