Auto-commit from giteapush.sh at 2025-05-10 10:07:17

documents/casestudies/genesissynccs.md

@@ -0,0 +1,99 @@
+# GenesisSync: Hybrid Object–Block Media Architecture for Broadcast Reliability and Scalable Archiving
+
+## Executive Summary
+
+GenesisSync is a hybrid storage architecture developed by Genesis Hosting Technologies to solve a persistent challenge in modern broadcast environments: enabling fast, local access for traditional DJ software while simultaneously ensuring secure, scalable, and redundant storage using object-based infrastructure.
+
+The system has been implemented in a live production environment, integrating StationPlaylist (SPL), AzuraCast, Mastodon, and MinIO object storage with ZFS-backed block storage. GenesisSync enables near-real-time file synchronization, integrity checking, and disaster recovery with no vendor lock-in or reliance on fragile mount hacks.
+
+---
+
+## The Problem
+
+- **SPL and similar DJ automation systems** require low-latency, POSIX-style file access for real-time media playback and cue-point accuracy.
+- **Web-native applications** (like Mastodon and AzuraCast) operate more efficiently using scalable object storage (e.g., S3, MinIO).
+- Legacy systems often can't interface directly with object storage without middleware or fragile FUSE mounts.
+- Previous attempts to unify object and block storage often led to file locking issues, broken workflows, or manual copy loops.
+
+---
+
+## The GenesisSync Architecture
+
+### Components
+
+- **Primary Storage**: ZFS-backed local block volumes (ext4 or ZFS)
+- **Backup Target**: MinIO object storage with S3-compatible APIs
+- **Apps**: StationPlaylist (Windows via SMB), AzuraCast (Docker), Mastodon
+- **Sync Tooling**: `rsync` for local, `mc mirror` for object sync
+
+### Sync Strategy
+
+- Local paths like `/mnt/azuracast` and `/mnt/stations` serve as the source of truth
+- Hourly cronjob or systemd timer mirrors data to MinIO using:
+  ```bash
+  mc mirror --overwrite --remove /mnt/azuracast localminio/azuracast-backup
+  ```
+- Optionally, `rsync` is used for internal ZFS → block migrations
+
+### Benefits
+
+- 🎧 Local-first for performance-sensitive apps  
+- ☁️ Cloud-capable for redundancy and long-term archiving  
+- 🔁 Resilient to network blips, container restarts, or media sync delays  
+
+---
+
+## Real-World Implementation
+
+| Component        | Role                                             |
+|------------------|--------------------------------------------------|
+| SPL              | Reads from ZFS mirror via SMB                   |
+| AzuraCast        | Writes directly to MinIO via S3 API             |
+| MinIO            | Remote object store for backups                 |
+| ZFS              | Local resilience, snapshots, and fast access    |
+| `mc`             | Handles object sync from local storage          |
+| `rsync`          | Handles safe internal migration and deduplication |
+
+### Recovery Drill
+
+- Snapshot-based rollback with ZFS for quick recovery
+- Verified `mc mirror` restore from MinIO to cold boot new environment
+
+---
+
+## Results
+
+| Metric                        | Value                                  |
+|-------------------------------|----------------------------------------|
+| Playback latency (SPL)       | <10ms via local ZFS                    |
+| Average mirror time (100MB)  | ~12 seconds                            |
+| Recovery time (5GB)          | <2 minutes                             |
+| Deployment size              | ~4.8TB usable                          |
+| Interruption events          | 0 file-level issues since deployment   |
+
+---
+
+## Lessons Learned
+
+- Object storage is powerful, but it's not a filesystem — don't pretend it is.
+- Legacy apps need real disk paths — even if the data lives in the cloud.
+- Syncing on your terms (with tools like `rsync` and `mc`) beats fighting with FUSE.
+- Snapshot + mirror = peace of mind.
+
+---
+
+## Future Roadmap
+
+- 📦 Add bidirectional sync detection for selective restores  
+- ✅ Build in sync integrity verification (hash/diff-based)  
+- 🔔 Hook Telegram alerts for failed syncs or staleness  
+- 🌐 Publish GenesisSync as an open-source utility  
+- 📄 Full documentation for third-party station adoption  
+
+---
+
+## About Genesis Hosting Technologies
+
+Genesis Hosting Technologies operates media infrastructure for Genesis Radio and affiliated stations. With a focus on low-latency access, hybrid cloud flexibility, and disaster resilience, GenesisSync represents a foundational step toward a smarter, mirrored media future.
+
+_"Fast on the air, safe on the backend."_

miscellaneous/bash/startemup.sh

@@ -7,7 +7,7 @@ declare -A VENV_APPS=(
   [recordtheshow]="app.py"
   [radiotoot]="app.py"
   [hostingtoot]="app.py"
-  [dbcheck]="dbcheck1.py"
+  [radiotoot]="live.py"
 )
 
 SCRIPT_BASE="/home/doc/genesis-tools"