Keysat
8d839e3714
- Add redaction gateway (redaction_gateway.py, redaction/ scrub + tests) - Add embeddings proxy and spark_embed service (Dockerfile + main.py) - Expand audio_proxy with speaker-aware handling; deep_health/health/server updates - Package: configureSparks action + sparkConfig model updates, manifest/main wiring - Docs: AUDIO_API, EMBEDDINGS, REDACTION_GATEWAY; HANDOFF and runbook/known-issues refresh
Spark Control
A browser-based control panel for a dual-DGX-Spark vLLM cluster on your LAN. See which LLM is loaded, swap to another with one click, and watch the streaming log until the new model is ready.
What you get on StartOS
After install you have:
- A web UI at the package's LAN address (HTTPS, .local).
- One-click model swaps for any model in your
models.yamlcatalog. - Live status of vLLM, Parakeet (STT), and Kokoro (TTS).
Getting set up
This package SSHes into your Spark server to run cluster commands, so it needs a one-time setup:
- Open Actions → Show Public Key. Copy the ed25519 public key that the package generated.
- SSH into each Spark and append the key to
~/.ssh/authorized_keys:echo "<paste-pubkey-here>" >> ~/.ssh/authorized_keys - Open Actions → Configure Sparks. Enter the LAN hostnames or IPs for Spark 1 and Spark 2, plus the SSH username (usually
<spark-user>). - Open the Web UI. It will hit each Spark to confirm. If both indicators are green you're done.
Using Spark Control
Once configured, open the web interface from your phone or laptop. The current model is shown in the top bar. Each available model has a card with a "Switch to this" button. Clicking it stops the current model and launches the new one — the log tails in real time until Application startup complete. appears (3–6 min depending on the model).
Editing the model catalog
The bundled catalog covers the models in the starter models.yaml. To add a model, ssh into the StartOS server and edit /embassy-data/package-data/volumes/spark-control/main/models.yaml, then restart the service. (A proper "Edit Model Catalog" action is on the roadmap.)