Keysat
8d839e3714
- Add redaction gateway (redaction_gateway.py, redaction/ scrub + tests) - Add embeddings proxy and spark_embed service (Dockerfile + main.py) - Expand audio_proxy with speaker-aware handling; deep_health/health/server updates - Package: configureSparks action + sparkConfig model updates, manifest/main wiring - Docs: AUDIO_API, EMBEDDINGS, REDACTION_GATEWAY; HANDOFF and runbook/known-issues refresh
36 lines
1.8 KiB
Markdown
36 lines
1.8 KiB
Markdown
# Spark Control
|
||
|
||
A browser-based control panel for a dual-DGX-Spark vLLM cluster on your LAN. See which LLM is loaded, swap to another with one click, and watch the streaming log until the new model is ready.
|
||
|
||
## What you get on StartOS
|
||
|
||
After install you have:
|
||
|
||
- **A web UI** at the package's LAN address (HTTPS, .local).
|
||
- **One-click model swaps** for any model in your `models.yaml` catalog.
|
||
- **Live status** of vLLM, Parakeet (STT), and Kokoro (TTS).
|
||
|
||
## Getting set up
|
||
|
||
This package SSHes into your Spark server to run cluster commands, so it needs a one-time setup:
|
||
|
||
1. **Open Actions → Show Public Key.** Copy the ed25519 public key that the package generated.
|
||
2. **SSH into each Spark** and append the key to `~/.ssh/authorized_keys`:
|
||
```bash
|
||
echo "<paste-pubkey-here>" >> ~/.ssh/authorized_keys
|
||
```
|
||
3. **Open Actions → Configure Sparks.** Enter the LAN hostnames or IPs for Spark 1 and Spark 2, plus the SSH username (usually `<spark-user>`).
|
||
4. **Open the Web UI.** It will hit each Spark to confirm. If both indicators are green you're done.
|
||
|
||
## Using Spark Control
|
||
|
||
Once configured, open the web interface from your phone or laptop. The current model is shown in the top bar. Each available model has a card with a "Switch to this" button. Clicking it stops the current model and launches the new one — the log tails in real time until `Application startup complete.` appears (3–6 min depending on the model).
|
||
|
||
## Editing the model catalog
|
||
|
||
The bundled catalog covers the models in the starter `models.yaml`. To add a model, ssh into the StartOS server and edit `/embassy-data/package-data/volumes/spark-control/main/models.yaml`, then restart the service. (A proper "Edit Model Catalog" action is on the roadmap.)
|
||
|
||
## Source code
|
||
|
||
<https://github.com/Start9Labs/...> (TBD)
|