spark-control

connecting…

Configuration needed. Run the Configure Sparks action in StartOS to set hostnames, then run Test Connection.

OpenAI-compatible endpoint

Base URL —

Model ID —

curl example

Swap in progress 0:00

Starting…

Show technical logs

Always-on services

LLM swap

Add downloaded model to catalog

It will appear as a new card you can swap to. Knob values become its default launch flags — you can tweak later via the model's "Advanced" panel.

Key (URL-safe id) Display name Repo (read-only) Size (GB) Mode Description (optional)

Default launch knobs Max context (tokens) GPU memory % 0.85 Fast safetensors loading Prefix caching FP8 KV cache

Advanced settings

Custom values are stored in the package volume and survive package updates. Empty fields fall back to defaults.

Max context (tokens) GPU memory % Fast safetensors loading (faster cold start) Prefix caching (speeds up repeated prefixes) FP8 KV cache (halves context memory)

HuggingFace repo

Where Spark 1 only (solo) Both Sparks (cluster, copy in parallel)

Downloading… 0:00

Connecting…

Show technical logs

Checking for updates…

Pending commits

Applying update…

0:00

Show technical logs

vLLM Parakeet Magpie