Grant
c6da6b0784
Bug fix: - config.py: empty PARAKEET_CONTAINER / MAGPIE_CONTAINER env vars (from migrating to v0.2.0+ where the field is optional and saved as '') now fall back to 'parakeet-asr' / 'magpie-tts' via the 'or' idiom. Confirmed live: services classify as 'running' instead of 'unknown'. UX: - Replaced text 'Copy' buttons with compact icon buttons (clipboard SVG) - Endpoint Base URL + Model ID + curl snippet are now click-to-copy themselves (the value AND a separate icon button) - Service cards: host, base URL, and model are now three separate copyable rows - Update banner: leading explanatory line — 'Updates to eugr/spark-vllm-docker — the upstream project that orchestrates vLLM on your Sparks. These are not firmware, OS, or model updates.' with a link to the repo.
214 lines
11 KiB
HTML
214 lines
11 KiB
HTML
<!doctype html>
|
|
<html lang="en">
|
|
<head>
|
|
<meta charset="utf-8">
|
|
<meta name="viewport" content="width=device-width, initial-scale=1, viewport-fit=cover">
|
|
<meta name="color-scheme" content="dark">
|
|
<title>spark-control</title>
|
|
<link rel="stylesheet" href="/static/style.css">
|
|
</head>
|
|
<body>
|
|
<header class="topbar">
|
|
<div class="brand">
|
|
<span class="logo-dot"></span>
|
|
<span>spark-control</span>
|
|
</div>
|
|
<div class="current" id="current">
|
|
<span class="muted">connecting…</span>
|
|
</div>
|
|
</header>
|
|
|
|
<main>
|
|
<section id="setup-banner" class="banner hidden">
|
|
<strong>Configuration needed.</strong>
|
|
<span>Run the <em>Configure Sparks</em> action in StartOS to set hostnames, then run <em>Test Connection</em>.</span>
|
|
</section>
|
|
|
|
<section id="endpoint-panel" class="endpoint-panel hidden">
|
|
<div class="ep-title muted small">OpenAI-compatible endpoint</div>
|
|
<div class="ep-row">
|
|
<span class="ep-label">Base URL</span>
|
|
<code class="ep-value copyable" id="ep-url" data-copy-self title="Click to copy">—</code>
|
|
<button class="icon-btn" data-copy="#ep-url" title="Copy base URL" aria-label="Copy">
|
|
<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><rect x="9" y="9" width="13" height="13" rx="2"/><path d="M5 15H4a2 2 0 0 1-2-2V4a2 2 0 0 1 2-2h9a2 2 0 0 1 2 2v1"/></svg>
|
|
</button>
|
|
</div>
|
|
<div class="ep-row">
|
|
<span class="ep-label">Model ID</span>
|
|
<code class="ep-value copyable" id="ep-model" data-copy-self title="Click to copy">—</code>
|
|
<button class="icon-btn" data-copy="#ep-model" title="Copy model ID" aria-label="Copy">
|
|
<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><rect x="9" y="9" width="13" height="13" rx="2"/><path d="M5 15H4a2 2 0 0 1-2-2V4a2 2 0 0 1 2-2h9a2 2 0 0 1 2 2v1"/></svg>
|
|
</button>
|
|
</div>
|
|
<details class="ep-curl">
|
|
<summary class="muted small">curl example</summary>
|
|
<pre id="ep-curl-snippet" class="snippet copyable" data-copy-self title="Click to copy"></pre>
|
|
<button class="icon-btn" data-copy="#ep-curl-snippet" title="Copy snippet" aria-label="Copy">
|
|
<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><rect x="9" y="9" width="13" height="13" rx="2"/><path d="M5 15H4a2 2 0 0 1-2-2V4a2 2 0 0 1 2-2h9a2 2 0 0 1 2 2v1"/></svg>
|
|
</button>
|
|
</details>
|
|
</section>
|
|
|
|
<section id="swap-panel" class="swap-panel hidden">
|
|
<div class="swap-header">
|
|
<span class="spinner"></span>
|
|
<span id="swap-title">Swap in progress</span>
|
|
<span class="spacer"></span>
|
|
<span class="timer" id="swap-elapsed">0:00</span>
|
|
</div>
|
|
<div class="phase-row">
|
|
<div class="phase" id="swap-phase">Starting…</div>
|
|
<div class="phase-detail muted small" id="swap-phase-detail"></div>
|
|
</div>
|
|
<div class="phase-track">
|
|
<div class="phase-fill" id="swap-phase-fill"></div>
|
|
</div>
|
|
<details id="swap-log-details">
|
|
<summary class="muted small">Show technical logs</summary>
|
|
<pre id="swap-log" class="log"></pre>
|
|
</details>
|
|
</section>
|
|
|
|
<section id="services-panel" class="services hidden">
|
|
<h2 class="section-title">Always-on services</h2>
|
|
<div id="services-grid" class="services-grid"></div>
|
|
</section>
|
|
|
|
<section id="models-section">
|
|
<div class="section-header">
|
|
<h2 class="section-title">LLM swap</h2>
|
|
<button id="open-download" class="btn small-btn">+ Download a new model</button>
|
|
</div>
|
|
|
|
<dialog id="catalog-dialog" class="modal">
|
|
<form method="dialog" class="modal-form" id="catalog-form">
|
|
<h3>Add downloaded model to catalog</h3>
|
|
<p class="muted small">It will appear as a new card you can swap to. Knob values become its default launch flags — you can tweak later via the model's "Advanced" panel.</p>
|
|
<label class="modal-row"><span>Key (URL-safe id)</span><input type="text" id="cd-key" required pattern="[a-zA-Z0-9_-]+"></label>
|
|
<label class="modal-row"><span>Display name</span><input type="text" id="cd-name" required></label>
|
|
<label class="modal-row"><span>Repo (read-only)</span><input type="text" id="cd-repo" readonly></label>
|
|
<label class="modal-row"><span>Size (GB)</span><input type="number" id="cd-size" step="0.1" min="0"></label>
|
|
<label class="modal-row"><span>Mode</span>
|
|
<select id="cd-mode">
|
|
<option value="solo">solo (Spark 1 only)</option>
|
|
<option value="cluster">cluster (both Sparks via Ray)</option>
|
|
</select>
|
|
</label>
|
|
<label class="modal-row"><span>Description (optional)</span><textarea id="cd-desc" rows="3"></textarea></label>
|
|
<fieldset class="modal-fieldset">
|
|
<legend>Default launch knobs</legend>
|
|
<label class="modal-row"><span>Max context (tokens)</span><input type="number" id="cd-mml" step="1024" min="1024" value="32768"></label>
|
|
<label class="modal-row"><span>GPU memory %</span><input type="range" id="cd-gmu" min="0.5" max="0.95" step="0.01" value="0.85"> <output id="cd-gmu-out">0.85</output></label>
|
|
<label class="modal-row inline"><input type="checkbox" id="cd-fst" checked> Fast safetensors loading</label>
|
|
<label class="modal-row inline"><input type="checkbox" id="cd-pcache" checked> Prefix caching</label>
|
|
<label class="modal-row inline"><input type="checkbox" id="cd-fp8" checked> FP8 KV cache</label>
|
|
</fieldset>
|
|
<div class="modal-actions">
|
|
<button type="button" id="cd-cancel" class="btn">Cancel</button>
|
|
<button type="submit" class="btn primary">Add to catalog</button>
|
|
</div>
|
|
</form>
|
|
</dialog>
|
|
|
|
<dialog id="advanced-dialog" class="modal">
|
|
<form method="dialog" class="modal-form" id="advanced-form">
|
|
<h3 id="adv-title">Advanced settings</h3>
|
|
<p class="muted small">Custom values are stored in the package volume and survive package updates. Empty fields fall back to defaults.</p>
|
|
<label class="modal-row"><span>Max context (tokens)</span><input type="number" id="adv-mml" step="1024" min="1024"></label>
|
|
<label class="modal-row"><span>GPU memory %</span><input type="range" id="adv-gmu" min="0.5" max="0.95" step="0.01"> <output id="adv-gmu-out"></output></label>
|
|
<label class="modal-row inline"><input type="checkbox" id="adv-fst"> Fast safetensors loading <span class="muted small">(faster cold start)</span></label>
|
|
<label class="modal-row inline"><input type="checkbox" id="adv-pcache"> Prefix caching <span class="muted small">(speeds up repeated prefixes)</span></label>
|
|
<label class="modal-row inline"><input type="checkbox" id="adv-fp8"> FP8 KV cache <span class="muted small">(halves context memory)</span></label>
|
|
<div class="modal-actions">
|
|
<button type="button" id="adv-delete" class="btn danger hidden">Delete model</button>
|
|
<span class="spacer"></span>
|
|
<button type="button" id="adv-cancel" class="btn">Cancel</button>
|
|
<button type="submit" class="btn primary">Save</button>
|
|
</div>
|
|
</form>
|
|
</dialog>
|
|
|
|
<section id="download-panel" class="download-panel hidden">
|
|
<div class="download-form" id="download-form">
|
|
<label class="dl-row">
|
|
<span class="dl-label">HuggingFace repo</span>
|
|
<input type="text" id="dl-repo" placeholder="e.g. RedHatAI/Qwen3.6-35B-A3B-NVFP4" autocomplete="off">
|
|
</label>
|
|
<div class="dl-row">
|
|
<span class="dl-label">Where</span>
|
|
<label class="radio"><input type="radio" name="dl-mode" value="solo" checked> Spark 1 only (solo)</label>
|
|
<label class="radio"><input type="radio" name="dl-mode" value="cluster"> Both Sparks (cluster, copy in parallel)</label>
|
|
</div>
|
|
<div class="dl-actions">
|
|
<button id="dl-cancel" class="btn">Cancel</button>
|
|
<button id="dl-start" class="btn primary">Start download</button>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="download-progress hidden" id="download-progress">
|
|
<div class="dl-header">
|
|
<span class="spinner"></span>
|
|
<span id="dl-title">Downloading…</span>
|
|
<span class="spacer"></span>
|
|
<span class="timer" id="dl-elapsed">0:00</span>
|
|
</div>
|
|
<div class="phase-row">
|
|
<div class="phase" id="dl-phase">Connecting…</div>
|
|
<div class="phase-detail muted small" id="dl-phase-detail"></div>
|
|
</div>
|
|
<div class="phase-track">
|
|
<div class="phase-fill" id="dl-progress-fill"></div>
|
|
</div>
|
|
<div class="dl-stats muted small" id="dl-stats"></div>
|
|
<details id="dl-log-details">
|
|
<summary class="muted small">Show technical logs</summary>
|
|
<pre id="dl-log" class="log"></pre>
|
|
</details>
|
|
</div>
|
|
</section>
|
|
|
|
<section id="cards" class="cards"></section>
|
|
</section>
|
|
|
|
<section id="update-banner" class="update-banner hidden">
|
|
<div class="ub-context muted small">
|
|
Updates to <strong><a href="https://github.com/eugr/spark-vllm-docker" target="_blank" rel="noopener">eugr/spark-vllm-docker</a></strong>
|
|
— the upstream project that orchestrates vLLM on your Sparks (launch-cluster.sh, recipes, mods). These are <em>not</em> firmware, OS, or model updates.
|
|
</div>
|
|
<div class="ub-row">
|
|
<span id="ub-text">Checking for updates…</span>
|
|
<span class="spacer"></span>
|
|
<button id="ub-details" class="btn small-btn hidden">Show details</button>
|
|
<button id="ub-apply" class="btn small-btn primary hidden">Apply update</button>
|
|
</div>
|
|
<details id="ub-list" class="hidden">
|
|
<summary class="muted small">Pending commits</summary>
|
|
<pre id="ub-log" class="snippet"></pre>
|
|
</details>
|
|
<div id="ub-progress" class="hidden">
|
|
<div class="phase-row">
|
|
<div class="phase" id="ub-phase">Applying update…</div>
|
|
<span class="spacer"></span>
|
|
<span class="timer" id="ub-elapsed">0:00</span>
|
|
</div>
|
|
<details>
|
|
<summary class="muted small">Show technical logs</summary>
|
|
<pre id="ub-stream" class="log"></pre>
|
|
</details>
|
|
</div>
|
|
</section>
|
|
|
|
<footer class="footer">
|
|
<div class="health">
|
|
<span class="health-item" id="h-vllm"><span class="dot"></span> vLLM</span>
|
|
<span class="health-item" id="h-parakeet"><span class="dot"></span> Parakeet</span>
|
|
<span class="health-item" id="h-magpie"><span class="dot"></span> Magpie</span>
|
|
</div>
|
|
<div class="muted small" id="updated"></div>
|
|
</footer>
|
|
</main>
|
|
|
|
<script src="/static/app.js"></script>
|
|
</body>
|
|
</html>
|