v0.1.8: two-Spark pipeline + kept-warm serving
- Secondary-Spark models now work in air-gapped mode: the LiteLLM proxy is dual-homed onto the default bridge (docker network connect) to reach the secondary's published vLLM port; grader containers stay on the --internal network with zero egress. The head-only enforcement is replaced by a secondary-configured check. - Extraction runs in parallel with grading when the extractor's model and every grader model in the wave sit on different Sparks (separate GPUs). - Keep-warm: single-wave jobs no longer tear the wave down between decks (was a ~6-min 31B reload per deck); a kept-warm wave that fails preflight is restarted once. Adjudicator reuses the live wave when its model is already serving instead of cycling the shared proxy. - clear_resident_containers (preJobStopContainers) now stops names on every configured Spark; health() reports containers on both Sparks. - Verified with a mocked dry-run of the full job loop (3 decks: one bring-up, zero mid-job teardowns, parallel overlap, stale-wave restart). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Fable 5
parent
7ec5222834
commit
506e6c79bd
@@ -120,7 +120,7 @@ Canonical repo: `https://gitea.ten31.ai/Ten31AI/boardroom-map`.
|
||||
|
||||
## Status
|
||||
|
||||
**v0.1.7 — live in production.** Deployed on a StartOS box driving a DGX Spark
|
||||
**v0.1.8 — live in production.** Deployed on a StartOS box driving a DGX Spark
|
||||
in single-spark air-gapped mode (gemma-4-31B panel: munger-lens /
|
||||
girdley-operator / buffett-owner). First full grading run completed
|
||||
2026-07-29: a three-deck company history graded end-to-end into a running
|
||||
@@ -138,7 +138,11 @@ dashboard, an at-a-glance strip per deck report, and a concise "At a glance"
|
||||
summary table atop every generated DECK_REPORT.md; v0.1.7 added company
|
||||
deletion from the dashboard (wipes the graded history, optionally restores
|
||||
the graded deck files to the inbox) so an evaluation can be re-run from
|
||||
scratch with a different model panel.
|
||||
scratch with a different model panel; v0.1.8 added the two-Spark pipeline —
|
||||
secondary-Spark models work in air-gapped mode (dual-homed proxy; graders
|
||||
keep zero egress), extraction and grading run in parallel when their models
|
||||
sit on different Sparks, and single-wave jobs keep the vLLMs warm across
|
||||
decks instead of reloading the 31B (~6 min) per deck.
|
||||
|
||||
Known optimization not yet done: the wave is torn down per deck, so the 31B
|
||||
reloads from disk (~6 min) between decks even when the model set is unchanged.
|
||||
|
||||
Reference in New Issue
Block a user