PUBLIC/gpu-turnstile
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 19 Wiki Activity
90 Commits 1 Branch 25 Tags
31ee6013db4e1ef96c7cb2c8e8d242b0000d47fd
Commit Graph
3 Commits
Author SHA1 Message Date
mram d2c49e52fa Monitor: show Ollama's loaded models, their VRAM footprint, and busy state 
The status snapshot now queries /api/ps (2s timeout so a wedged Ollama
cannot stall the channel) and the ollama line renders e.g.
'UP · llama3.1:8b (4.8 GiB VRAM) · busy'; comfy gets the busy marker
too while an image job runs.
 2026-09-22 12:44:04 +02:00
mram db11da8307 Rename to gpu-turnstile; swap port roles 
The proxy now listens on the standard service ports (Ollama :11434,
ComfyUI :8188) and the actual services move one port up (:11435, :8189).
Metric prefix is now gpu_turnstile_.
 2026-09-20 18:10:22 +02:00
mram 065c294a96 gpulock: GPU arbitration proxy for Ollama + ComfyUI 
Implements SPEC.md: two listeners, one writer-preferring two-mode lock,
Ollama unload before image jobs, ComfyUI history polling + VRAM free,
optional model warm-up, healthz/metrics endpoints, streaming-safe
reverse proxies, Dockerfile and Gitea Actions CI.
 2026-09-20 18:05:20 +02:00