PUBLIC/gpu-turnstile
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 3 Wiki Activity
15 Commits 1 Branch 9 Tags
08d02d8fa85dc60d9109ea81e78552e6ef8f73d3
Commit Graph
5 Commits
Author SHA1 Message Date
mram bacb26772a Add LLM busy modes: wait (hang) or reject with Retry-After 
LLM_BUSY_MODE=reject answers blocked LLM requests immediately with
LLM_BUSY_STATUS (default 503, 429 works) and Retry-After, so routers
like LiteLLM can cool down and retry instead of holding a hung
connection. The default wait mode now also sends Retry-After when
LLM_WAIT_TIMEOUT expires. Document the service account (LocalSystem
default, NT SERVICE virtual-account hardening) and the Program
Files / ProgramData install layout.
 2026-09-20 21:43:03 +02:00
mram 5f6a22c2cf Pin compose example to v0.1.2
ci / test (push) Successful in 47s
Details
ci / docker (push) Successful in 1m5s
Details
2026-09-20 20:07:38 +02:00
mram 20d5439b5f Retry upstream connection-refused with exponential backoff 
A refused dial (service down/restarting) is retried with a wait that
doubles from BACKOFF_INITIAL (1s) up to BACKOFF_MAX (60s) until the
upstream answers or the client disconnects. Handles the Windows WSA
errno (10061) as well as POSIX ECONNREFUSED. compose.yaml.example now
uses host.docker.internal like the working local deployment.
 2026-09-20 19:45:48 +02:00
mram 3aaa5d80a9 CI: lowercase image repository name; compose example too
ci / test (push) Successful in 49s
Details
ci / docker (push) Successful in 1m7s
Details 
Docker registry names must be lowercase, so PUBLIC/gpu-turnstile was
rejected by buildx. The workflow now lowercases gitea.repository.
 2026-09-20 19:25:37 +02:00
mram cef845c2e3 Add compose.yaml.example; ignore local compose files 2026-09-20 19:24:26 +02:00