mram bacb26772a Add LLM busy modes: wait (hang) or reject with Retry-After ...

LLM_BUSY_MODE=reject answers blocked LLM requests immediately with
LLM_BUSY_STATUS (default 503, 429 works) and Retry-After, so routers
like LiteLLM can cool down and retry instead of holding a hung
connection. The default wait mode now also sends Retry-After when
LLM_WAIT_TIMEOUT expires. Document the service account (LocalSystem
default, NT SERVICE virtual-account hardening) and the Program
Files / ProgramData install layout.

2026-09-20 21:43:03 +02:00

..

config_test.go

Add LLM busy modes: wait (hang) or reject with Retry-After

2026-09-20 21:43:03 +02:00

config.go

Add LLM busy modes: wait (hang) or reject with Retry-After

2026-09-20 21:43:03 +02:00