session-affinity

该仓库用于记录解决基于 URL 查询参数（如 appid 和 roomid）的 WebSocket 请求路由与会话亲和性问题。通过合理配置和负载均衡策略，确保客户端在扩容和重连的情况下，能够始终连接到相同的 Pod，保持 WebSocket 会话的稳定性与一致性。

Hermes Agent plugin for fail-closed, session-derived custom request headers across named local and OpenAI-compatible providers.

One OpenAI-compatible endpoint in front of three vLLM replicas. Pins each conversation to the same GPU so its KV cache stays warm, sends cheap work to the small tier, and tracks token budgets per agent.

Load Balancing Test: Example Shiny App

A Go microservice that routes tasks to workers while maintaining session affinity with retry mechanisms

Rotate Pi provider session-affinity IDs without losing local conversation history.

Upstream-first downstream fork of OmniRoute for hard session-lifetime connection leases, continuity, and capacity-safe managed-provider routing.