Skip to content

feat: keep several prompt cache entries (--prompt-cache-entries) and evict under memory pressure - #210

Merged
solderzzc merged 2 commits into
SharpAI:mainfrom
CodeAndCanvas728:pr/prompt-cache-lru
Oct 5, 2026
Merged

solderzzc merged 2 commits into
SharpAI:mainfrom
CodeAndCanvas728:pr/prompt-cache-lru

Commits

Commits on Oct 5, 2026