P
pi-session-affinity
Faster pi on self-hosted and gateway-routed models: keeps each conversation on the inference engine that holds its prompt cache with a per-session routing header, plus an optional post-compaction boundary request.
- Weekly downloads
- 480
- Monthly downloads
- 700
- Stars
- 0
- Users (7 days)
- 0
- Likes
- 0
Install
Pi
pi install npm:pi-session-affinity- Version
- 1.1.1
- Publisher
- lobo235
- License
- MIT
- Repository
- lobo235/pi-session-affinity