← Back to the list
P

pi-session-affinity

Faster pi on self-hosted and gateway-routed models: keeps each conversation on the inference engine that holds its prompt cache with a per-session routing header, plus an optional post-compaction boundary request.

Weekly downloads
480
Monthly downloads
700
Stars
0
Users (7 days)
0
Likes
0

Install

Pi
pi install npm:pi-session-affinity
Version
1.1.1
Publisher
lobo235
License
MIT