Sep 27
•
Articles
• 9 min read
TL;DR
| | Bifrost | LiteLLM 4 workers |
|---|---|---|
| p50 at 100 RPS | 1.01 ms | 5.84 ms |
| Success rate at 1,000 RPS | 100% | 94.9% |
| p99 at 1,000 RPS | 2.62 ms | 33,766 ms |
| Published container runs as | UID 1000 | root |
| SSRF guard on th...